2023-08-18T20:28:04.516 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-18T20:28:04.518 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --archive /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445 --verbose --name yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445/orig.config.yaml 2023-08-18T20:28:04.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T20:28:04.653 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445 branch: main description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7372445' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 8204 sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_64a4fc940624dbc1b65654f740fd0424260cfd2a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-18_20:13:47 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-18T20:28:04.653 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_64a4fc940624dbc1b65654f740fd0424260cfd2a/qa; will attempt to use it 2023-08-18T20:28:04.655 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_64a4fc940624dbc1b65654f740fd0424260cfd2a/qa/tasks 2023-08-18T20:28:04.655 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-18T20:28:04.658 INFO:teuthology.task.internal:Checking packages... 2023-08-18T20:28:04.690 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '64a4fc940624dbc1b65654f740fd0424260cfd2a' 2023-08-18T20:28:04.691 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-18T20:28:04.691 INFO:teuthology.packaging:ref: None 2023-08-18T20:28:04.692 INFO:teuthology.packaging:tag: None 2023-08-18T20:28:04.692 INFO:teuthology.packaging:branch: main 2023-08-18T20:28:04.692 INFO:teuthology.packaging:sha1: 64a4fc940624dbc1b65654f740fd0424260cfd2a 2023-08-18T20:28:04.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-08-18T20:28:04.951 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5567.g64a4fc94 2023-08-18T20:28:04.951 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-18T20:28:04.960 INFO:teuthology.task.internal:no buildpackages task found 2023-08-18T20:28:04.960 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-18T20:28:04.967 INFO:teuthology.task.internal:Saving configuration 2023-08-18T20:28:04.990 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-18T20:28:04.998 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T20:28:05.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 20:14:59.374077', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-18T20:28:05.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 20:14:59.375186', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-18T20:28:05.048 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-18T20:28:05.055 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-08-18T20:28:05.055 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-08-18T20:28:05.056 INFO:teuthology.run_tasks:Running task console_log... 2023-08-18T20:28:05.142 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f60564b6f70>, signals=[15]) 2023-08-18T20:28:05.143 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-18T20:28:05.153 INFO:teuthology.task.internal:Opening connections... 2023-08-18T20:28:05.153 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:28:05.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T20:28:05.230 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:28:05.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T20:28:05.301 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-18T20:28:05.308 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-08-18T20:28:05.330 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-08-18T20:28:05.331 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-08-18T20:28:05.389 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-08-18T20:28:05.389 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-08-18T20:28:05.389 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-08-18T20:28:05.389 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-08-18T20:28:05.390 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-18T20:28:05.391 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T20:28:05.391 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:28:05.391 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-18T20:28:05.391 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-18T20:28:05.392 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-18T20:28:05.393 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-18T20:28:05.393 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-08-18T20:28:05.428 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2023-08-18T20:28:05.449 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-08-18T20:28:05.450 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-08-18T20:28:05.510 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux" 2023-08-18T20:28:05.511 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)" 2023-08-18T20:28:05.511 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel" 2023-08-18T20:28:05.511 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora" 2023-08-18T20:28:05.511 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/" 2023-08-18T20:28:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-18T20:28:05.513 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-18T20:28:05.514 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-08-18T20:28:05.549 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-18T20:28:05.563 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-18T20:28:05.570 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-18T20:28:05.571 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2023-08-18T20:28:05.576 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2023-08-18T20:28:05.596 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-18T20:28:05.605 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-18T20:28:05.606 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2023-08-18T20:28:05.636 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2023-08-18T20:28:05.679 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-18T20:28:05.736 INFO:teuthology.run_tasks:Running task kernel... 2023-08-18T20:28:05.754 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-08-18T20:28:05.755 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2023-08-18T20:28:05.755 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-08-18T20:28:05.756 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-18T20:28:05.757 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-18T20:28:05.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:28:05.776 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2023-08-18T20:28:05.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:28:05.777 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2023-08-18T20:28:05.837 INFO:teuthology.orchestra.run.smithi121.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:05.837 INFO:teuthology.task.kernel:Running kernel on smithi121: 4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:05.838 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2023-08-18T20:28:05.839 INFO:teuthology.orchestra.run.smithi122.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:05.839 INFO:teuthology.task.kernel:Running kernel on smithi122: 4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:05.839 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2023-08-18T20:28:07.037 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:07.038 INFO:teuthology.orchestra.run.smithi122.stdout:Unable to read consumer identity 2023-08-18T20:28:07.071 INFO:teuthology.orchestra.run.smithi121.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:07.071 INFO:teuthology.orchestra.run.smithi121.stdout:Unable to read consumer identity 2023-08-18T20:28:08.487 INFO:teuthology.orchestra.run.smithi122.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-08-18T20:28:08.692 INFO:teuthology.orchestra.run.smithi121.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-08-18T20:28:09.546 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-08-18T20:28:10.609 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-08-18T20:28:12.912 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 571 kB/s | 24 kB 00:00 2023-08-18T20:28:13.556 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-18T20:28:13.602 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-08-18T20:28:13.603 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2023-08-18T20:28:13.603 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-08-18T20:28:13.725 DEBUG:teuthology.orchestra.run.smithi122:> echo no | sudo yum reinstall kernel || true 2023-08-18T20:28:14.018 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 372 kB/s | 24 kB 00:00 2023-08-18T20:28:14.056 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:14.056 INFO:teuthology.orchestra.run.smithi122.stdout:Unable to read consumer identity 2023-08-18T20:28:14.318 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:02 ago on Fri 18 Aug 2023 08:28:12 PM UTC. 2023-08-18T20:28:14.360 INFO:teuthology.orchestra.run.smithi122.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-18T20:28:14.396 INFO:teuthology.orchestra.run.smithi122.stderr:Error: No packages marked for reinstall. 2023-08-18T20:28:14.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum reinstall -y kernel || true 2023-08-18T20:28:14.679 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-18T20:28:14.731 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-08-18T20:28:14.732 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-08-18T20:28:14.732 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-08-18T20:28:14.772 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:14.772 INFO:teuthology.orchestra.run.smithi122.stdout:Unable to read consumer identity 2023-08-18T20:28:14.906 DEBUG:teuthology.orchestra.run.smithi121:> echo no | sudo yum reinstall kernel || true 2023-08-18T20:28:15.030 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:03 ago on Fri 18 Aug 2023 08:28:12 PM UTC. 2023-08-18T20:28:15.072 INFO:teuthology.orchestra.run.smithi122.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-18T20:28:15.093 INFO:teuthology.orchestra.run.smithi122.stderr:Error: No packages marked for reinstall. 2023-08-18T20:28:15.144 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2023-08-18T20:28:15.224 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:15.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:15.225 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-18T20:28:15.225 DEBUG:teuthology.parallel:result is None 2023-08-18T20:28:15.239 INFO:teuthology.orchestra.run.smithi121.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:15.239 INFO:teuthology.orchestra.run.smithi121.stdout:Unable to read consumer identity 2023-08-18T20:28:15.501 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:02 ago on Fri 18 Aug 2023 08:28:13 PM UTC. 2023-08-18T20:28:15.543 INFO:teuthology.orchestra.run.smithi121.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-18T20:28:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:Error: No packages marked for reinstall. 2023-08-18T20:28:15.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum reinstall -y kernel || true 2023-08-18T20:28:15.960 INFO:teuthology.orchestra.run.smithi121.stdout:Updating Subscription Management repositories. 2023-08-18T20:28:15.961 INFO:teuthology.orchestra.run.smithi121.stdout:Unable to read consumer identity 2023-08-18T20:28:16.210 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:03 ago on Fri 18 Aug 2023 08:28:13 PM UTC. 2023-08-18T20:28:16.250 INFO:teuthology.orchestra.run.smithi121.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-18T20:28:16.280 INFO:teuthology.orchestra.run.smithi121.stderr:Error: No packages marked for reinstall. 2023-08-18T20:28:16.325 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2023-08-18T20:28:16.404 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:16.405 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-18T20:28:16.405 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-18T20:28:16.405 DEBUG:teuthology.parallel:result is None 2023-08-18T20:28:16.406 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-18T20:28:16.418 INFO:teuthology.task.internal:Creating test directory... 2023-08-18T20:28:16.418 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-18T20:28:16.422 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-18T20:28:16.446 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-18T20:28:16.465 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-18T20:28:16.486 INFO:teuthology.task.internal:Creating archive directory... 2023-08-18T20:28:16.486 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-18T20:28:16.491 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-18T20:28:16.519 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-18T20:28:16.528 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-18T20:28:16.529 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-18T20:28:16.548 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-18T20:28:16.589 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-18T20:28:16.608 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-18T20:28:16.609 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-18T20:28:16.625 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-18T20:28:16.626 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-18T20:28:16.635 INFO:teuthology.task.internal:Configuring sudo... 2023-08-18T20:28:16.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-18T20:28:16.652 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-18T20:28:16.682 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-18T20:28:16.694 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-18T20:28:16.695 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-18T20:28:16.721 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-18T20:28:16.739 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-18T20:28:16.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-18T20:28:16.875 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-18T20:28:16.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-18T20:28:17.007 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:28:17.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-18T20:28:17.085 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-18T20:28:17.132 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-18T20:28:17.214 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-18T20:28:17.263 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-18T20:28:17.313 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:28:17.314 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-18T20:28:17.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2023-08-18T20:28:17.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2023-08-18T20:28:17.459 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-18T20:28:17.485 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-18T20:28:17.769 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-18T20:28:17.780 INFO:teuthology.task.internal:Starting timer... 2023-08-18T20:28:17.781 INFO:teuthology.run_tasks:Running task pcp... 2023-08-18T20:28:17.804 INFO:teuthology.run_tasks:Running task selinux... 2023-08-18T20:28:17.817 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-08-18T20:28:17.818 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2023-08-18T20:28:17.884 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2023-08-18T20:28:17.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2023-08-18T20:28:17.965 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2023-08-18T20:28:17.969 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-18T20:28:17.969 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2023-08-18T20:28:17.998 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2023-08-18T20:28:17.999 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2023-08-18T20:28:18.020 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2023-08-18T20:28:18.022 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2023-08-18T20:28:18.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-18T20:28:18.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:28:18.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-18T20:28:18.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:28:18.096 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-18T20:28:18.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2023-08-18T20:28:18.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2023-08-18T20:28:18.168 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-18T20:28:18.180 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-18T20:28:18.181 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-18T20:28:18.204 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-18T20:28:18.205 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-18T20:40:17.295 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2023-08-18T20:40:17.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-18T20:40:17.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T20:40:17.378 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-08-18T20:40:17.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-18T20:40:17.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-08-18T20:40:17.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T20:40:17.531 DEBUG:teuthology.orchestra.run.smithi122:> true 2023-08-18T20:40:17.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-08-18T20:40:17.558 INFO:teuthology.run_tasks:Running task clock... 2023-08-18T20:40:17.577 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-18T20:40:17.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-18T20:40:17.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-18T20:40:17.592 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-18T20:40:17.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-18T20:40:17.624 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-18T20:40:17.633 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-18T20:40:17.634 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-18T20:40:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-18T20:40:17.701 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2023-08-18T20:40:17.710 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2023-08-18T20:40:17.723 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2023-08-18T20:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-18T20:40:17.725 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2023-08-18T20:40:17.744 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-18T20:40:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-18T20:40:17.760 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-18T20:40:17.808 INFO:teuthology.orchestra.run.smithi121.stderr:bash: ntpq: command not found 2023-08-18T20:40:17.812 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-18T20:40:17.813 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2023-08-18T20:40:17.813 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.813 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.813 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.814 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.835 INFO:teuthology.orchestra.run.smithi122.stderr:bash: ntpq: command not found 2023-08-18T20:40:17.838 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-18T20:40:17.838 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2023-08-18T20:40:17.838 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.838 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.838 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.839 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-18T20:40:17.847 INFO:teuthology.run_tasks:Running task install... 2023-08-18T20:40:17.865 DEBUG:teuthology.task.install:project ceph 2023-08-18T20:40:17.866 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'}} 2023-08-18T20:40:17.866 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'} 2023-08-18T20:40:17.866 INFO:teuthology.task.install:Using flavor: default 2023-08-18T20:40:17.875 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-18T20:40:17.875 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-18T20:40:17.876 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a', 'tag': None, 'wait_for_package': False} 2023-08-18T20:40:17.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=64a4fc940624dbc1b65654f740fd0424260cfd2a 2023-08-18T20:40:17.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a', 'tag': None, 'wait_for_package': False} 2023-08-18T20:40:17.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=64a4fc940624dbc1b65654f740fd0424260cfd2a 2023-08-18T20:40:18.084 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/ 2023-08-18T20:40:18.088 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5567.g64a4fc94 2023-08-18T20:40:18.135 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/ 2023-08-18T20:40:18.135 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5567.g64a4fc94 2023-08-18T20:40:18.494 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-18T20:40:18.494 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:40:18.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-18T20:40:18.525 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/64a4fc940624dbc1b65654f740fd0424260cfd2a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-18T20:40:18.526 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:40:18.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-18T20:40:18.533 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-18T20:40:18.534 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/64a4fc940624dbc1b65654f740fd0424260cfd2a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-18T20:40:18.563 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-18T20:40:18.564 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/64a4fc940624dbc1b65654f740fd0424260cfd2a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-18T20:40:18.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-18T20:40:18.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-18T20:40:18.696 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-18T20:40:18.725 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-18T20:40:18.764 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2023-08-18T20:40:18.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2023-08-18T20:40:18.802 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2023-08-18T20:40:18.803 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2023-08-18T20:40:19.148 INFO:teuthology.orchestra.run.smithi121.stdout:Updating Subscription Management repositories. 2023-08-18T20:40:19.175 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-08-18T20:40:20.176 INFO:teuthology.orchestra.run.smithi121.stdout:44 files removed 2023-08-18T20:40:20.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-18T20:40:20.246 INFO:teuthology.orchestra.run.smithi122.stdout:44 files removed 2023-08-18T20:40:20.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-18T20:40:20.556 INFO:teuthology.orchestra.run.smithi121.stdout:Updating Subscription Management repositories. 2023-08-18T20:40:20.639 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-08-18T20:40:22.396 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 117 kB/s | 81 kB 00:00 2023-08-18T20:40:22.829 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 97 kB/s | 81 kB 00:00 2023-08-18T20:40:22.996 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-08-18T20:40:23.464 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-08-18T20:40:23.614 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-08-18T20:40:23.764 INFO:teuthology.orchestra.run.smithi121.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-18T20:40:24.464 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 1.5 kB/s | 1.5 kB 00:00 2023-08-18T20:40:24.609 INFO:teuthology.orchestra.run.smithi122.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-08-18T20:40:24.925 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-08-18T20:40:26.231 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-08-18T20:40:28.333 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 383 kB/s | 24 kB 00:00 2023-08-18T20:40:29.500 INFO:teuthology.orchestra.run.smithi121.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-08-18T20:40:29.658 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-08-18T20:40:30.775 INFO:teuthology.orchestra.run.smithi122.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 53 MB 00:01 2023-08-18T20:40:38.050 INFO:teuthology.orchestra.run.smithi121.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 53 MB 00:01 2023-08-18T20:40:39.204 INFO:teuthology.orchestra.run.smithi122.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 47 MB 00:01 2023-08-18T20:40:49.098 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-18T20:40:49.100 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-18T20:40:49.114 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-18T20:40:49.117 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-18T20:40:49.117 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-18T20:40:49.118 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-18T20:40:49.120 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-18T20:40:49.123 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-18T20:40:49.124 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-18T20:40:49.256 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-08-18T20:40:49.268 INFO:teuthology.orchestra.run.smithi121.stdout:=========================================================================================================================== 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout:=========================================================================================================================== 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-18T20:40:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 6.4 k 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 5.4 M 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 860 k 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 167 k 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 1.6 M 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 131 k 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 1.7 M 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 7.4 M 2023-08-18T20:40:49.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 47 k 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 14 M 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 48 M 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 261 k 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 171 k 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 260 k 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 18 k 2023-08-18T20:40:49.271 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-18T20:40:49.272 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-18T20:40:49.272 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-18T20:40:49.272 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 31 k 2023-08-18T20:40:49.272 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 783 k 2023-08-18T20:40:49.273 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 139 k 2023-08-18T20:40:49.274 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-18T20:40:49.274 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-18T20:40:49.274 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-18T20:40:49.274 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-18T20:40:49.274 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-18T20:40:49.275 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-18T20:40:49.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 197 k 2023-08-18T20:40:49.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 372 k 2023-08-18T20:40:49.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 366 k 2023-08-18T20:40:49.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 107 k 2023-08-18T20:40:49.281 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 93 k 2023-08-18T20:40:49.282 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.5 M 2023-08-18T20:40:49.282 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 179 k 2023-08-18T20:40:49.282 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-18T20:40:49.282 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2023-08-18T20:40:49.284 INFO:teuthology.orchestra.run.smithi121.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-18T20:40:49.284 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.7 M 2023-08-18T20:40:49.284 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.6 M 2023-08-18T20:40:49.285 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-08-18T20:40:49.285 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-18T20:40:49.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 22 M 2023-08-18T20:40:49.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 23 k 2023-08-18T20:40:49.286 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 2.3 M 2023-08-18T20:40:49.286 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 242 k 2023-08-18T20:40:49.286 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 4.6 M 2023-08-18T20:40:49.287 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 18 M 2023-08-18T20:40:49.287 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 15 k 2023-08-18T20:40:49.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 24 k 2023-08-18T20:40:49.290 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-18T20:40:49.293 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-18T20:40:49.295 INFO:teuthology.orchestra.run.smithi121.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-18T20:40:49.295 INFO:teuthology.orchestra.run.smithi121.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-18T20:40:49.295 INFO:teuthology.orchestra.run.smithi121.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-18T20:40:49.295 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 139 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-18T20:40:49.296 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 473 k 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 6.8 M 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-18T20:40:49.297 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-18T20:40:49.298 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-18T20:40:49.299 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-18T20:40:49.299 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-18T20:40:49.299 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-18T20:40:49.299 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-18T20:40:49.299 INFO:teuthology.orchestra.run.smithi121.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-18T20:40:49.300 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-18T20:40:49.300 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 45 k 2023-08-18T20:40:49.300 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 125 k 2023-08-18T20:40:49.300 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-18T20:40:49.300 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-18T20:40:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-18T20:40:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-18T20:40:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-18T20:40:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-18T20:40:49.303 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-18T20:40:49.304 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-18T20:40:49.304 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-18T20:40:49.304 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-18T20:40:49.304 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-18T20:40:49.304 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-18T20:40:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-18T20:40:49.306 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-18T20:40:49.307 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-18T20:40:49.307 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-18T20:40:49.308 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-18T20:40:49.308 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-18T20:40:49.309 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout:Enabling module streams: 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql 10 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout:=========================================================================================================================== 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout:Install 128 Packages 2023-08-18T20:40:49.310 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 3 Packages 2023-08-18T20:40:49.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:40:49.311 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 206 M 2023-08-18T20:40:49.311 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-08-18T20:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout:(1/131): ceph-18.0.0-5567.g64a4fc94.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-08-18T20:40:49.833 INFO:teuthology.orchestra.run.smithi121.stdout:(2/131): ceph-fuse-18.0.0-5567.g64a4fc94.el8.x8 3.0 MB/s | 860 kB 00:00 2023-08-18T20:40:49.925 INFO:teuthology.orchestra.run.smithi121.stdout:(3/131): ceph-immutable-object-cache-18.0.0-556 1.8 MB/s | 167 kB 00:00 2023-08-18T20:40:50.124 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-18T20:40:50.125 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-18T20:40:50.139 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-18T20:40:50.140 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-18T20:40:50.141 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-18T20:40:50.142 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-18T20:40:50.144 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-18T20:40:50.147 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-18T20:40:50.148 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-18T20:40:50.277 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-08-18T20:40:50.292 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-08-18T20:40:50.301 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2023-08-18T20:40:50.301 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-08-18T20:40:50.301 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 6.4 k 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 5.4 M 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 860 k 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 167 k 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 1.6 M 2023-08-18T20:40:50.302 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 131 k 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 1.7 M 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 7.4 M 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 47 k 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 14 M 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 48 M 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 261 k 2023-08-18T20:40:50.303 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 171 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 260 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 18 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 31 k 2023-08-18T20:40:50.304 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 783 k 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 139 k 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-18T20:40:50.305 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 197 k 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 372 k 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 366 k 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 107 k 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 93 k 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.5 M 2023-08-18T20:40:50.306 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 179 k 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.7 M 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 3.6 M 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2023-08-18T20:40:50.307 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 22 M 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 23 k 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 2.3 M 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 242 k 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 4.6 M 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 18 M 2023-08-18T20:40:50.308 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5567.g64a4fc94.el8 ceph-noarch 15 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 24 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-18T20:40:50.309 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 139 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-18T20:40:50.310 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 473 k 2023-08-18T20:40:50.311 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-18T20:40:50.312 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 6.8 M 2023-08-18T20:40:50.312 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-18T20:40:50.312 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-18T20:40:50.312 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-18T20:40:50.313 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-18T20:40:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 45 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:18.0.0-5567.g64a4fc94.el8 ceph 125 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-18T20:40:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-18T20:40:50.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-18T20:40:50.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-18T20:40:50.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-18T20:40:50.319 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-18T20:40:50.320 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-18T20:40:50.321 INFO:teuthology.orchestra.run.smithi122.stdout:Enabling module streams: 2023-08-18T20:40:50.322 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql 10 2023-08-18T20:40:50.322 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:40:50.322 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-08-18T20:40:50.323 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-08-18T20:40:50.323 INFO:teuthology.orchestra.run.smithi122.stdout:Install 128 Packages 2023-08-18T20:40:50.323 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 3 Packages 2023-08-18T20:40:50.323 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:40:50.324 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 206 M 2023-08-18T20:40:50.324 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2023-08-18T20:40:50.458 INFO:teuthology.orchestra.run.smithi121.stdout:(4/131): ceph-mds-18.0.0-5567.g64a4fc94.el8.x86 4.3 MB/s | 2.3 MB 00:00 2023-08-18T20:40:50.567 INFO:teuthology.orchestra.run.smithi121.stdout:(5/131): ceph-base-18.0.0-5567.g64a4fc94.el8.x8 4.4 MB/s | 5.4 MB 00:01 2023-08-18T20:40:50.569 INFO:teuthology.orchestra.run.smithi122.stdout:(1/131): ceph-18.0.0-5567.g64a4fc94.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2023-08-18T20:40:50.835 INFO:teuthology.orchestra.run.smithi121.stdout:(6/131): ceph-mgr-18.0.0-5567.g64a4fc94.el8.x86 4.2 MB/s | 1.6 MB 00:00 2023-08-18T20:40:51.309 INFO:teuthology.orchestra.run.smithi121.stdout:(7/131): ceph-mon-18.0.0-5567.g64a4fc94.el8.x86 6.2 MB/s | 4.6 MB 00:00 2023-08-18T20:40:51.611 INFO:teuthology.orchestra.run.smithi122.stdout:(2/131): ceph-fuse-18.0.0-5567.g64a4fc94.el8.x8 826 kB/s | 860 kB 00:01 2023-08-18T20:40:51.778 INFO:teuthology.orchestra.run.smithi122.stdout:(3/131): ceph-immutable-object-cache-18.0.0-556 1.0 MB/s | 167 kB 00:00 2023-08-18T20:40:52.904 INFO:teuthology.orchestra.run.smithi122.stdout:(4/131): ceph-base-18.0.0-5567.g64a4fc94.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-08-18T20:40:52.945 INFO:teuthology.orchestra.run.smithi122.stdout:(5/131): ceph-mds-18.0.0-5567.g64a4fc94.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-08-18T20:40:53.296 INFO:teuthology.orchestra.run.smithi122.stdout:(6/131): ceph-mgr-18.0.0-5567.g64a4fc94.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-08-18T20:40:53.685 INFO:teuthology.orchestra.run.smithi121.stdout:(8/131): ceph-radosgw-18.0.0-5567.g64a4fc94.el8 5.7 MB/s | 14 MB 00:02 2023-08-18T20:40:53.793 INFO:teuthology.orchestra.run.smithi121.stdout:(9/131): ceph-selinux-18.0.0-5567.g64a4fc94.el8 225 kB/s | 24 kB 00:00 2023-08-18T20:40:54.423 INFO:teuthology.orchestra.run.smithi122.stdout:(7/131): ceph-mon-18.0.0-5567.g64a4fc94.el8.x86 3.1 MB/s | 4.6 MB 00:01 2023-08-18T20:40:56.517 INFO:teuthology.orchestra.run.smithi121.stdout:(10/131): ceph-osd-18.0.0-5567.g64a4fc94.el8.x8 3.1 MB/s | 18 MB 00:05 2023-08-18T20:40:56.676 INFO:teuthology.orchestra.run.smithi121.stdout:(11/131): cephfs-mirror-18.0.0-5567.g64a4fc94.e 1.6 MB/s | 260 kB 00:00 2023-08-18T20:40:56.743 INFO:teuthology.orchestra.run.smithi121.stdout:(12/131): libcephfs-devel-18.0.0-5567.g64a4fc94 467 kB/s | 31 kB 00:00 2023-08-18T20:40:56.754 INFO:teuthology.orchestra.run.smithi122.stdout:(8/131): ceph-osd-18.0.0-5567.g64a4fc94.el8.x86 5.1 MB/s | 18 MB 00:03 2023-08-18T20:40:56.846 INFO:teuthology.orchestra.run.smithi122.stdout:(9/131): ceph-selinux-18.0.0-5567.g64a4fc94.el8 266 kB/s | 24 kB 00:00 2023-08-18T20:40:57.035 INFO:teuthology.orchestra.run.smithi121.stdout:(13/131): libcephfs2-18.0.0-5567.g64a4fc94.el8. 2.6 MB/s | 783 kB 00:00 2023-08-18T20:40:57.127 INFO:teuthology.orchestra.run.smithi121.stdout:(14/131): libcephsqlite-18.0.0-5567.g64a4fc94.e 1.5 MB/s | 139 kB 00:00 2023-08-18T20:40:57.244 INFO:teuthology.orchestra.run.smithi121.stdout:(15/131): librados-devel-18.0.0-5567.g64a4fc94. 1.2 MB/s | 139 kB 00:00 2023-08-18T20:40:57.453 INFO:teuthology.orchestra.run.smithi121.stdout:(16/131): ceph-common-18.0.0-5567.g64a4fc94.el8 2.7 MB/s | 22 MB 00:08 2023-08-18T20:40:57.503 INFO:teuthology.orchestra.run.smithi121.stdout:(17/131): libradosstriper1-18.0.0-5567.g64a4fc9 1.8 MB/s | 473 kB 00:00 2023-08-18T20:40:57.578 INFO:teuthology.orchestra.run.smithi121.stdout:(18/131): python3-ceph-argparse-18.0.0-5567.g64 596 kB/s | 45 kB 00:00 2023-08-18T20:40:57.662 INFO:teuthology.orchestra.run.smithi121.stdout:(19/131): python3-ceph-common-18.0.0-5567.g64a4 1.5 MB/s | 125 kB 00:00 2023-08-18T20:40:57.754 INFO:teuthology.orchestra.run.smithi121.stdout:(20/131): python3-cephfs-18.0.0-5567.g64a4fc94. 2.1 MB/s | 197 kB 00:00 2023-08-18T20:40:57.929 INFO:teuthology.orchestra.run.smithi121.stdout:(21/131): python3-rados-18.0.0-5567.g64a4fc94.e 2.1 MB/s | 372 kB 00:00 2023-08-18T20:40:58.096 INFO:teuthology.orchestra.run.smithi121.stdout:(22/131): python3-rbd-18.0.0-5567.g64a4fc94.el8 2.1 MB/s | 366 kB 00:00 2023-08-18T20:40:58.163 INFO:teuthology.orchestra.run.smithi121.stdout:(23/131): python3-rgw-18.0.0-5567.g64a4fc94.el8 1.6 MB/s | 107 kB 00:00 2023-08-18T20:40:58.180 INFO:teuthology.orchestra.run.smithi122.stdout:(10/131): ceph-radosgw-18.0.0-5567.g64a4fc94.el 3.6 MB/s | 14 MB 00:03 2023-08-18T20:40:58.247 INFO:teuthology.orchestra.run.smithi121.stdout:(24/131): rbd-fuse-18.0.0-5567.g64a4fc94.el8.x8 1.1 MB/s | 93 kB 00:00 2023-08-18T20:40:58.281 INFO:teuthology.orchestra.run.smithi122.stdout:(11/131): cephfs-mirror-18.0.0-5567.g64a4fc94.e 2.5 MB/s | 260 kB 00:00 2023-08-18T20:40:58.356 INFO:teuthology.orchestra.run.smithi122.stdout:(12/131): libcephfs-devel-18.0.0-5567.g64a4fc94 415 kB/s | 31 kB 00:00 2023-08-18T20:40:58.606 INFO:teuthology.orchestra.run.smithi122.stdout:(13/131): libcephfs2-18.0.0-5567.g64a4fc94.el8. 3.1 MB/s | 783 kB 00:00 2023-08-18T20:40:58.706 INFO:teuthology.orchestra.run.smithi122.stdout:(14/131): libcephsqlite-18.0.0-5567.g64a4fc94.e 1.4 MB/s | 139 kB 00:00 2023-08-18T20:40:58.807 INFO:teuthology.orchestra.run.smithi122.stdout:(15/131): librados-devel-18.0.0-5567.g64a4fc94. 1.4 MB/s | 139 kB 00:00 2023-08-18T20:40:58.974 INFO:teuthology.orchestra.run.smithi122.stdout:(16/131): libradosstriper1-18.0.0-5567.g64a4fc9 2.8 MB/s | 473 kB 00:00 2023-08-18T20:40:59.422 INFO:teuthology.orchestra.run.smithi121.stdout:(25/131): rbd-mirror-18.0.0-5567.g64a4fc94.el8. 3.0 MB/s | 3.5 MB 00:01 2023-08-18T20:40:59.580 INFO:teuthology.orchestra.run.smithi121.stdout:(26/131): rbd-nbd-18.0.0-5567.g64a4fc94.el8.x86 1.1 MB/s | 179 kB 00:00 2023-08-18T20:40:59.672 INFO:teuthology.orchestra.run.smithi121.stdout:(27/131): librgw2-18.0.0-5567.g64a4fc94.el8.x86 3.1 MB/s | 6.8 MB 00:02 2023-08-18T20:40:59.697 INFO:teuthology.orchestra.run.smithi121.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5567.g 197 kB/s | 23 kB 00:00 2023-08-18T20:40:59.764 INFO:teuthology.orchestra.run.smithi121.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5567.g64a4fc9 1.4 MB/s | 131 kB 00:00 2023-08-18T20:41:00.431 INFO:teuthology.orchestra.run.smithi121.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5567.g64a4f 2.4 MB/s | 1.7 MB 00:00 2023-08-18T20:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout:(17/131): ceph-common-18.0.0-5567.g64a4fc94.el8 2.2 MB/s | 22 MB 00:10 2023-08-18T20:41:00.573 INFO:teuthology.orchestra.run.smithi121.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5567.g64 1.7 MB/s | 242 kB 00:00 2023-08-18T20:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout:(18/131): python3-ceph-argparse-18.0.0-5567.g64 414 kB/s | 45 kB 00:00 2023-08-18T20:41:00.705 INFO:teuthology.orchestra.run.smithi121.stdout:(32/131): ceph-mgr-rook-18.0.0-5567.g64a4fc94.e 360 kB/s | 47 kB 00:00 2023-08-18T20:41:00.791 INFO:teuthology.orchestra.run.smithi121.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5567.g6 171 kB/s | 15 kB 00:00 2023-08-18T20:41:00.817 INFO:teuthology.orchestra.run.smithi122.stdout:(19/131): librgw2-18.0.0-5567.g64a4fc94.el8.x86 3.7 MB/s | 6.8 MB 00:01 2023-08-18T20:41:00.842 INFO:teuthology.orchestra.run.smithi122.stdout:(20/131): python3-ceph-common-18.0.0-5567.g64a4 557 kB/s | 125 kB 00:00 2023-08-18T20:41:00.909 INFO:teuthology.orchestra.run.smithi122.stdout:(21/131): python3-cephfs-18.0.0-5567.g64a4fc94. 2.1 MB/s | 197 kB 00:00 2023-08-18T20:41:01.084 INFO:teuthology.orchestra.run.smithi122.stdout:(22/131): python3-rbd-18.0.0-5567.g64a4fc94.el8 2.0 MB/s | 366 kB 00:00 2023-08-18T20:41:01.124 INFO:teuthology.orchestra.run.smithi121.stdout:(34/131): ceph-volume-18.0.0-5567.g64a4fc94.el8 782 kB/s | 261 kB 00:00 2023-08-18T20:41:01.143 INFO:teuthology.orchestra.run.smithi122.stdout:(23/131): python3-rados-18.0.0-5567.g64a4fc94.e 1.2 MB/s | 372 kB 00:00 2023-08-18T20:41:01.202 INFO:teuthology.orchestra.run.smithi122.stdout:(24/131): python3-rgw-18.0.0-5567.g64a4fc94.el8 912 kB/s | 107 kB 00:00 2023-08-18T20:41:01.260 INFO:teuthology.orchestra.run.smithi122.stdout:(25/131): rbd-fuse-18.0.0-5567.g64a4fc94.el8.x8 798 kB/s | 93 kB 00:00 2023-08-18T20:41:01.283 INFO:teuthology.orchestra.run.smithi121.stdout:(35/131): cephadm-18.0.0-5567.g64a4fc94.el8.noa 1.1 MB/s | 171 kB 00:00 2023-08-18T20:41:01.391 INFO:teuthology.orchestra.run.smithi121.stdout:(36/131): cephfs-top-18.0.0-5567.g64a4fc94.el8. 166 kB/s | 18 kB 00:00 2023-08-18T20:41:01.461 INFO:teuthology.orchestra.run.smithi122.stdout:(26/131): rbd-nbd-18.0.0-5567.g64a4fc94.el8.x86 896 kB/s | 179 kB 00:00 2023-08-18T20:41:01.561 INFO:teuthology.orchestra.run.smithi122.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5567.g 231 kB/s | 23 kB 00:00 2023-08-18T20:41:01.684 INFO:teuthology.orchestra.run.smithi122.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5567.g64a4fc9 1.0 MB/s | 131 kB 00:00 2023-08-18T20:41:01.800 INFO:teuthology.orchestra.run.smithi121.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 750 kB/s | 306 kB 00:00 2023-08-18T20:41:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-08-18T20:41:01.926 INFO:teuthology.orchestra.run.smithi121.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-08-18T20:41:02.026 INFO:teuthology.orchestra.run.smithi121.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.7 MB/s | 476 kB 00:00 2023-08-18T20:41:02.085 INFO:teuthology.orchestra.run.smithi121.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 746 kB/s | 44 kB 00:00 2023-08-18T20:41:02.143 INFO:teuthology.orchestra.run.smithi121.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-08-18T20:41:02.194 INFO:teuthology.orchestra.run.smithi121.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 660 kB/s | 33 kB 00:00 2023-08-18T20:41:02.244 INFO:teuthology.orchestra.run.smithi121.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2023-08-18T20:41:02.279 INFO:teuthology.orchestra.run.smithi122.stdout:(29/131): rbd-mirror-18.0.0-5567.g64a4fc94.el8. 3.3 MB/s | 3.5 MB 00:01 2023-08-18T20:41:02.311 INFO:teuthology.orchestra.run.smithi121.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-08-18T20:41:02.378 INFO:teuthology.orchestra.run.smithi121.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2023-08-18T20:41:02.428 INFO:teuthology.orchestra.run.smithi121.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-08-18T20:41:02.495 INFO:teuthology.orchestra.run.smithi121.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-08-18T20:41:02.554 INFO:teuthology.orchestra.run.smithi121.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-08-18T20:41:02.663 INFO:teuthology.orchestra.run.smithi121.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-08-18T20:41:02.713 INFO:teuthology.orchestra.run.smithi121.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 979 kB/s | 49 kB 00:00 2023-08-18T20:41:02.729 INFO:teuthology.orchestra.run.smithi122.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5567.g64a4f 1.7 MB/s | 1.7 MB 00:01 2023-08-18T20:41:02.763 INFO:teuthology.orchestra.run.smithi121.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-08-18T20:41:02.813 INFO:teuthology.orchestra.run.smithi121.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-08-18T20:41:02.872 INFO:teuthology.orchestra.run.smithi121.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-08-18T20:41:02.914 INFO:teuthology.orchestra.run.smithi121.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2023-08-18T20:41:02.921 INFO:teuthology.orchestra.run.smithi122.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5567.g64 1.2 MB/s | 242 kB 00:00 2023-08-18T20:41:02.998 INFO:teuthology.orchestra.run.smithi121.stdout:(56/131): ceph-mgr-diskprediction-local-18.0.0- 2.3 MB/s | 7.4 MB 00:03 2023-08-18T20:41:03.014 INFO:teuthology.orchestra.run.smithi121.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-08-18T20:41:03.029 INFO:teuthology.orchestra.run.smithi122.stdout:(32/131): ceph-mgr-rook-18.0.0-5567.g64a4fc94.e 437 kB/s | 47 kB 00:00 2023-08-18T20:41:03.090 INFO:teuthology.orchestra.run.smithi121.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 852 kB/s | 64 kB 00:00 2023-08-18T20:41:03.165 INFO:teuthology.orchestra.run.smithi121.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 250 kB/s | 19 kB 00:00 2023-08-18T20:41:03.171 INFO:teuthology.orchestra.run.smithi122.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5567.g6 103 kB/s | 15 kB 00:00 2023-08-18T20:41:03.241 INFO:teuthology.orchestra.run.smithi121.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 319 kB/s | 24 kB 00:00 2023-08-18T20:41:03.324 INFO:teuthology.orchestra.run.smithi121.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 351 kB/s | 29 kB 00:00 2023-08-18T20:41:03.366 INFO:teuthology.orchestra.run.smithi121.stdout:(62/131): python3-routes-2.4.1-12.el8.noarch.rp 533 kB/s | 196 kB 00:00 2023-08-18T20:41:03.401 INFO:teuthology.orchestra.run.smithi121.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-08-18T20:41:03.414 INFO:teuthology.orchestra.run.smithi122.stdout:(34/131): ceph-volume-18.0.0-5567.g64a4fc94.el8 1.1 MB/s | 261 kB 00:00 2023-08-18T20:41:03.475 INFO:teuthology.orchestra.run.smithi121.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-08-18T20:41:03.500 INFO:teuthology.orchestra.run.smithi121.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-08-18T20:41:03.534 INFO:teuthology.orchestra.run.smithi121.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-08-18T20:41:03.568 INFO:teuthology.orchestra.run.smithi121.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.3 MB/s | 85 kB 00:00 2023-08-18T20:41:03.631 INFO:teuthology.orchestra.run.smithi121.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 239 kB/s | 23 kB 00:00 2023-08-18T20:41:03.660 INFO:teuthology.orchestra.run.smithi121.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.3 MB/s | 70 kB 00:00 2023-08-18T20:41:03.665 INFO:teuthology.orchestra.run.smithi122.stdout:(35/131): cephadm-18.0.0-5567.g64a4fc94.el8.noa 683 kB/s | 171 kB 00:00 2023-08-18T20:41:03.714 INFO:teuthology.orchestra.run.smithi122.stdout:(36/131): cephfs-top-18.0.0-5567.g64a4fc94.el8. 362 kB/s | 18 kB 00:00 2023-08-18T20:41:03.794 INFO:teuthology.orchestra.run.smithi121.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 7.7 MB/s | 1.7 MB 00:00 2023-08-18T20:41:03.919 INFO:teuthology.orchestra.run.smithi121.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 882 kB/s | 110 kB 00:00 2023-08-18T20:41:03.940 INFO:teuthology.orchestra.run.smithi122.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 4.5 MB/s | 7.4 MB 00:01 2023-08-18T20:41:04.023 INFO:teuthology.orchestra.run.smithi122.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 992 kB/s | 306 kB 00:00 2023-08-18T20:41:04.111 INFO:teuthology.orchestra.run.smithi121.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 30 MB/s | 14 MB 00:00 2023-08-18T20:41:04.133 INFO:teuthology.orchestra.run.smithi122.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 689 kB/s | 75 kB 00:00 2023-08-18T20:41:04.154 INFO:teuthology.orchestra.run.smithi121.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 232 kB/s | 54 kB 00:00 2023-08-18T20:41:04.287 INFO:teuthology.orchestra.run.smithi121.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-08-18T20:41:04.312 INFO:teuthology.orchestra.run.smithi121.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-08-18T20:41:04.424 INFO:teuthology.orchestra.run.smithi122.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-08-18T20:41:04.437 INFO:teuthology.orchestra.run.smithi121.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2023-08-18T20:41:04.516 INFO:teuthology.orchestra.run.smithi122.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-08-18T20:41:04.529 INFO:teuthology.orchestra.run.smithi121.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-08-18T20:41:04.574 INFO:teuthology.orchestra.run.smithi122.stdout:(42/131): liboath-2.6.2-3.el8.x86_64.rpm 93 kB/s | 59 kB 00:00 2023-08-18T20:41:04.579 INFO:teuthology.orchestra.run.smithi121.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-08-18T20:41:04.675 INFO:teuthology.orchestra.run.smithi122.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-08-18T20:41:04.742 INFO:teuthology.orchestra.run.smithi122.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-08-18T20:41:05.021 INFO:teuthology.orchestra.run.smithi121.stdout:(79/131): ceph-test-18.0.0-5567.g64a4fc94.el8.x 4.3 MB/s | 48 MB 00:11 2023-08-18T20:41:05.046 INFO:teuthology.orchestra.run.smithi121.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 303 kB/s | 157 kB 00:00 2023-08-18T20:41:05.080 INFO:teuthology.orchestra.run.smithi121.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 374 kB/s | 187 kB 00:00 2023-08-18T20:41:05.122 INFO:teuthology.orchestra.run.smithi121.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 7.0 MB/s | 713 kB 00:00 2023-08-18T20:41:05.189 INFO:teuthology.orchestra.run.smithi121.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 244 kB/s | 27 kB 00:00 2023-08-18T20:41:05.222 INFO:teuthology.orchestra.run.smithi121.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2023-08-18T20:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout:(45/131): ceph-test-18.0.0-5567.g64a4fc94.el8.x 5.7 MB/s | 48 MB 00:08 2023-08-18T20:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 48 kB/s | 33 kB 00:00 2023-08-18T20:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 314 kB/s | 173 kB 00:00 2023-08-18T20:41:05.332 INFO:teuthology.orchestra.run.smithi121.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-08-18T20:41:05.356 INFO:teuthology.orchestra.run.smithi121.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 263 kB/s | 44 kB 00:00 2023-08-18T20:41:05.359 INFO:teuthology.orchestra.run.smithi122.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-08-18T20:41:05.426 INFO:teuthology.orchestra.run.smithi122.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 264 kB/s | 18 kB 00:00 2023-08-18T20:41:05.443 INFO:teuthology.orchestra.run.smithi122.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 462 kB/s | 81 kB 00:00 2023-08-18T20:41:05.465 INFO:teuthology.orchestra.run.smithi121.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-08-18T20:41:05.498 INFO:teuthology.orchestra.run.smithi121.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.7 MB/s | 457 kB 00:00 2023-08-18T20:41:05.511 INFO:teuthology.orchestra.run.smithi122.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 729 kB/s | 49 kB 00:00 2023-08-18T20:41:05.549 INFO:teuthology.orchestra.run.smithi121.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2023-08-18T20:41:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 429 kB/s | 64 kB 00:00 2023-08-18T20:41:05.627 INFO:teuthology.orchestra.run.smithi122.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 503 kB/s | 59 kB 00:00 2023-08-18T20:41:05.649 INFO:teuthology.orchestra.run.smithi121.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 840 kB/s | 126 kB 00:00 2023-08-18T20:41:05.691 INFO:teuthology.orchestra.run.smithi121.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2023-08-18T20:41:05.736 INFO:teuthology.orchestra.run.smithi122.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 556 kB/s | 60 kB 00:00 2023-08-18T20:41:05.750 INFO:teuthology.orchestra.run.smithi121.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 766 kB/s | 103 kB 00:00 2023-08-18T20:41:05.792 INFO:teuthology.orchestra.run.smithi121.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-08-18T20:41:05.842 INFO:teuthology.orchestra.run.smithi121.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-08-18T20:41:05.853 INFO:teuthology.orchestra.run.smithi122.stdout:(54/131): python3-cherrypy-18.4.0-1.el8.noarch. 630 kB/s | 384 kB 00:00 2023-08-18T20:41:05.923 INFO:teuthology.orchestra.run.smithi122.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-08-18T20:41:05.925 INFO:teuthology.orchestra.run.smithi121.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-08-18T20:41:05.951 INFO:teuthology.orchestra.run.smithi121.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-08-18T20:41:05.962 INFO:teuthology.orchestra.run.smithi122.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-08-18T20:41:06.021 INFO:teuthology.orchestra.run.smithi122.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-08-18T20:41:06.043 INFO:teuthology.orchestra.run.smithi121.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-08-18T20:41:06.096 INFO:teuthology.orchestra.run.smithi122.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2023-08-18T20:41:06.118 INFO:teuthology.orchestra.run.smithi121.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-08-18T20:41:06.131 INFO:teuthology.orchestra.run.smithi122.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-08-18T20:41:06.157 INFO:teuthology.orchestra.run.smithi122.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 317 kB/s | 19 kB 00:00 2023-08-18T20:41:06.160 INFO:teuthology.orchestra.run.smithi121.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-08-18T20:41:06.209 INFO:teuthology.orchestra.run.smithi122.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 341 kB/s | 64 kB 00:00 2023-08-18T20:41:06.231 INFO:teuthology.orchestra.run.smithi122.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-08-18T20:41:06.248 INFO:teuthology.orchestra.run.smithi122.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2023-08-18T20:41:06.294 INFO:teuthology.orchestra.run.smithi121.stdout:(101/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-08-18T20:41:06.307 INFO:teuthology.orchestra.run.smithi122.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 284 kB/s | 27 kB 00:00 2023-08-18T20:41:06.319 INFO:teuthology.orchestra.run.smithi121.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-08-18T20:41:06.344 INFO:teuthology.orchestra.run.smithi121.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-08-18T20:41:06.394 INFO:teuthology.orchestra.run.smithi121.stdout:(104/131): postgresql-10.21-2.module+el8.6.0+15 5.4 MB/s | 1.5 MB 00:00 2023-08-18T20:41:06.428 INFO:teuthology.orchestra.run.smithi121.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 391 kB/s | 43 kB 00:00 2023-08-18T20:41:06.432 INFO:teuthology.orchestra.run.smithi122.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-08-18T20:41:06.449 INFO:teuthology.orchestra.run.smithi122.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-08-18T20:41:06.474 INFO:teuthology.orchestra.run.smithi122.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 366 kB/s | 61 kB 00:00 2023-08-18T20:41:06.478 INFO:teuthology.orchestra.run.smithi121.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-08-18T20:41:06.504 INFO:teuthology.orchestra.run.smithi121.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 441 kB/s | 48 kB 00:00 2023-08-18T20:41:06.529 INFO:teuthology.orchestra.run.smithi121.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 864 kB/s | 87 kB 00:00 2023-08-18T20:41:06.558 INFO:teuthology.orchestra.run.smithi122.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 680 kB/s | 85 kB 00:00 2023-08-18T20:41:06.562 INFO:teuthology.orchestra.run.smithi121.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 509 kB/s | 43 kB 00:00 2023-08-18T20:41:06.586 INFO:teuthology.orchestra.run.smithi122.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-08-18T20:41:06.608 INFO:teuthology.orchestra.run.smithi122.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-08-18T20:41:06.613 INFO:teuthology.orchestra.run.smithi121.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-08-18T20:41:06.638 INFO:teuthology.orchestra.run.smithi121.stdout:(111/131): python3-pycparser-2.14-14.el8.noarch 813 kB/s | 109 kB 00:00 2023-08-18T20:41:06.696 INFO:teuthology.orchestra.run.smithi121.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-08-18T20:41:06.717 INFO:teuthology.orchestra.run.smithi122.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 351 kB/s | 47 kB 00:00 2023-08-18T20:41:06.739 INFO:teuthology.orchestra.run.smithi121.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2023-08-18T20:41:06.742 INFO:teuthology.orchestra.run.smithi122.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-08-18T20:41:06.773 INFO:teuthology.orchestra.run.smithi121.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 7.3 MB/s | 559 kB 00:00 2023-08-18T20:41:06.792 INFO:teuthology.orchestra.run.smithi122.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 566 kB/s | 43 kB 00:00 2023-08-18T20:41:06.797 INFO:teuthology.orchestra.run.smithi121.stdout:(115/131): libaio-devel-0.3.112-1.el8.x86_64.rp 101 kB/s | 19 kB 00:00 2023-08-18T20:41:06.818 INFO:teuthology.orchestra.run.smithi122.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-08-18T20:41:06.822 INFO:teuthology.orchestra.run.smithi121.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-08-18T20:41:06.887 INFO:teuthology.orchestra.run.smithi121.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-08-18T20:41:06.911 INFO:teuthology.orchestra.run.smithi122.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 412 kB/s | 48 kB 00:00 2023-08-18T20:41:06.944 INFO:teuthology.orchestra.run.smithi121.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-08-18T20:41:06.952 INFO:teuthology.orchestra.run.smithi122.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 652 kB/s | 87 kB 00:00 2023-08-18T20:41:07.007 INFO:teuthology.orchestra.run.smithi121.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-08-18T20:41:07.019 INFO:teuthology.orchestra.run.smithi122.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 393 kB/s | 43 kB 00:00 2023-08-18T20:41:07.034 INFO:teuthology.orchestra.run.smithi121.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 499 kB/s | 72 kB 00:00 2023-08-18T20:41:07.091 INFO:teuthology.orchestra.run.smithi121.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 550 kB/s | 83 kB 00:00 2023-08-18T20:41:07.111 INFO:teuthology.orchestra.run.smithi122.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 687 kB/s | 109 kB 00:00 2023-08-18T20:41:07.133 INFO:teuthology.orchestra.run.smithi121.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 477 kB/s | 60 kB 00:00 2023-08-18T20:41:07.136 INFO:teuthology.orchestra.run.smithi122.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-08-18T20:41:07.166 INFO:teuthology.orchestra.run.smithi121.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 733 kB/s | 98 kB 00:00 2023-08-18T20:41:07.203 INFO:teuthology.orchestra.run.smithi122.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2023-08-18T20:41:07.261 INFO:teuthology.orchestra.run.smithi122.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-08-18T20:41:07.287 INFO:teuthology.orchestra.run.smithi122.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-08-18T20:41:07.329 INFO:teuthology.orchestra.run.smithi122.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 8.1 MB/s | 559 kB 00:00 2023-08-18T20:41:07.446 INFO:teuthology.orchestra.run.smithi122.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 113 kB/s | 18 kB 00:00 2023-08-18T20:41:07.467 INFO:teuthology.orchestra.run.smithi121.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 154 kB/s | 58 kB 00:00 2023-08-18T20:41:07.479 INFO:teuthology.orchestra.run.smithi122.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-08-18T20:41:07.492 INFO:teuthology.orchestra.run.smithi121.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 107 kB/s | 39 kB 00:00 2023-08-18T20:41:07.549 INFO:teuthology.orchestra.run.smithi122.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-08-18T20:41:07.551 INFO:teuthology.orchestra.run.smithi121.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 1.6 MB/s | 644 kB 00:00 2023-08-18T20:41:07.576 INFO:teuthology.orchestra.run.smithi121.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.5 MB/s | 171 kB 00:00 2023-08-18T20:41:07.630 INFO:teuthology.orchestra.run.smithi122.stdout:(87/131): thrift-0.13.0-2.el8.x86_64.rpm 1.5 MB/s | 1.7 MB 00:01 2023-08-18T20:41:07.710 INFO:teuthology.orchestra.run.smithi121.stdout:(128/131): NetworkManager-initscripts-updown-1. 634 kB/s | 138 kB 00:00 2023-08-18T20:41:07.764 INFO:teuthology.orchestra.run.smithi122.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 333 kB/s | 72 kB 00:00 2023-08-18T20:41:07.835 INFO:teuthology.orchestra.run.smithi121.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 6.2 MB/s | 798 kB 00:00 2023-08-18T20:41:07.961 INFO:teuthology.orchestra.run.smithi122.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 4.8 MB/s | 2.3 MB 00:00 2023-08-18T20:41:07.982 INFO:teuthology.orchestra.run.smithi122.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 283 kB/s | 60 kB 00:00 2023-08-18T20:41:08.007 INFO:teuthology.orchestra.run.smithi122.stdout:(91/131): fuse-2.9.7-15.el8.x86_64.rpm 220 kB/s | 83 kB 00:00 2023-08-18T20:41:08.082 INFO:teuthology.orchestra.run.smithi122.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 815 kB/s | 98 kB 00:00 2023-08-18T20:41:08.099 INFO:teuthology.orchestra.run.smithi122.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 420 kB/s | 39 kB 00:00 2023-08-18T20:41:08.116 INFO:teuthology.orchestra.run.smithi122.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 430 kB/s | 58 kB 00:00 2023-08-18T20:41:08.152 INFO:teuthology.orchestra.run.smithi121.stdout:(130/131): librbd1-18.0.0-5567.g64a4fc94.el8.x8 6.3 MB/s | 3.6 MB 00:00 2023-08-18T20:41:08.200 INFO:teuthology.orchestra.run.smithi122.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.7 MB/s | 171 kB 00:00 2023-08-18T20:41:08.244 INFO:teuthology.orchestra.run.smithi122.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 644 kB 00:00 2023-08-18T20:41:08.267 INFO:teuthology.orchestra.run.smithi122.stdout:(97/131): NetworkManager-initscripts-updown-1.3 914 kB/s | 138 kB 00:00 2023-08-18T20:41:08.302 INFO:teuthology.orchestra.run.smithi121.stdout:(131/131): librados2-18.0.0-5567.g64a4fc94.el8. 4.9 MB/s | 3.7 MB 00:00 2023-08-18T20:41:08.305 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-08-18T20:41:08.305 INFO:teuthology.orchestra.run.smithi121.stdout:Total 11 MB/s | 206 MB 00:19 2023-08-18T20:41:08.334 INFO:teuthology.orchestra.run.smithi122.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 815 kB/s | 54 kB 00:00 2023-08-18T20:41:08.368 INFO:teuthology.orchestra.run.smithi122.stdout:(99/131): python3-pyasn1-modules-0.3.7-6.el8.no 877 kB/s | 110 kB 00:00 2023-08-18T20:41:08.443 INFO:teuthology.orchestra.run.smithi122.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-08-18T20:41:08.476 INFO:teuthology.orchestra.run.smithi122.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-08-18T20:41:08.569 INFO:teuthology.orchestra.run.smithi122.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 310 kB/s | 39 kB 00:00 2023-08-18T20:41:08.610 INFO:teuthology.orchestra.run.smithi122.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-08-18T20:41:08.762 INFO:teuthology.orchestra.run.smithi122.stdout:(104/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-08-18T20:41:08.786 INFO:teuthology.orchestra.run.smithi122.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 895 kB/s | 157 kB 00:00 2023-08-18T20:41:08.820 INFO:teuthology.orchestra.run.smithi122.stdout:(106/131): python3-jinja2-2.10.1-3.el8.noarch.r 2.1 MB/s | 538 kB 00:00 2023-08-18T20:41:08.912 INFO:teuthology.orchestra.run.smithi122.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-08-18T20:41:08.970 INFO:teuthology.orchestra.run.smithi122.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 3.8 MB/s | 713 kB 00:00 2023-08-18T20:41:09.054 INFO:teuthology.orchestra.run.smithi122.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-08-18T20:41:09.147 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-08-18T20:41:09.152 INFO:teuthology.orchestra.run.smithi122.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 1.7 MB/s | 320 kB 00:00 2023-08-18T20:41:09.172 INFO:teuthology.orchestra.run.smithi122.stdout:(111/131): python3-jsonpatch-1.21-2.el8.noarch. 102 kB/s | 27 kB 00:00 2023-08-18T20:41:09.267 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-08-18T20:41:09.267 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-08-18T20:41:09.280 INFO:teuthology.orchestra.run.smithi122.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 194 kB/s | 44 kB 00:00 2023-08-18T20:41:09.372 INFO:teuthology.orchestra.run.smithi122.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-08-18T20:41:09.407 INFO:teuthology.orchestra.run.smithi122.stdout:(114/131): python3-werkzeug-0.12.2-4.el8.noarch 1.9 MB/s | 457 kB 00:00 2023-08-18T20:41:09.457 INFO:teuthology.orchestra.run.smithi122.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2023-08-18T20:41:09.482 INFO:teuthology.orchestra.run.smithi122.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 588 kB/s | 64 kB 00:00 2023-08-18T20:41:09.540 INFO:teuthology.orchestra.run.smithi122.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 942 kB/s | 126 kB 00:00 2023-08-18T20:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 149 kB/s | 20 kB 00:00 2023-08-18T20:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 562 kB/s | 103 kB 00:00 2023-08-18T20:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-08-18T20:41:09.783 INFO:teuthology.orchestra.run.smithi122.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-08-18T20:41:09.858 INFO:teuthology.orchestra.run.smithi122.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-08-18T20:41:09.959 INFO:teuthology.orchestra.run.smithi122.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-08-18T20:41:09.984 INFO:teuthology.orchestra.run.smithi122.stdout:(124/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-08-18T20:41:10.018 INFO:teuthology.orchestra.run.smithi122.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-08-18T20:41:10.168 INFO:teuthology.orchestra.run.smithi122.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.3 MB/s | 808 kB 00:00 2023-08-18T20:41:10.252 INFO:teuthology.orchestra.run.smithi122.stdout:(127/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-08-18T20:41:10.302 INFO:teuthology.orchestra.run.smithi122.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 5.3 MB/s | 1.5 MB 00:00 2023-08-18T20:41:10.387 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-08-18T20:41:10.391 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-08-18T20:41:10.452 INFO:teuthology.orchestra.run.smithi122.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.2 MB/s | 798 kB 00:00 2023-08-18T20:41:10.886 INFO:teuthology.orchestra.run.smithi122.stdout:(130/131): librbd1-18.0.0-5567.g64a4fc94.el8.x8 5.7 MB/s | 3.6 MB 00:00 2023-08-18T20:41:10.944 INFO:teuthology.orchestra.run.smithi122.stdout:(131/131): librados2-18.0.0-5567.g64a4fc94.el8. 4.8 MB/s | 3.7 MB 00:00 2023-08-18T20:41:10.947 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2023-08-18T20:41:10.947 INFO:teuthology.orchestra.run.smithi122.stdout:Total 10 MB/s | 206 MB 00:20 2023-08-18T20:41:11.772 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2023-08-18T20:41:11.892 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2023-08-18T20:41:11.892 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2023-08-18T20:41:13.021 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2023-08-18T20:41:13.025 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2023-08-18T20:41:15.326 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-08-18T20:41:15.558 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-18T20:41:15.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-18T20:41:15.967 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-18T20:41:16.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-18T20:41:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-18T20:41:16.496 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-18T20:41:16.900 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-18T20:41:17.102 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:41:17.497 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:41:17.693 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:41:17.820 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:41:18.152 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2023-08-18T20:41:18.252 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 8/134 2023-08-18T20:41:18.344 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-18T20:41:18.351 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 8/134 2023-08-18T20:41:18.546 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 9/134 2023-08-18T20:41:18.837 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-18T20:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-18T20:41:19.030 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-18T20:41:19.040 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-18T20:41:19.185 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-18T20:41:19.404 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-18T20:41:19.445 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-18T20:41:19.688 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-18T20:41:19.814 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-18T20:41:19.919 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 14/134 2023-08-18T20:41:20.028 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 14/134 2023-08-18T20:41:20.037 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 5/134 2023-08-18T20:41:20.201 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 15/134 2023-08-18T20:41:20.282 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 15/134 2023-08-18T20:41:20.409 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-18T20:41:20.466 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 5/134 2023-08-18T20:41:20.549 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-18T20:41:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-18T20:41:20.721 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:41:20.833 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:41:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:41:21.086 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:41:21.259 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 8/134 2023-08-18T20:41:21.318 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-18T20:41:21.446 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-18T20:41:21.484 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-18T20:41:21.733 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-18T20:41:21.948 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-18T20:41:22.084 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-18T20:41:22.292 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-18T20:41:22.420 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-18T20:41:22.683 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-18T20:41:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 14/134 2023-08-18T20:41:22.961 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 14/134 2023-08-18T20:41:22.985 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-18T20:41:23.154 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 15/134 2023-08-18T20:41:23.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-18T20:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 15/134 2023-08-18T20:41:23.482 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-18T20:41:23.485 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-18T20:41:23.710 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-18T20:41:23.892 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-18T20:41:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-18T20:41:24.116 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-18T20:41:24.215 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-18T20:41:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-18T20:41:24.457 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-18T20:41:24.595 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-18T20:41:24.654 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-18T20:41:24.857 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8. 26/134 2023-08-18T20:41:25.003 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el 27/134 2023-08-18T20:41:25.241 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-18T20:41:25.412 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-18T20:41:25.908 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_6 28/134 2023-08-18T20:41:25.999 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-18T20:41:26.195 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-18T20:41:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-18T20:41:26.518 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-18T20:41:26.795 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-18T20:41:26.880 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-18T20:41:27.017 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-18T20:41:27.194 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-18T20:41:27.368 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-18T20:41:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-18T20:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8. 26/134 2023-08-18T20:41:27.889 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el 27/134 2023-08-18T20:41:28.166 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_6 28/134 2023-08-18T20:41:28.361 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-18T20:41:28.779 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-18T20:41:29.143 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-18T20:41:29.353 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-18T20:41:29.544 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-18T20:41:29.763 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 36/134 2023-08-18T20:41:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_6 37/134 2023-08-18T20:41:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-18T20:41:30.130 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-18T20:41:30.233 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-18T20:41:30.427 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-18T20:41:30.585 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-18T20:41:30.770 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-18T20:41:30.969 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-18T20:41:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-18T20:41:31.323 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-18T20:41:31.517 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-18T20:41:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-18T20:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-18T20:41:31.825 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-18T20:41:32.045 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-18T20:41:32.063 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-18T20:41:32.273 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-18T20:41:32.278 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-18T20:41:32.481 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-18T20:41:32.581 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-18T20:41:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 36/134 2023-08-18T20:41:32.842 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_6 37/134 2023-08-18T20:41:32.848 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-18T20:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-18T20:41:33.091 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-18T20:41:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-18T20:41:33.303 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-18T20:41:33.344 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-18T20:41:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-18T20:41:33.487 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-18T20:41:33.656 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-18T20:41:33.692 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-18T20:41:33.881 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-18T20:41:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-18T20:41:34.084 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-18T20:41:34.153 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-18T20:41:34.297 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-18T20:41:34.399 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-18T20:41:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-18T20:41:34.606 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-18T20:41:34.788 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-18T20:41:34.797 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-18T20:41:34.972 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-18T20:41:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-18T20:41:35.141 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-18T20:41:35.146 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-18T20:41:35.281 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-18T20:41:35.318 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-18T20:41:35.418 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-18T20:41:35.508 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-18T20:41:35.642 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-18T20:41:35.715 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-18T20:41:35.861 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-18T20:41:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-18T20:41:36.081 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-18T20:41:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-18T20:41:36.360 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-18T20:41:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-18T20:41:36.523 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-18T20:41:36.605 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-18T20:41:36.705 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-18T20:41:36.848 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-18T20:41:36.908 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-18T20:41:37.115 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-18T20:41:37.182 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-18T20:41:37.426 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-18T20:41:37.437 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-18T20:41:37.601 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-18T20:41:37.643 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-18T20:41:37.791 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-18T20:41:37.819 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-18T20:41:38.014 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-18T20:41:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-18T20:41:38.208 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-18T20:41:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-18T20:41:38.390 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-18T20:41:38.405 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-18T20:41:38.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-18T20:41:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-18T20:41:38.748 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-18T20:41:38.952 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-18T20:41:39.037 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-18T20:41:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-18T20:41:39.282 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-18T20:41:39.395 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-18T20:41:39.528 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-18T20:41:39.685 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-18T20:41:39.701 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-18T20:41:39.887 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-18T20:41:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-18T20:41:40.107 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-18T20:41:40.168 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-18T20:41:40.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-18T20:41:40.369 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-18T20:41:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-18T20:41:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-18T20:41:40.934 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-18T20:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-18T20:41:41.320 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-18T20:41:41.418 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-18T20:41:41.529 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-18T20:41:41.666 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-18T20:41:41.708 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-18T20:41:41.890 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-18T20:41:41.938 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-18T20:41:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-18T20:41:42.238 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-18T20:41:42.316 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-18T20:41:42.540 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-18T20:41:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-18T20:41:42.713 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-18T20:41:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-18T20:41:43.076 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-18T20:41:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-18T20:41:43.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-18T20:41:43.721 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 92/134 2023-08-18T20:41:43.783 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 92/134 2023-08-18T20:41:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 93/134 2023-08-18T20:41:44.404 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-18T20:41:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-18T20:41:44.892 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-18T20:41:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-18T20:41:45.595 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-18T20:41:45.772 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-18T20:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-18T20:41:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 92/134 2023-08-18T20:41:46.817 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 92/134 2023-08-18T20:41:47.026 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 93/134 2023-08-18T20:41:47.565 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:47.783 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:48.366 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:48.687 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 95/134 2023-08-18T20:41:48.774 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 95/134 2023-08-18T20:41:48.945 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 96/134 2023-08-18T20:41:50.693 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 94/134 2023-08-18T20:41:51.793 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 95/134 2023-08-18T20:41:51.870 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 95/134 2023-08-18T20:41:52.025 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 96/134 2023-08-18T20:42:07.441 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 96/134 2023-08-18T20:42:07.441 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2023-08-18T20:42:07.441 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2023-08-18T20:42:07.441 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /dev 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /run 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2023-08-18T20:42:07.442 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /dev 2023-08-18T20:42:07.443 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:07.824 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 97/134 2023-08-18T20:42:09.409 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 97/134 2023-08-18T20:42:09.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 98/134 2023-08-18T20:42:09.843 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 98/134 2023-08-18T20:42:09.982 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 99/134 2023-08-18T20:42:10.434 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 99/134 2023-08-18T20:42:10.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 100/134 2023-08-18T20:42:10.624 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 100/134 2023-08-18T20:42:10.951 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 96/134 2023-08-18T20:42:10.951 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /run 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2023-08-18T20:42:10.952 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2023-08-18T20:42:10.953 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2023-08-18T20:42:10.953 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2023-08-18T20:42:10.953 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 97/134 2023-08-18T20:42:12.320 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 101/134 2023-08-18T20:42:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 101/134 2023-08-18T20:42:12.671 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.e 102/134 2023-08-18T20:42:12.865 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94. 103/134 2023-08-18T20:42:12.881 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 97/134 2023-08-18T20:42:13.065 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 104/134 2023-08-18T20:42:13.073 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 98/134 2023-08-18T20:42:13.282 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 104/134 2023-08-18T20:42:13.307 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 98/134 2023-08-18T20:42:13.481 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 99/134 2023-08-18T20:42:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 105/134 2023-08-18T20:42:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 99/134 2023-08-18T20:42:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 100/134 2023-08-18T20:42:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 100/134 2023-08-18T20:42:14.538 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 105/134 2023-08-18T20:42:14.706 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 106/134 2023-08-18T20:42:14.796 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 106/134 2023-08-18T20:42:15.193 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el 107/134 2023-08-18T20:42:15.373 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 108/134 2023-08-18T20:42:15.408 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 108/134 2023-08-18T20:42:15.605 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 109/134 2023-08-18T20:42:15.617 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 109/134 2023-08-18T20:42:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 101/134 2023-08-18T20:42:16.117 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 101/134 2023-08-18T20:42:16.245 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.e 102/134 2023-08-18T20:42:16.455 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94. 103/134 2023-08-18T20:42:16.639 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 104/134 2023-08-18T20:42:16.861 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 104/134 2023-08-18T20:42:16.923 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 110/134 2023-08-18T20:42:17.137 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 111/134 2023-08-18T20:42:17.147 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 105/134 2023-08-18T20:42:17.172 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 111/134 2023-08-18T20:42:17.364 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 112/134 2023-08-18T20:42:17.406 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 112/134 2023-08-18T20:42:17.539 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 113/134 2023-08-18T20:42:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 113/134 2023-08-18T20:42:18.072 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 114/134 2023-08-18T20:42:18.114 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 105/134 2023-08-18T20:42:18.280 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 106/134 2023-08-18T20:42:18.371 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 106/134 2023-08-18T20:42:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el 107/134 2023-08-18T20:42:18.964 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 108/134 2023-08-18T20:42:18.998 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 108/134 2023-08-18T20:42:19.172 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 109/134 2023-08-18T20:42:19.183 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 109/134 2023-08-18T20:42:20.527 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 110/134 2023-08-18T20:42:20.783 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 111/134 2023-08-18T20:42:20.818 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 111/134 2023-08-18T20:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 112/134 2023-08-18T20:42:21.039 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 112/134 2023-08-18T20:42:21.188 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 113/134 2023-08-18T20:42:21.543 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 113/134 2023-08-18T20:42:21.713 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 114/134 2023-08-18T20:42:22.634 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 114/134 2023-08-18T20:42:22.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 115/134 2023-08-18T20:42:23.087 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-18T20:42:23.276 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-18T20:42:24.209 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-18T20:42:24.519 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-18T20:42:24.713 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 119/134 2023-08-18T20:42:24.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-18T20:42:25.057 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_ 121/134 2023-08-18T20:42:25.221 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-18T20:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 114/134 2023-08-18T20:42:27.182 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 115/134 2023-08-18T20:42:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-18T20:42:27.703 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:27.720 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 117/134 2023-08-18T20:42:27.922 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 124/134 2023-08-18T20:42:28.057 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-18T20:42:28.186 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 125/134 2023-08-18T20:42:28.262 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-18T20:42:28.450 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 126/134 2023-08-18T20:42:28.453 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-18T20:42:28.725 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-18T20:42:28.788 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-18T20:42:28.908 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_ 121/134 2023-08-18T20:42:28.953 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-18T20:42:28.962 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-18T20:42:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-18T20:42:29.191 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-18T20:42:29.369 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-18T20:42:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-18T20:42:29.686 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-18T20:42:29.700 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-18T20:42:29.700 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:29.889 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:29.889 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-18T20:42:30.116 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-18T20:42:30.335 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:30.864 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:30.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 1/134 2023-08-18T20:42:30.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 2/134 2023-08-18T20:42:30.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 3/134 2023-08-18T20:42:30.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 4/134 2023-08-18T20:42:30.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 5/134 2023-08-18T20:42:30.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:42:30.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:42:30.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 8/134 2023-08-18T20:42:30.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 9/134 2023-08-18T20:42:30.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 10/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 11/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 12/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 13/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_ 14/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 15/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 16/134 2023-08-18T20:42:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_6 17/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 18/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 19/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el 20/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8. 21/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_6 22/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 23/134 2023-08-18T20:42:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 24/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 25/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 26/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 27/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 28/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94. 29/134 2023-08-18T20:42:30.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 30/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 31/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 32/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el 33/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 34/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.e 35/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 36/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 37/134 2023-08-18T20:42:30.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 38/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-18T20:42:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-18T20:42:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-18T20:42:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-18T20:42:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-18T20:42:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-18T20:42:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-18T20:42:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-18T20:42:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-18T20:42:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-18T20:42:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-18T20:42:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-18T20:42:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-18T20:42:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-18T20:42:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-18T20:42:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 129/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 131/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-18T20:42:31.342 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:31.587 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:31.604 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-18T20:42:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 124/134 2023-08-18T20:42:32.087 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 125/134 2023-08-18T20:42:32.428 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 126/134 2023-08-18T20:42:32.790 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-18T20:42:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-18T20:42:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-18T20:42:33.287 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-18T20:42:33.299 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-18T20:42:33.422 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:33.423 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:56 ago on Fri 18 Aug 2023 08:40:37 PM UTC. 2023-08-18T20:42:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-18T20:42:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-18T20:42:33.630 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-18T20:42:33.631 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-18T20:42:34.058 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-18T20:42:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:34.751 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 1/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 2/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 3/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 4/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5567.g64a4f 5/134 2023-08-18T20:42:34.752 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 6/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 7/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 8/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 9/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 10/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 11/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 12/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 13/134 2023-08-18T20:42:34.753 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_ 14/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 15/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 16/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_6 17/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86 18/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 19/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el 20/134 2023-08-18T20:42:34.754 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8. 21/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_6 22/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 23/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 24/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 25/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 26/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 27/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 28/134 2023-08-18T20:42:34.755 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94. 29/134 2023-08-18T20:42:34.756 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noa 30/134 2023-08-18T20:42:34.762 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.n 31/134 2023-08-18T20:42:34.762 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a 32/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el 33/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 34/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.e 35/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 36/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 37/134 2023-08-18T20:42:34.763 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 38/134 2023-08-18T20:42:34.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-18T20:42:34.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-18T20:42:34.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-18T20:42:34.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-18T20:42:34.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-18T20:42:34.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-18T20:42:34.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-18T20:42:34.767 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-18T20:42:34.768 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-18T20:42:34.769 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-18T20:42:34.770 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-18T20:42:34.771 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-18T20:42:34.772 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-18T20:42:34.773 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-18T20:42:34.774 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-18T20:42:34.775 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-18T20:42:34.776 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 129/134 2023-08-18T20:42:34.777 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-18T20:42:34.777 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 131/134 2023-08-18T20:42:34.777 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-18T20:42:34.777 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-18T20:42:37.322 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-18T20:42:37.323 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:59 ago on Fri 18 Aug 2023 08:40:38 PM UTC. 2023-08-18T20:42:44.923 INFO:teuthology.orchestra.run.smithi121.stdout:Installed products updated. 2023-08-18T20:42:45.155 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:45.155 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.1-7.el8.noarch 2023-08-18T20:42:45.156 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.0.4-10.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.158 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.159 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.1-9.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: jq-1.6-3.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-18T20:42:45.160 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-18T20:42:45.161 INFO:teuthology.orchestra.run.smithi121.stdout: libpq-13.5-1.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.162 INFO:teuthology.orchestra.run.smithi121.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-18T20:42:45.163 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-18T20:42:45.165 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-18T20:42:45.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-18T20:42:45.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-18T20:42:45.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-2.6-1.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-18T20:42:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-18T20:42:45.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-18T20:42:45.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-18T20:42:45.172 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-18T20:42:45.173 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-18T20:42:45.173 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-18T20:42:45.173 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-18T20:42:45.173 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-18T20:42:45.174 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:45.174 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-08-18T20:42:45.372 DEBUG:teuthology.parallel:result is None 2023-08-18T20:42:46.470 INFO:teuthology.orchestra.run.smithi122.stdout:Installed products updated. 2023-08-18T20:42:46.755 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:46.756 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2023-08-18T20:42:46.756 INFO:teuthology.orchestra.run.smithi122.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-18T20:42:46.756 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.756 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.756 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.1-7.el8.noarch 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.0.4-10.el8.x86_64 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.757 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.758 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.759 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:18.0.0-5567.g64a4fc94.el8.noarch 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.1-9.el8.x86_64 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-18T20:42:46.760 INFO:teuthology.orchestra.run.smithi122.stdout: jq-1.6-3.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.761 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: libpq-13.5-1.el8.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.762 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-18T20:42:46.763 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-18T20:42:46.764 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-18T20:42:46.765 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-18T20:42:46.766 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-18T20:42:46.767 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-18T20:42:46.768 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-2.6-1.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-18T20:42:46.769 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.770 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-18T20:42:46.771 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:18.0.0-5567.g64a4fc94.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-18T20:42:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-18T20:42:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:46.774 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-08-18T20:42:47.139 DEBUG:teuthology.parallel:result is None 2023-08-18T20:42:47.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=64a4fc940624dbc1b65654f740fd0424260cfd2a 2023-08-18T20:42:47.356 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-18T20:42:47.379 INFO:teuthology.orchestra.run.smithi121.stdout:18.0.0-5567.g64a4fc94.el8 2023-08-18T20:42:47.380 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5567.g64a4fc94.el8 2023-08-18T20:42:47.381 INFO:teuthology.task.install:The correct ceph version 18.0.0-5567.g64a4fc94 is installed. 2023-08-18T20:42:47.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=64a4fc940624dbc1b65654f740fd0424260cfd2a 2023-08-18T20:42:47.518 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-18T20:42:47.542 INFO:teuthology.orchestra.run.smithi122.stdout:18.0.0-5567.g64a4fc94.el8 2023-08-18T20:42:47.542 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5567.g64a4fc94.el8 2023-08-18T20:42:47.543 INFO:teuthology.task.install:The correct ceph version 18.0.0-5567.g64a4fc94 is installed. 2023-08-18T20:42:47.543 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-18T20:42:47.544 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:47.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-18T20:42:47.590 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:47.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-18T20:42:47.635 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-18T20:42:47.635 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:47.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2023-08-18T20:42:47.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-18T20:42:47.729 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:47.729 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2023-08-18T20:42:47.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-18T20:42:47.821 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-18T20:42:47.822 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:47.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-18T20:42:47.848 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-18T20:42:47.913 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:47.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-18T20:42:47.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-18T20:42:48.008 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-18T20:42:48.009 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:48.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2023-08-18T20:42:48.034 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-18T20:42:48.099 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:48.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2023-08-18T20:42:48.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-18T20:42:48.191 INFO:teuthology.run_tasks:Running task ceph... 2023-08-18T20:42:48.264 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-18T20:42:48.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2023-08-18T20:42:48.267 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2023-08-18T20:42:48.293 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-18T20:42:48.293 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-18T20:42:48.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-18T20:42:48.358 INFO:tasks.ceph:Creating extra log directories... 2023-08-18T20:42:48.358 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-18T20:42:48.398 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-18T20:42:48.431 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-18T20:42:48.431 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-18T20:42:48.432 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-18T20:42:48.432 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:48.432 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-18T20:42:48.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-18T20:42:48.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-18T20:42:48.648 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:48.649 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-18T20:42:48.664 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-18T20:42:48.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-18T20:42:48.823 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-18T20:42:48.824 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-18T20:42:48.824 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi/7372445', 'branch': 'main', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7372445', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-18_20:13:47-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 8204, 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_64a4fc940624dbc1b65654f740fd0424260cfd2a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi121.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi122.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '64a4fc940624dbc1b65654f740fd0424260cfd2a'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-18_20:13:47', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-18T20:42:48.825 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-18T20:42:48.827 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-18T20:42:48.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2023-08-18T20:42:48.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2023-08-18T20:42:48.942 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:48.942 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2023-08-18T20:42:48.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-18T20:42:48.985 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2023-08-18T20:42:49.041 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-18T20:42:49.042 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 388370 Links: 1 2023-08-18T20:42:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-18 20:42:30.551523421 +0000 2023-08-18T20:42:49.043 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-18 20:39:42.798376386 +0000 2023-08-18T20:42:49.043 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-18 20:39:42.798376386 +0000 2023-08-18T20:42:49.043 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2023-08-18T20:42:49.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-18T20:42:49.107 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-18T20:42:49.107 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-18T20:42:49.107 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000260454 s, 2.0 MB/s 2023-08-18T20:42:49.108 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-18T20:42:49.165 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2023-08-18T20:42:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-18T20:42:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.222 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 390294 Links: 1 2023-08-18T20:42:49.222 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.222 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.223 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-18 20:42:30.551523421 +0000 2023-08-18T20:42:49.223 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-18 20:39:43.359369099 +0000 2023-08-18T20:42:49.223 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-18 20:39:43.359369099 +0000 2023-08-18T20:42:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2023-08-18T20:42:49.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-18T20:42:49.288 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-18T20:42:49.288 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-18T20:42:49.288 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000204348 s, 2.5 MB/s 2023-08-18T20:42:49.289 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-18T20:42:49.346 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2023-08-18T20:42:49.402 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-18T20:42:49.402 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.402 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 390412 Links: 1 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-18 20:42:30.552523408 +0000 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-18 20:39:43.905362008 +0000 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-18 20:39:43.905362008 +0000 2023-08-18T20:42:49.403 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2023-08-18T20:42:49.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-18T20:42:49.466 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-18T20:42:49.467 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-18T20:42:49.467 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.00022263 s, 2.3 MB/s 2023-08-18T20:42:49.468 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-18T20:42:49.525 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2023-08-18T20:42:49.581 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-18T20:42:49.581 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 390486 Links: 1 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-18 20:42:30.552523408 +0000 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-18 20:39:44.478354565 +0000 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-18 20:39:44.478354565 +0000 2023-08-18T20:42:49.582 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2023-08-18T20:42:49.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-18T20:42:49.646 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-18T20:42:49.646 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-18T20:42:49.647 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000228485 s, 2.2 MB/s 2023-08-18T20:42:49.647 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-18T20:42:49.706 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:49.706 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:49.707 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2023-08-18T20:42:49.722 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-18T20:42:49.723 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2023-08-18T20:42:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-18T20:42:49.778 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 387001 Links: 1 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-08-18 20:42:34.462023848 +0000 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-08-18 20:39:42.792599070 +0000 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-08-18 20:39:42.792599070 +0000 2023-08-18T20:42:49.779 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-08-18T20:42:49.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-18T20:42:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-08-18T20:42:49.843 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-08-18T20:42:49.843 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000230416 s, 2.2 MB/s 2023-08-18T20:42:49.844 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-18T20:42:49.901 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2023-08-18T20:42:49.957 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 388609 Links: 1 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-08-18 20:42:34.462023848 +0000 2023-08-18T20:42:49.958 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-08-18 20:39:43.369585882 +0000 2023-08-18T20:42:49.959 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-08-18 20:39:43.369585882 +0000 2023-08-18T20:42:49.959 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-08-18T20:42:49.959 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-18T20:42:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-08-18T20:42:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-08-18T20:42:50.022 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000214676 s, 2.4 MB/s 2023-08-18T20:42:50.022 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-18T20:42:50.080 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2023-08-18T20:42:50.135 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 379583 Links: 1 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-08-18 20:42:34.462023848 +0000 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-08-18 20:39:43.928573105 +0000 2023-08-18T20:42:50.136 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-08-18 20:39:43.928573105 +0000 2023-08-18T20:42:50.137 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-08-18T20:42:50.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-18T20:42:50.199 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-08-18T20:42:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-08-18T20:42:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000235451 s, 2.2 MB/s 2023-08-18T20:42:50.201 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-18T20:42:50.258 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2023-08-18T20:42:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-18T20:42:50.314 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-18T20:42:50.314 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 389355 Links: 1 2023-08-18T20:42:50.314 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-18T20:42:50.315 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-08-18T20:42:50.315 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-08-18 20:42:34.462023848 +0000 2023-08-18T20:42:50.315 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-08-18 20:39:44.496560123 +0000 2023-08-18T20:42:50.315 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-08-18 20:39:44.496560123 +0000 2023-08-18T20:42:50.315 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-08-18T20:42:50.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-18T20:42:50.378 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-08-18T20:42:50.379 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-08-18T20:42:50.379 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000172973 s, 3.0 MB/s 2023-08-18T20:42:50.380 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-18T20:42:50.438 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:50.438 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-18T20:42:50.439 INFO:tasks.ceph:Generating config... 2023-08-18T20:42:50.440 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-18T20:42:50.440 INFO:tasks.ceph:[client] debug client = 20 2023-08-18T20:42:50.440 INFO:tasks.ceph:[client] debug ms = 1 2023-08-18T20:42:50.441 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-18T20:42:50.441 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-18T20:42:50.441 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-18T20:42:50.441 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-18T20:42:50.441 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-18T20:42:50.442 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-18T20:42:50.443 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-18T20:42:50.443 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-18T20:42:50.443 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-18T20:42:50.443 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-18T20:42:50.443 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-18T20:42:50.444 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-18T20:42:50.444 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-18T20:42:50.444 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-18T20:42:50.444 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-18T20:42:50.444 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-18T20:42:50.445 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-18T20:42:50.445 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-18T20:42:50.445 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-18T20:42:50.445 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-18T20:42:50.445 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-18T20:42:50.446 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-18T20:42:50.447 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-18T20:42:50.447 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-18T20:42:50.447 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-18T20:42:50.447 INFO:tasks.ceph:Setting up mon.a... 2023-08-18T20:42:50.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-18T20:42:50.688 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2023-08-18T20:42:50.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-18T20:42:50.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-18T20:42:50.765 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121'), ('mon.b', '172.21.15.122'), ('mon.c', '[v2:172.21.15.122:3301,v1:172.21.15.122:6790]')] 2023-08-18T20:42:50.766 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.121,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-18T20:42:50.767 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:50.767 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-18T20:42:50.821 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.121 --add b 172.21.15.122 --addv c '[v2:172.21.15.122:3301,v1:172.21.15.122:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:50.908 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:50.909 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid 4755cd5f-6734-4b3f-8f96-cd10dcf8d04c 2023-08-18T20:42:50.909 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = pacific 2023-08-18T20:42:50.909 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2023-08-18T20:42:50.909 INFO:teuthology.orchestra.run.smithi121.stdout:fsid 4755cd5f-6734-4b3f-8f96-cd10dcf8d04c 2023-08-18T20:42:50.909 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2023-08-18T20:42:50.909510+0000 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:created 2023-08-18T20:42:50.909510+0000 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 16 (pacific) 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:election_strategy: 1 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:2: [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] mon.c 2023-08-18T20:42:50.910 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-18T20:42:50.911 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-18T20:42:50.927 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4755cd5f-6734-4b3f-8f96-cd10dcf8d04c... 2023-08-18T20:42:50.928 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-18T20:42:50.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-18T20:42:51.012 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2023-08-18T20:42:51.012 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2023-08-18T20:42:51.013 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-18T20:42:51.013 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2023-08-18T20:42:51.013 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.013 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2023-08-18T20:42:51.013 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2023-08-18T20:42:51.014 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-18T20:42:51.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2023-08-18T20:42:51.016 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2023-08-18T20:42:51.017 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2023-08-18T20:42:51.017 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2023-08-18T20:42:51.017 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-18T20:42:51.017 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-18T20:42:51.017 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.018 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2023-08-18T20:42:51.019 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2023-08-18T20:42:51.019 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2023-08-18T20:42:51.019 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-08-18T20:42:51.019 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2023-08-18T20:42:51.019 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 4755cd5f-6734-4b3f-8f96-cd10dcf8d04c 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2023-08-18T20:42:51.020 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2023-08-18T20:42:51.021 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.022 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2023-08-18T20:42:51.023 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2023-08-18T20:42:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2023-08-18T20:42:51.025 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-08-18T20:42:51.026 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2023-08-18T20:42:51.027 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2023-08-18T20:42:51.028 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2023-08-18T20:42:51.029 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2023-08-18T20:42:51.030 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2023-08-18T20:42:51.031 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-08-18T20:42:51.032 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2023-08-18T20:42:51.033 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2023-08-18T20:42:51.034 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2023-08-18T20:42:51.035 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2023-08-18T20:42:51.035 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-08-18T20:42:51.035 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-08-18T20:42:51.035 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-08-18T20:42:51.036 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.037 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2023-08-18T20:42:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2023-08-18T20:42:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2023-08-18T20:42:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.038 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-18T20:42:51.039 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2023-08-18T20:42:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2023-08-18T20:42:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2023-08-18T20:42:51.040 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-18T20:42:51.041 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.121,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on skipped message = False 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 4755cd5f-6734-4b3f-8f96-cd10dcf8d04c 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2023-08-18T20:42:51.043 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2023-08-18T20:42:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2023-08-18T20:42:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2023-08-18T20:42:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2023-08-18T20:42:51.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2023-08-18T20:42:51.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2023-08-18T20:42:51.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2023-08-18T20:42:51.047 INFO:teuthology.orchestra.run.smithi122.stdout: bdev async discard = True 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: bdev enable discard = True 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = bitmap 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2023-08-18T20:42:51.048 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2023-08-18T20:42:51.049 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-08-18T20:42:51.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.051 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2023-08-18T20:42:51.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2023-08-18T20:42:51.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.054 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2023-08-18T20:42:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: mon op complaint time = 120 2023-08-18T20:42:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-08-18T20:42:51.055 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2023-08-18T20:42:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2023-08-18T20:42:51.055 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: client mount timeout = 600 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-08-18T20:42:51.056 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2023-08-18T20:42:51.057 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds = 20 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds balancer = 20 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug frag = True 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug scatterstat = True 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: mds op complaint time = 180 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: mds verify scatter = True 2023-08-18T20:42:51.058 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-08-18T20:42:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-08-18T20:42:51.059 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-08-18T20:42:51.059 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-18T20:42:51.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-18T20:42:51.134 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-18T20:42:51.135 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:51.135 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-18T20:42:51.151 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:51.151 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-18T20:42:51.207 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:42:51.207 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:51.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-18T20:42:51.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-18T20:42:51.284 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:42:51.284 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:51.340 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:42:51.340 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:51.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-18T20:42:51.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-18T20:42:51.378 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:42:51.379 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:51.435 INFO:tasks.ceph:Setting up mon nodes... 2023-08-18T20:42:51.435 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-18T20:42:51.435 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-18T20:42:51.488 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-18T20:42:51.491 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-18T20:42:51.573 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-18T20:42:51.576 INFO:tasks.ceph:Setting up mds nodes... 2023-08-18T20:42:51.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-18T20:42:51.630 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-18T20:42:51.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-18T20:42:51.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-18T20:42:51.755 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-18T20:42:51.758 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-18T20:42:51.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-18T20:42:51.841 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-18T20:42:51.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-18T20:42:51.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-18T20:42:51.961 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-18T20:42:51.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-18T20:42:51.989 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-18T20:42:51.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-18T20:42:52.033 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-18T20:42:52.045 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-18T20:42:52.087 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-18T20:42:52.100 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-18T20:42:52.100 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-18T20:42:52.101 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-18T20:42:52.126 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:52.127 INFO:tasks.ceph:role: osd.0 2023-08-18T20:42:52.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:42:52.127 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-18T20:42:52.200 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:42:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:42:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:42:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:42:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:42:52.648 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-18T20:42:52.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-18T20:42:52.650 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-18T20:42:52.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-18T20:42:52.842 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-18T20:42:52.908 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:52.908 INFO:tasks.ceph:role: osd.1 2023-08-18T20:42:52.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:42:52.909 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-18T20:42:52.981 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:42:52.981 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:42:52.981 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:42:52.981 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:42:52.982 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:42:53.406 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-18T20:42:53.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-18T20:42:53.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-18T20:42:53.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-18T20:42:53.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-18T20:42:53.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:53.606 INFO:tasks.ceph:role: osd.2 2023-08-18T20:42:53.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:42:53.607 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-18T20:42:53.679 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:42:53.680 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:42:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:42:53.681 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:42:54.130 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-18T20:42:54.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-18T20:42:54.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-18T20:42:54.293 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-18T20:42:54.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-18T20:42:54.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-18T20:42:54.392 INFO:tasks.ceph:role: osd.3 2023-08-18T20:42:54.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:42:54.393 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-18T20:42:54.466 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:42:54.466 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:42:54.466 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:42:54.466 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:42:54.467 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:42:54.467 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:42:54.467 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:42:54.467 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:42:54.467 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:42:54.468 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:42:54.911 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-18T20:42:54.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-18T20:42:54.913 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-18T20:42:55.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-18T20:42:55.096 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:55.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.246+0000 7f1d00700640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-18T20:42:55.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.247+0000 7f1d00700640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-18T20:42:55.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.247+0000 7f1d00700640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-18T20:42:55.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.247+0000 7f1d00700640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-18T20:42:55.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.247+0000 7f1d00700640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-18T20:42:55.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:55.247+0000 7f1d00700640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-18T20:42:58.149 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-18T20:42:58.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:42:58.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-18T20:42:58.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-18T20:42:58.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-18T20:42:58.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-18T20:42:58.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-18T20:42:58.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:42:58.262+0000 7fcff7ff5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-18T20:43:01.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-18T20:43:01.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:01.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.251+0000 7f09054ca640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-18T20:43:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.251+0000 7f09054ca640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-18T20:43:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.251+0000 7f09054ca640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-18T20:43:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.251+0000 7f09054ca640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-18T20:43:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.251+0000 7f09054ca640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-18T20:43:01.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:01.252+0000 7f09054ca640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-18T20:43:04.115 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-18T20:43:04.146 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:04.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.239+0000 7f557b1ce640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-18T20:43:04.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.239+0000 7f557b1ce640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-18T20:43:04.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.239+0000 7f557b1ce640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-18T20:43:04.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.239+0000 7f557b1ce640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-18T20:43:04.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.239+0000 7f557b1ce640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-18T20:43:04.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:04.240+0000 7f557b1ce640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-18T20:43:07.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-18T20:43:07.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-18T20:43:07.166 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-18T20:43:07.167 INFO:tasks.ceph:role: osd.4 2023-08-18T20:43:07.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:43:07.167 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-18T20:43:07.245 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:43:07.245 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:43:07.246 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:43:07.247 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:43:07.671 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-08-18T20:43:07.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-08-18T20:43:07.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-18T20:43:07.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-18T20:43:07.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-18T20:43:07.942 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-18T20:43:07.943 INFO:tasks.ceph:role: osd.5 2023-08-18T20:43:07.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:43:07.943 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-18T20:43:08.018 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:43:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:43:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:43:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:43:08.018 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:43:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:43:08.019 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:43:08.019 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:43:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:43:08.019 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:43:08.446 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-08-18T20:43:08.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-08-18T20:43:08.448 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-18T20:43:08.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-18T20:43:08.589 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-18T20:43:08.657 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-18T20:43:08.657 INFO:tasks.ceph:role: osd.6 2023-08-18T20:43:08.658 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:43:08.658 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-18T20:43:08.732 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:43:08.732 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:43:08.732 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:43:08.732 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:43:08.733 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:43:09.183 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-08-18T20:43:09.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-08-18T20:43:09.185 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-18T20:43:09.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-18T20:43:09.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-18T20:43:09.467 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-18T20:43:09.467 INFO:tasks.ceph:role: osd.7 2023-08-18T20:43:09.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:43:09.468 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-18T20:43:09.547 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-18T20:43:09.548 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-18T20:43:09.548 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-18T20:43:09.548 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-18T20:43:09.548 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-18T20:43:09.548 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-08-18T20:43:09.549 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-18T20:43:09.549 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-18T20:43:09.549 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-18T20:43:09.549 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-18T20:43:09.988 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-08-18T20:43:09.990 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-08-18T20:43:09.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-18T20:43:10.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-18T20:43:10.209 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:10.339 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.339+0000 7f720ea25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-18T20:43:10.339 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.339+0000 7f720ea25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-18T20:43:10.340 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.339+0000 7f720ea25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-18T20:43:10.340 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.339+0000 7f720ea25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-18T20:43:10.340 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.339+0000 7f720ea25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-18T20:43:10.341 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:10.340+0000 7f720ea25640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-18T20:43:13.206 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-18T20:43:13.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:13.335 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.335+0000 7f8f4a1e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-18T20:43:13.335 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.336+0000 7f8f4a1e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-18T20:43:13.335 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.336+0000 7f8f4a1e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-18T20:43:13.336 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.336+0000 7f8f4a1e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-18T20:43:13.336 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.336+0000 7f8f4a1e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-18T20:43:13.336 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:13.336+0000 7f8f4a1e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-18T20:43:16.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-18T20:43:16.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:16.331 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.331+0000 7fe79d85e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-18T20:43:16.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.331+0000 7fe79d85e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-18T20:43:16.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.331+0000 7fe79d85e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-18T20:43:16.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.331+0000 7fe79d85e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-18T20:43:16.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.331+0000 7fe79d85e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-18T20:43:16.333 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:16.332+0000 7fe79d85e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-18T20:43:18.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:43:18.829 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:43:19.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-18T20:43:19.223 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:19.319 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.319+0000 7f5b79287640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-18T20:43:19.319 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.319+0000 7f5b79287640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-18T20:43:19.319 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.319+0000 7f5b79287640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-18T20:43:19.320 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.319+0000 7f5b79287640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-18T20:43:19.320 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.320+0000 7f5b79287640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-18T20:43:19.320 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:19.320+0000 7f5b79287640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-18T20:43:22.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-18T20:43:22.212 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-18T20:43:22.212 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-18T20:43:22.244 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.245 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-18T20:43:22.313 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-18T20:43:22.383 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-18T20:43:22.451 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-18T20:43:22.518 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-18T20:43:22.583 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:22.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-18T20:43:22.649 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.649 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-18T20:43:22.682 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-18T20:43:22.753 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-18T20:43:22.825 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.826 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-18T20:43:22.897 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.897 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-18T20:43:22.969 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:22.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-18T20:43:23.041 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:23.041 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-18T20:43:23.113 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:23.113 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-18T20:43:23.134 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:23.134 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-18T20:43:23.173 INFO:tasks.ceph:Adding keys to all mons... 2023-08-18T20:43:23.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-18T20:43:23.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-18T20:43:23.218 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2023-08-18T20:43:23.218 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199k4X4vHRAA02Ik8CbuInP8RM5T3Z9qqw== 2023-08-18T20:43:23.218 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2023-08-18T20:43:23.218 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199ktYKlJRAAs3mdbvzBKm1gLPfu8TLwlg== 2023-08-18T20:43:23.218 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199kW+0aLRAAud1uvjmNRpU23rxK9nkK3Q== 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDP199kr+27DhAAPoOB9TF8z4jkfi5FxHUlEw== 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDS199kn0mkDxAAj5a4T282EkIifx69SShtMg== 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2023-08-18T20:43:23.219 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDV199kw+X/DhAAQ2yTAFT/Km+Ew2TPwuJLOQ== 2023-08-18T20:43:23.220 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2023-08-18T20:43:23.220 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDY199keIxJDhAAnPMJ66EEeCVapCyfpeX8Cg== 2023-08-18T20:43:23.220 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2023-08-18T20:43:23.220 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199k071CIhAA4ietCYXB23iN50L9O0VEAw== 2023-08-18T20:43:23.220 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2023-08-18T20:43:23.221 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199kqtgxMhAAdpQQEmGpyIJyUuUXtpzLow== 2023-08-18T20:43:23.221 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2023-08-18T20:43:23.221 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL199kBXpoORAA10zaeB/8n2rpDXJwCxolLA== 2023-08-18T20:43:23.221 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2023-08-18T20:43:23.221 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDe199kAK1DFBAAI9P5XM6ck/pDxTKY9p5MwQ== 2023-08-18T20:43:23.222 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2023-08-18T20:43:23.222 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDh199kJWQJFBAAoNVlAuCLrwWSyyrc40GklQ== 2023-08-18T20:43:23.222 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2023-08-18T20:43:23.222 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDk199k9nbEExAA+21djSBfGKMzVRbn3fofkg== 2023-08-18T20:43:23.222 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2023-08-18T20:43:23.223 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDn199kreETExAAuxx2sXu016kvAc8Mj1dV8A== 2023-08-18T20:43:23.223 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2023-08-18T20:43:23.223 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ== 2023-08-18T20:43:23.223 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2023-08-18T20:43:23.223 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A== 2023-08-18T20:43:23.244 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.y] 2023-08-18T20:43:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199k4X4vHRAA02Ik8CbuInP8RM5T3Z9qqw== 2023-08-18T20:43:23.245 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2023-08-18T20:43:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199ktYKlJRAAs3mdbvzBKm1gLPfu8TLwlg== 2023-08-18T20:43:23.245 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2023-08-18T20:43:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199kW+0aLRAAud1uvjmNRpU23rxK9nkK3Q== 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDP199kr+27DhAAPoOB9TF8z4jkfi5FxHUlEw== 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDS199kn0mkDxAAj5a4T282EkIifx69SShtMg== 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDV199kw+X/DhAAQ2yTAFT/Km+Ew2TPwuJLOQ== 2023-08-18T20:43:23.246 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDY199keIxJDhAAnPMJ66EEeCVapCyfpeX8Cg== 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199k071CIhAA4ietCYXB23iN50L9O0VEAw== 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199kqtgxMhAAdpQQEmGpyIJyUuUXtpzLow== 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2023-08-18T20:43:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDL199kBXpoORAA10zaeB/8n2rpDXJwCxolLA== 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.4] 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDe199kAK1DFBAAI9P5XM6ck/pDxTKY9p5MwQ== 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.5] 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDh199kJWQJFBAAoNVlAuCLrwWSyyrc40GklQ== 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.6] 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDk199k9nbEExAA+21djSBfGKMzVRbn3fofkg== 2023-08-18T20:43:23.248 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.7] 2023-08-18T20:43:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDn199kreETExAAuxx2sXu016kvAc8Mj1dV8A== 2023-08-18T20:43:23.249 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2023-08-18T20:43:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ== 2023-08-18T20:43:23.249 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2023-08-18T20:43:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A== 2023-08-18T20:43:23.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-18T20:43:23.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-18T20:43:23.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.416 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.529 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.586 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.694 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-18T20:43:23.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-18T20:43:23.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-18T20:43:23.865 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:23.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:24.037 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:24.041 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-18T20:43:24.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-18T20:43:24.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-18T20:43:24.153 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-18T20:43:24.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-18T20:43:24.210 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-18T20:43:24.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-18T20:43:24.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-18T20:43:24.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-18T20:43:24.360 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-18T20:43:24.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-18T20:43:24.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-18T20:43:24.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-18T20:43:24.575 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-18T20:43:24.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-18T20:43:24.698 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:24.701 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-18T20:43:24.755 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-18T20:43:24.755 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-18T20:43:24.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-18T20:43:24.758 INFO:tasks.ceph.mon.a:Started 2023-08-18T20:43:24.758 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-18T20:43:24.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-18T20:43:24.796 INFO:tasks.ceph.mon.b:Started 2023-08-18T20:43:24.797 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-18T20:43:24.797 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-18T20:43:24.798 INFO:tasks.ceph.mon.c:Started 2023-08-18T20:43:24.799 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-18T20:43:24.799 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-18T20:43:24.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-18T20:43:24.801 INFO:tasks.ceph.mgr.y:Started 2023-08-18T20:43:24.802 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-18T20:43:24.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-18T20:43:24.804 INFO:tasks.ceph.mgr.x:Started 2023-08-18T20:43:24.804 INFO:tasks.ceph:Setting crush tunables to default 2023-08-18T20:43:24.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2023-08-18T20:43:24.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.969+0000 7f9f15e01700 1 Processor -- start 2023-08-18T20:43:24.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.969+0000 7f9f15e01700 1 -- start start 2023-08-18T20:43:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f100c2de0 con 0x7f9f100a6200 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f100c6840 con 0x7f9f1014ea70 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f15e01700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c1aa0 con 0x7f9f100c3a30 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0effd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:24.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:49162/0 (socket says 172.21.15.121:49162) 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 -- 172.21.15.121:0/2664495364 learned_addr learned my addr 172.21.15.121:0/2664495364 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0effd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39326/0 (socket says 172.21.15.121:39326) 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 -- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 msgr2=0x7f9f100c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 -- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 msgr2=0x7f9f100c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.970+0000 7f9f0f7fe700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-18T20:43:24.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0f7fe700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0ffff700 1 -- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 msgr2=0x7f9f10151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0ffff700 1 -- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 msgr2=0x7f9f10151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0effd700 1 -- 172.21.15.121:0/2664495364 >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 msgr2=0x7f9f100c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-18T20:43:24.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0effd700 1 -- 172.21.15.121:0/2664495364 >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 msgr2=0x7f9f100c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-18T20:43:24.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-18T20:43:24.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:24.971+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-18T20:43:25.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.121:3300/0 conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0f7fe700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 -- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 msgr2=0x7f9f10151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:25.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 -- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 msgr2=0x7f9f100c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 -- 172.21.15.121:0/2664495364 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100c1d80 con 0x7f9f100a6200 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0f7fe700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0effd700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f100c34f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f100a94a0 tx=0x7f9f04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d602a4b1370ea0d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:25.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0e7fc700 1 -- 172.21.15.121:0/2664495364 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400c070 con 0x7f9f100a6200 2023-08-18T20:43:25.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0e7fc700 1 -- 172.21.15.121:0/2664495364 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04013610 con 0x7f9f100a6200 2023-08-18T20:43:25.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.172+0000 7f9f0e7fc700 1 -- 172.21.15.121:0/2664495364 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040139a0 con 0x7f9f100a6200 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 -- 172.21.15.121:0/2664495364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 msgr2=0x7f9f100c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f100c34f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f100a94a0 tx=0x7f9f04009b60 comp rx=0 tx=0).stop 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 -- 172.21.15.121:0/2664495364 shutdown_connections 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 --2- 172.21.15.121:0/2664495364 >> v2:172.21.15.122:3300/0 conn(0x7f9f1014ea70 0x7f9f100c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f100c3a30 0x7f9f10151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 --2- 172.21.15.121:0/2664495364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f100c34f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 -- 172.21.15.121:0/2664495364 >> 172.21.15.121:0/2664495364 conn(0x7f9f100a8800 msgr2=0x7f9f100a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:25.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 -- 172.21.15.121:0/2664495364 shutdown_connections 2023-08-18T20:43:25.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.173+0000 7f9f15e01700 1 -- 172.21.15.121:0/2664495364 wait complete. 2023-08-18T20:43:25.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.175+0000 7f9f15e01700 1 Processor -- start 2023-08-18T20:43:25.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.175+0000 7f9f15e01700 1 -- start start 2023-08-18T20:43:25.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 0x7f9f1014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 0x7f9f101428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1014f7d0 con 0x7f9f100a6200 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100722f0 con 0x7f9f100c3a30 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f15e01700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1014f210 con 0x7f9f1014ea70 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f0f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f0f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39352/0 (socket says 172.21.15.121:39352) 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f0f7fe700 1 -- 172.21.15.121:0/910356602 learned_addr learned my addr 172.21.15.121:0/910356602 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 0x7f9f101428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.176+0000 7f9f0effd700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 0x7f9f1014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 -- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 msgr2=0x7f9f1014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 0x7f9f1014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 -- 172.21.15.121:0/910356602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 msgr2=0x7f9f1014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 -- 172.21.15.121:0/910356602 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0800e700 con 0x7f9f1014ea70 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0f7fe700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0effd700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 0x7f9f1014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f0ffff700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 0x7f9f101428f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800eeb0 tx=0x7f9f08003980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011800 con 0x7f9f1014ea70 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08011960 con 0x7f9f1014ea70 2023-08-18T20:43:25.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011d10 con 0x7f9f1014ea70 2023-08-18T20:43:25.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f000097c0 con 0x7f9f1014ea70 2023-08-18T20:43:25.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040094e0 con 0x7f9f1014ea70 2023-08-18T20:43:25.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9f0801b740 con 0x7f9f1014ea70 2023-08-18T20:43:25.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.177+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f080258f0 con 0x7f9f1014ea70 2023-08-18T20:43:25.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.178+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f10074730 con 0x7f9f1014ea70 2023-08-18T20:43:25.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.181+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9f08020020 con 0x7f9f1014ea70 2023-08-18T20:43:25.232 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:25.232+0000 7efd39285200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-18T20:43:25.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.293+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9f101513c0 con 0x7f9f1014ea70 2023-08-18T20:43:25.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.301+0000 7f9ef7fff700 1 -- 172.21.15.121:0/910356602 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9f0801bbd0 con 0x7f9f1014ea70 2023-08-18T20:43:25.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.302+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 msgr2=0x7f9f101428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.302+0000 7f9f15e01700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 0x7f9f101428f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800eeb0 tx=0x7f9f08003980 comp rx=0 tx=0).stop 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.302+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 shutdown_connections 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f1014ea70 0x7f9f101428f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f100a6200 0x7f9f1014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 --2- 172.21.15.121:0/910356602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f100c3a30 0x7f9f1014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 >> 172.21.15.121:0/910356602 conn(0x7f9f100a8800 msgr2=0x7f9f1006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 shutdown_connections 2023-08-18T20:43:25.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:25.303+0000 7f9f15e01700 1 -- 172.21.15.121:0/910356602 wait complete. 2023-08-18T20:43:25.305 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2023-08-18T20:43:25.308 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:25.308+0000 7efd39285200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-18T20:43:25.316 INFO:tasks.ceph:check_enable_crimson: False 2023-08-18T20:43:25.316 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-18T20:43:25.317 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:25.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-18T20:43:25.347 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:25.347 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-18T20:43:25.395 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:25.394+0000 7efd39285200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-18T20:43:25.417 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:25.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-18T20:43:25.483 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:43:25.484 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-18T20:43:25.494 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:25.494+0000 7efd39285200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-18T20:43:25.519 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:25.520 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-18T20:43:25.546 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:25.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-18T20:43:25.602 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:25.601+0000 7f1dd8d0e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-18T20:43:25.611 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:25.611 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-18T20:43:25.661 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:25.661+0000 7efd39285200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-18T20:43:25.670 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:25.670+0000 7f1dd8d0e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-18T20:43:25.676 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:43:25.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-18T20:43:25.742 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 68cf284e-0eab-40a0-9196-194f72b9b014 0 2023-08-18T20:43:25.751 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:25.750+0000 7f1dd8d0e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-18T20:43:25.835 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:25.834+0000 7f1dd8d0e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-18T20:43:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.871+0000 7fb46c1dd700 1 Processor -- start 2023-08-18T20:43:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.871+0000 7fb46c1dd700 1 -- start start 2023-08-18T20:43:25.877 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46c1dd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.877 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46c1dd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 0x7fb46415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.877 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46c1dd700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640a6080 con 0x7fb46414fba0 2023-08-18T20:43:25.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46c1dd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464155ab0 con 0x7fb4641528d0 2023-08-18T20:43:25.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46c1dd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464155d90 con 0x7fb46406e840 2023-08-18T20:43:25.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469f79700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb46414fba0 0x7fb46406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42504/0 (socket says 172.21.15.122:42504) 2023-08-18T20:43:25.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:36974/0 (socket says 172.21.15.122:36974) 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469f79700 1 -- 172.21.15.122:0/9558022 learned_addr learned my addr 172.21.15.122:0/9558022 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46a77a700 1 --2- 172.21.15.122:0/9558022 >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 0x7fb46415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 -- 172.21.15.122:0/9558022 >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 msgr2=0x7fb46415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 --2- 172.21.15.122:0/9558022 >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 0x7fb46415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 -- 172.21.15.122:0/9558022 >> v1:172.21.15.122:6789/0 conn(0x7fb46414fba0 legacy=0x7fb46406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb468f77700 1 -- 172.21.15.122:0/9558022 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402583267 0 0) 0x7fb4640a6080 con 0x7fb46414fba0 2023-08-18T20:43:25.880 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb469778700 1 -- 172.21.15.122:0/9558022 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464156070 con 0x7fb46406e840 2023-08-18T20:43:25.880 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.872+0000 7fb46a77a700 1 --2- 172.21.15.122:0/9558022 >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 0x7fb46415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:25.880 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb469778700 1 --2- 172.21.15.122:0/9558022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb454009840 tx=0x7fb454009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01c577ee8fb1024 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:25.880 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb468f77700 1 -- 172.21.15.122:0/9558022 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454011830 con 0x7fb46406e840 2023-08-18T20:43:25.880 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb468f77700 1 -- 172.21.15.122:0/9558022 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454011990 con 0x7fb46406e840 2023-08-18T20:43:25.881 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb468f77700 1 -- 172.21.15.122:0/9558022 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454011d20 con 0x7fb46406e840 2023-08-18T20:43:25.881 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 -- 172.21.15.122:0/9558022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 msgr2=0x7fb464152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.881 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/9558022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb454009840 tx=0x7fb454009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:25.881 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 -- 172.21.15.122:0/9558022 shutdown_connections 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/9558022 >> v2:172.21.15.121:3300/0 conn(0x7fb4641528d0 0x7fb46415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/9558022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb46406e840 0x7fb464152390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.873+0000 7fb46c1dd700 1 -- 172.21.15.122:0/9558022 >> 172.21.15.122:0/9558022 conn(0x7fb4640a8800 msgr2=0x7fb4640a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.874+0000 7fb46c1dd700 1 -- 172.21.15.122:0/9558022 shutdown_connections 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.874+0000 7fb46c1dd700 1 -- 172.21.15.122:0/9558022 wait complete. 2023-08-18T20:43:25.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 Processor -- start 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 -- start start 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb46406e840 0x7fb4640bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 0x7fb464072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46414eca0 con 0x7fb46406e840 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640709b0 con 0x7fb46414fba0 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46c1dd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464072940 con 0x7fb4641528d0 2023-08-18T20:43:25.883 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb469778700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb469778700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47126/0 (socket says 172.21.15.122:47126) 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb46a77a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 0x7fb464072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb469778700 1 -- 172.21.15.122:0/1105590315 learned_addr learned my addr 172.21.15.122:0/1105590315 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.875+0000 7fb469f79700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb46406e840 0x7fb4640bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 -- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 msgr2=0x7fb464072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 0x7fb464072400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 -- 172.21.15.122:0/1105590315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb46406e840 msgr2=0x7fb4640bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb46406e840 0x7fb4640bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 -- 172.21.15.122:0/1105590315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540094a0 con 0x7fb46414fba0 2023-08-18T20:43:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb46a77a700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 0x7fb464072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb469778700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4640a92f0 tx=0x7fb454004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:25.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454004400 con 0x7fb46414fba0 2023-08-18T20:43:25.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45401f070 con 0x7fb46414fba0 2023-08-18T20:43:25.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4640a7fc0 con 0x7fb46414fba0 2023-08-18T20:43:25.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540038e0 con 0x7fb46414fba0 2023-08-18T20:43:25.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46414e650 con 0x7fb46414fba0 2023-08-18T20:43:25.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb454021030 con 0x7fb46414fba0 2023-08-18T20:43:25.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.876+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb45401a9a0 con 0x7fb46414fba0 2023-08-18T20:43:25.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.877+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46414ede0 con 0x7fb46414fba0 2023-08-18T20:43:25.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.881+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb46414ede0 con 0x7fb46414fba0 2023-08-18T20:43:25.965 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.965+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "68cf284e-0eab-40a0-9196-194f72b9b014", "id": 0} v 0) v1 -- 0x7fb464074730 con 0x7fb46414fba0 2023-08-18T20:43:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.970+0000 7fb45a7fc700 1 -- 172.21.15.122:0/1105590315 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68cf284e-0eab-40a0-9196-194f72b9b014", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb454015020 con 0x7fb46414fba0 2023-08-18T20:43:25.971 INFO:teuthology.orchestra.run.smithi122.stdout:0 2023-08-18T20:43:25.972 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 msgr2=0x7fb464071ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:25.973 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4640a92f0 tx=0x7fb454004750 comp rx=0 tx=0).stop 2023-08-18T20:43:25.973 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 shutdown_connections 2023-08-18T20:43:25.973 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4641528d0 0x7fb464072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.973 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb46406e840 0x7fb4640bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.973 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 --2- 172.21.15.122:0/1105590315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46414fba0 0x7fb464071ec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 >> 172.21.15.122:0/1105590315 conn(0x7fb4640a8800 msgr2=0x7fb4640a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 shutdown_connections 2023-08-18T20:43:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:25.971+0000 7fb46c1dd700 1 -- 172.21.15.122:0/1105590315 wait complete. 2023-08-18T20:43:25.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc 1 2023-08-18T20:43:25.987 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:25.987+0000 7f1dd8d0e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-18T20:43:26.065 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:26.065+0000 7efd39285200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-18T20:43:26.105 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.104+0000 7fc1d8943700 1 Processor -- start 2023-08-18T20:43:26.105 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.104+0000 7fc1d8943700 1 -- start start 2023-08-18T20:43:26.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.105+0000 7fc1d8943700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1d40c0c50 0x7fc1d406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.105+0000 7fc1d8943700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d406a7e0 0x7fc1d40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d8943700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40c4f40 con 0x7fc1d40a6290 2023-08-18T20:43:26.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d8943700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40c6120 con 0x7fc1d40c0c50 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d8943700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41551f0 con 0x7fc1d406a7e0 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1d40c0c50 0x7fc1d406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d2d9d700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc1d40a6290 0x7fc1d4071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42518/0 (socket says 172.21.15.122:42518) 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d2d9d700 1 -- 172.21.15.122:0/2890193144 learned_addr learned my addr 172.21.15.122:0/2890193144 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d1d9b700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d406a7e0 0x7fc1d40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 -- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d406a7e0 msgr2=0x7fc1d40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d406a7e0 0x7fc1d40c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 -- 172.21.15.122:0/2890193144 >> v1:172.21.15.122:6789/0 conn(0x7fc1d40a6290 legacy=0x7fc1d4071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d159a700 1 -- 172.21.15.122:0/2890193144 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791870329 0 0) 0x7fc1d40c4f40 con 0x7fc1d40a6290 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 -- 172.21.15.122:0/2890193144 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40c63a0 con 0x7fc1d40c0c50 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d259c700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d406a2a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009840 tx=0x7fc1c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8c0ef5cc254894 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d159a700 1 -- 172.21.15.122:0/2890193144 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4011830 con 0x7fc1d40c0c50 2023-08-18T20:43:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d159a700 1 -- 172.21.15.122:0/2890193144 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4011990 con 0x7fc1d40c0c50 2023-08-18T20:43:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.106+0000 7fc1d159a700 1 -- 172.21.15.122:0/2890193144 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4011d20 con 0x7fc1d40c0c50 2023-08-18T20:43:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 -- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 msgr2=0x7fc1d406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d406a2a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009840 tx=0x7fc1c4009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 -- 172.21.15.122:0/2890193144 shutdown_connections 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d406a2a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 --2- 172.21.15.122:0/2890193144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d406a7e0 0x7fc1d40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 -- 172.21.15.122:0/2890193144 >> 172.21.15.122:0/2890193144 conn(0x7fc1d40c6b10 msgr2=0x7fc1d40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 -- 172.21.15.122:0/2890193144 shutdown_connections 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.107+0000 7fc1d8943700 1 -- 172.21.15.122:0/2890193144 wait complete. 2023-08-18T20:43:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.108+0000 7fc1d8943700 1 Processor -- start 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.108+0000 7fc1d8943700 1 -- start start 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1d406a7e0 0x7fc1d40ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d4071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41e96a0 con 0x7fc1d406a7e0 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41e9940 con 0x7fc1d40c0c50 2023-08-18T20:43:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d8943700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41e9c20 con 0x7fc1d40a6290 2023-08-18T20:43:26.115 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d2d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d4071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.115 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.115 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:36992/0 (socket says 172.21.15.122:36992) 2023-08-18T20:43:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d2d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d4071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47140/0 (socket says 172.21.15.122:47140) 2023-08-18T20:43:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 -- 172.21.15.122:0/1574435125 learned_addr learned my addr 172.21.15.122:0/1574435125 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d259c700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1d406a7e0 0x7fc1d40ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 -- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 msgr2=0x7fc1d4071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d4071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 -- 172.21.15.122:0/1574435125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1d406a7e0 msgr2=0x7fc1d40ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.109+0000 7fc1d1d9b700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1d406a7e0 0x7fc1d40ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1d1d9b700 1 -- 172.21.15.122:0/1574435125 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40094a0 con 0x7fc1d40a6290 2023-08-18T20:43:26.119 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1d1d9b700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800e870 tx=0x7fc1c800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.120 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8009590 con 0x7fc1d40a6290 2023-08-18T20:43:26.120 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8013680 con 0x7fc1d40a6290 2023-08-18T20:43:26.120 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d41e9f00 con 0x7fc1d40a6290 2023-08-18T20:43:26.120 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80139f0 con 0x7fc1d40a6290 2023-08-18T20:43:26.121 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d41ea420 con 0x7fc1d40a6290 2023-08-18T20:43:26.121 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc1c8005a20 con 0x7fc1d40a6290 2023-08-18T20:43:26.121 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.110+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc1c801c800 con 0x7fc1d40a6290 2023-08-18T20:43:26.121 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.111+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d4074730 con 0x7fc1d40a6290 2023-08-18T20:43:26.122 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.113+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc1c8021060 con 0x7fc1d40a6290 2023-08-18T20:43:26.189 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:26.188+0000 7efd39285200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-18T20:43:26.204 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.203+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc", "id": 1} v 0) v1 -- 0x7fc1d4151d90 con 0x7fc1d40a6290 2023-08-18T20:43:26.212 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.212+0000 7fc1c2ffd700 1 -- 172.21.15.122:0/1574435125 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc1c8017070 con 0x7fc1d40a6290 2023-08-18T20:43:26.213 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:43:26.214 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 msgr2=0x7fc1d4157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.215 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800e870 tx=0x7fc1c800eb80 comp rx=0 tx=0).stop 2023-08-18T20:43:26.215 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 shutdown_connections 2023-08-18T20:43:26.215 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1d40c0c50 0x7fc1d4071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.216 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1d406a7e0 0x7fc1d40ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.216 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 --2- 172.21.15.122:0/1574435125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1d40a6290 0x7fc1d4157c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.216 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 >> 172.21.15.122:0/1574435125 conn(0x7fc1d40c6b10 msgr2=0x7fc1d406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.216 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 shutdown_connections 2023-08-18T20:43:26.217 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.213+0000 7fc1d8943700 1 -- 172.21.15.122:0/1574435125 wait complete. 2023-08-18T20:43:26.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 973df490-20df-445d-9f34-acbb13cf0efc 2 2023-08-18T20:43:26.280 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:26.279+0000 7efd39285200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-18T20:43:26.367 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:26.367+0000 7efd39285200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-18T20:43:26.385 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.385+0000 7fca15c20700 1 Processor -- start 2023-08-18T20:43:26.386 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.385+0000 7fca15c20700 1 -- start start 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca15c20700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca100c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca15c20700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca10070950 0x7fca100c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca15c20700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100c2260 con 0x7fca1014e950 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca15c20700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100a6630 con 0x7fca10070950 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca15c20700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca10151d90 con 0x7fca1014ed30 2023-08-18T20:43:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca10070950 0x7fca100c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0effd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca100c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0f7fe700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fca1014e950 0x7fca100c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42528/0 (socket says 172.21.15.122:42528) 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0f7fe700 1 -- 172.21.15.122:0/3466544936 learned_addr learned my addr 172.21.15.122:0/3466544936 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0e7fc700 1 -- 172.21.15.122:0/3466544936 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083847168 0 0) 0x7fca100c2260 con 0x7fca1014e950 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 -- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 msgr2=0x7fca100c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca100c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.389 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 -- 172.21.15.122:0/3466544936 >> v1:172.21.15.122:6789/0 conn(0x7fca1014e950 legacy=0x7fca100c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 -- 172.21.15.122:0/3466544936 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10152070 con 0x7fca10070950 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0effd700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca100c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0ffff700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca100c4b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca08009d90 tx=0x7fca0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fda883fe8e57b02 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0e7fc700 1 -- 172.21.15.122:0/3466544936 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800e070 con 0x7fca10070950 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0e7fc700 1 -- 172.21.15.122:0/3466544936 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800bb20 con 0x7fca10070950 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.386+0000 7fca0e7fc700 1 -- 172.21.15.122:0/3466544936 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08012430 con 0x7fca10070950 2023-08-18T20:43:26.390 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 -- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 msgr2=0x7fca100c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca100c4b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca08009d90 tx=0x7fca0800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 -- 172.21.15.122:0/3466544936 shutdown_connections 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca100c4b10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 --2- 172.21.15.122:0/3466544936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca100c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 -- 172.21.15.122:0/3466544936 >> 172.21.15.122:0/3466544936 conn(0x7fca100c6b10 msgr2=0x7fca100c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 -- 172.21.15.122:0/3466544936 shutdown_connections 2023-08-18T20:43:26.391 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.387+0000 7fca15c20700 1 -- 172.21.15.122:0/3466544936 wait complete. 2023-08-18T20:43:26.393 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.389+0000 7fca15c20700 1 Processor -- start 2023-08-18T20:43:26.393 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.389+0000 7fca15c20700 1 -- start start 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca1014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca1014e950 0x7fca101d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101497f0 con 0x7fca1014e950 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014a170 con 0x7fca10070950 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014a450 con 0x7fca1014ed30 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:37006/0 (socket says 172.21.15.122:37006) 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 -- 172.21.15.122:0/483180087 learned_addr learned my addr 172.21.15.122:0/483180087 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0f7fe700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca1014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 -- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 msgr2=0x7fca1014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca1014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 -- 172.21.15.122:0/483180087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca1014e950 msgr2=0x7fca101d96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca1014e950 0x7fca101d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 -- 172.21.15.122:0/483180087 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040094a0 con 0x7fca1014ed30 2023-08-18T20:43:26.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca0ffff700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca100c4690 tx=0x7fca08004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08012430 con 0x7fca1014ed30 2023-08-18T20:43:26.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08020070 con 0x7fca1014ed30 2023-08-18T20:43:26.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca08009a70 con 0x7fca1014ed30 2023-08-18T20:43:26.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08004280 con 0x7fca1014ed30 2023-08-18T20:43:26.397 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.390+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1014aa10 con 0x7fca1014ed30 2023-08-18T20:43:26.397 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.391+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca080046e0 con 0x7fca1014ed30 2023-08-18T20:43:26.397 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.391+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fca08022070 con 0x7fca1014ed30 2023-08-18T20:43:26.397 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.391+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca100c1b20 con 0x7fca1014ed30 2023-08-18T20:43:26.398 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.393+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fca08027da0 con 0x7fca1014ed30 2023-08-18T20:43:26.411 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:26.410+0000 7f1dd8d0e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-18T20:43:26.477 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.476+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd new", "uuid": "973df490-20df-445d-9f34-acbb13cf0efc", "id": 2} v 0) v1 -- 0x7fca10074730 con 0x7fca1014ed30 2023-08-18T20:43:26.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.484+0000 7fc9f7fff700 1 -- 172.21.15.122:0/483180087 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "973df490-20df-445d-9f34-acbb13cf0efc", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca08027480 con 0x7fca1014ed30 2023-08-18T20:43:26.485 INFO:teuthology.orchestra.run.smithi122.stdout:2 2023-08-18T20:43:26.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 msgr2=0x7fca101450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca100c4690 tx=0x7fca08004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 shutdown_connections 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca1014ed30 0x7fca101450c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca10070950 0x7fca1014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 --2- 172.21.15.122:0/483180087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca1014e950 0x7fca101d96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.485+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 >> 172.21.15.122:0/483180087 conn(0x7fca100c6b10 msgr2=0x7fca100c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.486+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 shutdown_connections 2023-08-18T20:43:26.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.486+0000 7fca15c20700 1 -- 172.21.15.122:0/483180087 wait complete. 2023-08-18T20:43:26.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new eadba227-ddaf-40d9-992c-6d0802e5f8bb 3 2023-08-18T20:43:26.535 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:26.535+0000 7f1dd8d0e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-18T20:43:26.623 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.622+0000 7f8e3275a700 1 Processor -- start 2023-08-18T20:43:26.623 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.622+0000 7f8e3275a700 1 -- start start 2023-08-18T20:43:26.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 0x7f8e2c072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8e2c152d30 0x7f8e2c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8e2c14fa00 0x7f8e2c155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c066380 con 0x7f8e2c14fa00 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c1531b0 con 0x7f8e2c152d30 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e3275a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c066080 con 0x7f8e2c06b520 2023-08-18T20:43:26.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8e2c152d30 0x7f8e2c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 0x7f8e2c072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8e2c152d30 0x7f8e2c14f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47158/0 (socket says 172.21.15.122:47158) 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 -- 172.21.15.122:0/110082302 learned_addr learned my addr 172.21.15.122:0/110082302 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e30cf7700 1 --2- 172.21.15.122:0/110082302 >> v2:172.21.15.121:3300/0 conn(0x7f8e2c14fa00 0x7f8e2c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 -- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 msgr2=0x7f8e2c072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:26.627 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 0x7f8e2c072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 -- 172.21.15.122:0/110082302 >> v2:172.21.15.121:3300/0 conn(0x7f8e2c14fa00 msgr2=0x7f8e2c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 --2- 172.21.15.122:0/110082302 >> v2:172.21.15.121:3300/0 conn(0x7f8e2c14fa00 0x7f8e2c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2b7fe700 1 -- 172.21.15.122:0/110082302 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c06d0f0 con 0x7f8e2c152d30 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.623+0000 7f8e2bfff700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 0x7f8e2c072360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e2b7fe700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14f4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ac450 tx=0x7f8e20009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c65cd8b4ddb412 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e2affd700 1 -- 172.21.15.122:0/110082302 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20005e30 con 0x7f8e2c152d30 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e2affd700 1 -- 172.21.15.122:0/110082302 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20004030 con 0x7f8e2c152d30 2023-08-18T20:43:26.628 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e2affd700 1 -- 172.21.15.122:0/110082302 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200043e0 con 0x7f8e2c152d30 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 -- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c152d30 msgr2=0x7f8e2c14f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14f4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ac450 tx=0x7f8e20009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 -- 172.21.15.122:0/110082302 shutdown_connections 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 --2- 172.21.15.122:0/110082302 >> v2:172.21.15.121:3300/0 conn(0x7f8e2c14fa00 0x7f8e2c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c06b520 0x7f8e2c072360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 --2- 172.21.15.122:0/110082302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14f4c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.629 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 -- 172.21.15.122:0/110082302 >> 172.21.15.122:0/110082302 conn(0x7f8e2c0c2ca0 msgr2=0x7f8e2c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.630 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 -- 172.21.15.122:0/110082302 shutdown_connections 2023-08-18T20:43:26.630 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.624+0000 7f8e3275a700 1 -- 172.21.15.122:0/110082302 wait complete. 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.626+0000 7f8e3275a700 1 Processor -- start 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.626+0000 7f8e3275a700 1 -- start start 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 0x7f8e2c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.632 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c14bc80 con 0x7f8e2c152d30 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c150f60 con 0x7f8e2c06b520 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e3275a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c150390 con 0x7f8e2c14fa00 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47160/0 (socket says 172.21.15.122:47160) 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 -- 172.21.15.122:0/1534651371 learned_addr learned my addr 172.21.15.122:0/1534651371 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 0x7f8e2c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e30cf7700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.633 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 -- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 msgr2=0x7f8e2c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 0x7f8e2c1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 -- 172.21.15.122:0/1534651371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e2c152d30 msgr2=0x7f8e2c14da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 -- 172.21.15.122:0/1534651371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0094a0 con 0x7f8e2c06b520 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2b7fe700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 0x7f8e2c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e2bfff700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ebe0 tx=0x7f8e1c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.634 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.627+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c009760 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c00c850 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20009500 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00cbe0 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c151980 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e1c005a20 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8e1c0067a0 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.628+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c074730 con 0x7f8e2c06b520 2023-08-18T20:43:26.635 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.631+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8e1c021060 con 0x7f8e2c06b520 2023-08-18T20:43:26.636 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:26.634+0000 7f1dd8d0e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-18T20:43:26.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.714+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eadba227-ddaf-40d9-992c-6d0802e5f8bb", "id": 3} v 0) v1 -- 0x7f8e2c14dfb0 con 0x7f8e2c06b520 2023-08-18T20:43:26.718 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:26.718+0000 7f1dd8d0e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-18T20:43:26.720 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.720+0000 7f8e28ff9700 1 -- 172.21.15.122:0/1534651371 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eadba227-ddaf-40d9-992c-6d0802e5f8bb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e1c017070 con 0x7f8e2c06b520 2023-08-18T20:43:26.720 INFO:teuthology.orchestra.run.smithi122.stdout:3 2023-08-18T20:43:26.721 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 msgr2=0x7f8e2c1e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.721 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ebe0 tx=0x7f8e1c00eef0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.721 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 shutdown_connections 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e2c152d30 0x7f8e2c14da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e2c06b520 0x7f8e2c1e6f10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 --2- 172.21.15.122:0/1534651371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2c14fa00 0x7f8e2c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 >> 172.21.15.122:0/1534651371 conn(0x7f8e2c0c2ca0 msgr2=0x7f8e2c0aa100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 shutdown_connections 2023-08-18T20:43:26.722 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.721+0000 7f8e3275a700 1 -- 172.21.15.122:0/1534651371 wait complete. 2023-08-18T20:43:26.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 212a15bb-faa9-470a-8e9f-e4a62d5029c0 4 2023-08-18T20:43:26.835 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:26.834+0000 7efd39285200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-18T20:43:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.894+0000 7fbacae34700 1 Processor -- start 2023-08-18T20:43:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.894+0000 7fbacae34700 1 -- start start 2023-08-18T20:43:26.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbacae34700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbac406fd30 0x7fbac40c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbacae34700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbacae34700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac41529a0 con 0x7fbac41559c0 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbacae34700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac4152c80 con 0x7fbac406fd30 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbacae34700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4152f60 con 0x7fbac4152450 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbac406fd30 0x7fbac40c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac3fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac93d1700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fbac41559c0 0x7fbac414f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42556/0 (socket says 172.21.15.122:42556) 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac93d1700 1 -- 172.21.15.122:0/229372288 learned_addr learned my addr 172.21.15.122:0/229372288 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 -- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 msgr2=0x7fbac40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 -- 172.21.15.122:0/229372288 >> v1:172.21.15.122:6789/0 conn(0x7fbac41559c0 legacy=0x7fbac414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 -- 172.21.15.122:0/229372288 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4153240 con 0x7fbac406fd30 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac37fe700 1 -- 172.21.15.122:0/229372288 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082346969 0 0) 0x7fbac41529a0 con 0x7fbac41559c0 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac3fff700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac8bd0700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40c6d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009840 tx=0x7fbab8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941509fa123233b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.895+0000 7fbac37fe700 1 -- 172.21.15.122:0/229372288 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011830 con 0x7fbac406fd30 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbac37fe700 1 -- 172.21.15.122:0/229372288 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8011990 con 0x7fbac406fd30 2023-08-18T20:43:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbac37fe700 1 -- 172.21.15.122:0/229372288 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011d20 con 0x7fbac406fd30 2023-08-18T20:43:26.900 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 -- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 msgr2=0x7fbac40c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.900 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40c6d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009840 tx=0x7fbab8009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:26.900 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 -- 172.21.15.122:0/229372288 shutdown_connections 2023-08-18T20:43:26.900 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40c6d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.901 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 --2- 172.21.15.122:0/229372288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.901 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 -- 172.21.15.122:0/229372288 >> 172.21.15.122:0/229372288 conn(0x7fbac40c7bf0 msgr2=0x7fbac40c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.901 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 -- 172.21.15.122:0/229372288 shutdown_connections 2023-08-18T20:43:26.901 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.896+0000 7fbacae34700 1 -- 172.21.15.122:0/229372288 wait complete. 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.897+0000 7fbacae34700 1 Processor -- start 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.897+0000 7fbacae34700 1 -- start start 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac4152450 0x7fbac40aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 0x7fbac41ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:26.903 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40a8370 con 0x7fbac4152450 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40a7d50 con 0x7fbac406fd30 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbacae34700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41eb5a0 con 0x7fbac41559c0 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac93d1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 0x7fbac41ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac8bd0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac8bd0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47172/0 (socket says 172.21.15.122:47172) 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac93d1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 0x7fbac41ead60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:37030/0 (socket says 172.21.15.122:37030) 2023-08-18T20:43:26.904 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac8bd0700 1 -- 172.21.15.122:0/3862948022 learned_addr learned my addr 172.21.15.122:0/3862948022 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.898+0000 7fbac3fff700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac4152450 0x7fbac40aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 -- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 msgr2=0x7fbac41ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 0x7fbac41ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 -- 172.21.15.122:0/3862948022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac4152450 msgr2=0x7fbac40aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac4152450 0x7fbac40aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 -- 172.21.15.122:0/3862948022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00094a0 con 0x7fbac406fd30 2023-08-18T20:43:26.905 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac8bd0700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab80036a0 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab801f070 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab80094a0 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8003a60 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40a8000 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbab8026480 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.899+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbab8021070 con 0x7fbac406fd30 2023-08-18T20:43:26.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.900+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40ad2b0 con 0x7fbac406fd30 2023-08-18T20:43:26.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.902+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbab8015020 con 0x7fbac406fd30 2023-08-18T20:43:26.985 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.985+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "212a15bb-faa9-470a-8e9f-e4a62d5029c0", "id": 4} v 0) v1 -- 0x7fbac4074730 con 0x7fbac406fd30 2023-08-18T20:43:26.991 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.990+0000 7fbac17fa700 1 -- 172.21.15.122:0/3862948022 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "212a15bb-faa9-470a-8e9f-e4a62d5029c0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbab8026940 con 0x7fbac406fd30 2023-08-18T20:43:26.991 INFO:teuthology.orchestra.run.smithi122.stdout:4 2023-08-18T20:43:26.992 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 msgr2=0x7fbac40ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:26.992 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab8004750 comp rx=0 tx=0).stop 2023-08-18T20:43:26.992 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 shutdown_connections 2023-08-18T20:43:26.992 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac41559c0 0x7fbac41ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.992 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac406fd30 0x7fbac40ad460 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.993 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 --2- 172.21.15.122:0/3862948022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac4152450 0x7fbac40aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:26.993 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 >> 172.21.15.122:0/3862948022 conn(0x7fbac40c7bf0 msgr2=0x7fbac4154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:26.993 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 shutdown_connections 2023-08-18T20:43:26.993 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:26.991+0000 7fbacae34700 1 -- 172.21.15.122:0/3862948022 wait complete. 2023-08-18T20:43:27.003 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef 5 2023-08-18T20:43:27.126 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 Processor -- start 2023-08-18T20:43:27.126 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 -- start start 2023-08-18T20:43:27.128 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f747006fd30 0x7f74700c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f74701559c0 0x7f74700c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74701529a0 con 0x7f7470152450 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7470152c80 con 0x7f74701559c0 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f7475fe9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7470152f60 con 0x7f747006fd30 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f746f7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f747006fd30 0x7f74700c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.129 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f746effd700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7470152450 0x7f747014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42564/0 (socket says 172.21.15.122:42564) 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.126+0000 7f746effd700 1 -- 172.21.15.122:0/2229708955 learned_addr learned my addr 172.21.15.122:0/2229708955 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746ffff700 1 --2- 172.21.15.122:0/2229708955 >> v2:172.21.15.121:3300/0 conn(0x7f74701559c0 0x7f74700c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746e7fc700 1 -- 172.21.15.122:0/2229708955 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518309839 0 0) 0x7f74701529a0 con 0x7f7470152450 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746e7fc700 1 -- 172.21.15.122:0/2229708955 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74580035b0 con 0x7f7470152450 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746f7fe700 1 -- 172.21.15.122:0/2229708955 >> v2:172.21.15.121:3300/0 conn(0x7f74701559c0 msgr2=0x7f74700c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746f7fe700 1 --2- 172.21.15.122:0/2229708955 >> v2:172.21.15.121:3300/0 conn(0x7f74701559c0 0x7f74700c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.130 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746f7fe700 1 -- 172.21.15.122:0/2229708955 >> v1:172.21.15.122:6789/0 conn(0x7f7470152450 legacy=0x7f747014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746f7fe700 1 -- 172.21.15.122:0/2229708955 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470153240 con 0x7f747006fd30 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746f7fe700 1 --2- 172.21.15.122:0/2229708955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f747006fd30 0x7f74700c6d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f747006eec0 tx=0x7f7460009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff7cb08ca8a244c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746e7fc700 1 -- 172.21.15.122:0/2229708955 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011830 con 0x7f747006fd30 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746e7fc700 1 -- 172.21.15.122:0/2229708955 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460011990 con 0x7f747006fd30 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.127+0000 7f746e7fc700 1 -- 172.21.15.122:0/2229708955 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011d20 con 0x7f747006fd30 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 -- 172.21.15.122:0/2229708955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f747006fd30 msgr2=0x7f74700c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2229708955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f747006fd30 0x7f74700c6d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f747006eec0 tx=0x7f7460009b20 comp rx=0 tx=0).stop 2023-08-18T20:43:27.131 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 -- 172.21.15.122:0/2229708955 shutdown_connections 2023-08-18T20:43:27.132 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2229708955 >> v2:172.21.15.121:3300/0 conn(0x7f74701559c0 0x7f74700c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.132 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2229708955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f747006fd30 0x7f74700c6d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.132 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 -- 172.21.15.122:0/2229708955 >> 172.21.15.122:0/2229708955 conn(0x7f74700c7bf0 msgr2=0x7f74700c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.132 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 -- 172.21.15.122:0/2229708955 shutdown_connections 2023-08-18T20:43:27.132 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.128+0000 7f7475fe9700 1 -- 172.21.15.122:0/2229708955 wait complete. 2023-08-18T20:43:27.134 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.129+0000 7f7475fe9700 1 Processor -- start 2023-08-18T20:43:27.134 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.129+0000 7f7475fe9700 1 -- start start 2023-08-18T20:43:27.134 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747006fd30 0x7f74700a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 0x7f74701e9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74701ea5c0 con 0x7f747006fd30 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700bee60 con 0x7f74701559c0 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f7475fe9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74701ea2e0 con 0x7f7470152450 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.135 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47188/0 (socket says 172.21.15.122:47188) 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 -- 172.21.15.122:0/2313075848 learned_addr learned my addr 172.21.15.122:0/2313075848 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746effd700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 0x7f74701e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746f7fe700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747006fd30 0x7f74700a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 -- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 msgr2=0x7f74701e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 0x7f74701e9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 -- 172.21.15.122:0/2313075848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747006fd30 msgr2=0x7f74700a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747006fd30 0x7f74700a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.136 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 -- 172.21.15.122:0/2313075848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600094a0 con 0x7f74701559c0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746effd700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 0x7f74701e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.130+0000 7f746ffff700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f746800efc0 tx=0x7f746800c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.131+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800cad0 con 0x7f74701559c0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.131+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746800f040 con 0x7f74701559c0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.131+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74700bf100 con 0x7f74701559c0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.131+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800ce70 con 0x7f74701559c0 2023-08-18T20:43:27.137 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.131+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74700a6950 con 0x7f74701559c0 2023-08-18T20:43:27.138 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.132+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7468014780 con 0x7f74701559c0 2023-08-18T20:43:27.138 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.132+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f746801de30 con 0x7f74701559c0 2023-08-18T20:43:27.138 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.132+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74700becc0 con 0x7f74701559c0 2023-08-18T20:43:27.138 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.134+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f746803bb00 con 0x7f74701559c0 2023-08-18T20:43:27.205 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:27.205+0000 7f1dd8d0e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-18T20:43:27.229 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.228+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef", "id": 5} v 0) v1 -- 0x7f74700bf340 con 0x7f74701559c0 2023-08-18T20:43:27.257 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.257+0000 7f7457fff700 1 -- 172.21.15.122:0/2313075848 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f746802a030 con 0x7f74701559c0 2023-08-18T20:43:27.258 INFO:teuthology.orchestra.run.smithi122.stdout:5 2023-08-18T20:43:27.258 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 msgr2=0x7f74701e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f746800efc0 tx=0x7f746800c0c0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 shutdown_connections 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74701559c0 0x7f74701e9ac0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747006fd30 0x7f74700a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 --2- 172.21.15.122:0/2313075848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7470152450 0x7f74701e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 >> 172.21.15.122:0/2313075848 conn(0x7f74700c7bf0 msgr2=0x7f7470154520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 shutdown_connections 2023-08-18T20:43:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.258+0000 7f7475fe9700 1 -- 172.21.15.122:0/2313075848 wait complete. 2023-08-18T20:43:27.271 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 5a5b13ad-b2f8-4499-85dc-070cd36fb752 6 2023-08-18T20:43:27.392 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 Processor -- start 2023-08-18T20:43:27.392 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 -- start start 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54700a6290 0x7f54700c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700c4f40 con 0x7f54700c1b10 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700c6120 con 0x7f54700c0c50 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.392+0000 7f54756b5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54701551f0 con 0x7f54700a6290 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546effd700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f54700c0c50 0x7f547006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42576/0 (socket says 172.21.15.122:42576) 2023-08-18T20:43:27.394 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546effd700 1 -- 172.21.15.122:0/2874220444 learned_addr learned my addr 172.21.15.122:0/2874220444 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546e7fc700 1 --2- 172.21.15.122:0/2874220444 >> v2:172.21.15.121:3300/0 conn(0x7f54700a6290 0x7f54700c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114450879 0 0) 0x7f54700c6120 con 0x7f54700c0c50 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54580035b0 con 0x7f54700c0c50 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546e7fc700 1 -- 172.21.15.122:0/2874220444 >> v1:172.21.15.122:6789/0 conn(0x7f54700c0c50 legacy=0x7f547006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546e7fc700 1 -- 172.21.15.122:0/2874220444 >> v1:172.21.15.121:6789/0 conn(0x7f54700c1b10 legacy=0x7f5470071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315840992 0 0) 0x7f54700c4f40 con 0x7f54700c1b10 2023-08-18T20:43:27.395 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546e7fc700 1 -- 172.21.15.122:0/2874220444 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700c63a0 con 0x7f54700a6290 2023-08-18T20:43:27.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546e7fc700 1 --2- 172.21.15.122:0/2874220444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a6290 0x7f54700c53d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5464009840 tx=0x7f5464009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5909757393d76fd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464011830 con 0x7f54700a6290 2023-08-18T20:43:27.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5464011990 con 0x7f54700a6290 2023-08-18T20:43:27.396 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.393+0000 7f546dffb700 1 -- 172.21.15.122:0/2874220444 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464011d20 con 0x7f54700a6290 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 -- 172.21.15.122:0/2874220444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a6290 msgr2=0x7f54700c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 --2- 172.21.15.122:0/2874220444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a6290 0x7f54700c53d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5464009840 tx=0x7f5464009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 -- 172.21.15.122:0/2874220444 shutdown_connections 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 --2- 172.21.15.122:0/2874220444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a6290 0x7f54700c53d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 -- 172.21.15.122:0/2874220444 >> 172.21.15.122:0/2874220444 conn(0x7f54700c6b10 msgr2=0x7f54700c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.399 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 -- 172.21.15.122:0/2874220444 shutdown_connections 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.394+0000 7f54756b5700 1 -- 172.21.15.122:0/2874220444 wait complete. 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.395+0000 7f54756b5700 1 Processor -- start 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.395+0000 7f54756b5700 1 -- start start 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54700a6290 0x7f54700ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700c0c50 0x7f54701563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.400 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470156910 con 0x7f54700c0c50 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700aabf0 con 0x7f54700c1b10 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f54756b5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54701e9fc0 con 0x7f54700a6290 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546effd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54700a6290 0x7f54700ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47200/0 (socket says 172.21.15.122:47200) 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 -- 172.21.15.122:0/1247489556 learned_addr learned my addr 172.21.15.122:0/1247489556 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546e7fc700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700c0c50 0x7f54701563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.401 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 -- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54700a6290 msgr2=0x7f54700ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54700a6290 0x7f54700ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 -- 172.21.15.122:0/1247489556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700c0c50 msgr2=0x7f54701563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700c0c50 0x7f54701563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.396+0000 7f546f7fe700 1 -- 172.21.15.122:0/1247489556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640094a0 con 0x7f54700c1b10 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f546f7fe700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f546800c7a0 tx=0x7f546800cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468003e30 con 0x7f54700c1b10 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5468005070 con 0x7f54700c1b10 2023-08-18T20:43:27.402 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468005420 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54700aae90 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54701ea2a0 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f546801c440 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.397+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f54680129f0 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.398+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5470074730 con 0x7f54700c1b10 2023-08-18T20:43:27.403 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.400+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5468017070 con 0x7f54700c1b10 2023-08-18T20:43:27.484 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.483+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a5b13ad-b2f8-4499-85dc-070cd36fb752", "id": 6} v 0) v1 -- 0x7f54700c4a10 con 0x7f54700c1b10 2023-08-18T20:43:27.490 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:27.490+0000 7efd39285200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-18T20:43:27.494 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.493+0000 7f54577fe700 1 -- 172.21.15.122:0/1247489556 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a5b13ad-b2f8-4499-85dc-070cd36fb752", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5468012400 con 0x7f54700c1b10 2023-08-18T20:43:27.494 INFO:teuthology.orchestra.run.smithi122.stdout:6 2023-08-18T20:43:27.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 msgr2=0x7f54700ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f546800c7a0 tx=0x7f546800cab0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 shutdown_connections 2023-08-18T20:43:27.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54700c1b10 0x7f54700ab690 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54700a6290 0x7f54700ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 --2- 172.21.15.122:0/1247489556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700c0c50 0x7f54701563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 >> 172.21.15.122:0/1247489556 conn(0x7f54700c6b10 msgr2=0x7f54700713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 shutdown_connections 2023-08-18T20:43:27.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.494+0000 7f54756b5700 1 -- 172.21.15.122:0/1247489556 wait complete. 2023-08-18T20:43:27.507 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 872749f0-a678-4b59-b4a7-766fc52aceae 7 2023-08-18T20:43:27.561 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:27.560+0000 7efd39285200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-18T20:43:27.650 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.650+0000 7f80dccea700 1 Processor -- start 2023-08-18T20:43:27.651 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.650+0000 7f80dccea700 1 -- start start 2023-08-18T20:43:27.652 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80dccea700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.652 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80dccea700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f80d8152250 0x7f80d806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.652 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80dccea700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d8155970 con 0x7f80d806a7e0 2023-08-18T20:43:27.652 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80dccea700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d814ff70 con 0x7f80d8152250 2023-08-18T20:43:27.653 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80dccea700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d806e830 con 0x7f80d814fb90 2023-08-18T20:43:27.653 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80d5d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f80d8152250 0x7f80d806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.653 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80d5d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f80d8152250 0x7f80d806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47202/0 (socket says 172.21.15.122:47202) 2023-08-18T20:43:27.653 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80d5d9b700 1 -- 172.21.15.122:0/634627283 learned_addr learned my addr 172.21.15.122:0/634627283 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:27.653 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.651+0000 7f80d659c700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.654 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d5d9b700 1 -- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 msgr2=0x7f80d80c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d5d9b700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d80c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d5d9b700 1 -- 172.21.15.122:0/634627283 >> v1:172.21.15.122:6789/0 conn(0x7f80d806a7e0 legacy=0x7f80d8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d559a700 1 -- 172.21.15.122:0/634627283 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340437187 0 0) 0x7f80d8155970 con 0x7f80d806a7e0 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d5d9b700 1 -- 172.21.15.122:0/634627283 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d806df90 con 0x7f80d8152250 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d659c700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d80c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d5d9b700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d8152250 0x7f80d806a2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80c80098f0 tx=0x7f80c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31c114b42f9b94d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.655 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d559a700 1 -- 172.21.15.122:0/634627283 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8011830 con 0x7f80d8152250 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.652+0000 7f80d559a700 1 -- 172.21.15.122:0/634627283 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8011990 con 0x7f80d8152250 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80d559a700 1 -- 172.21.15.122:0/634627283 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8011d20 con 0x7f80d8152250 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 -- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d8152250 msgr2=0x7f80d806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d8152250 0x7f80d806a2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80c80098f0 tx=0x7f80c8009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 -- 172.21.15.122:0/634627283 shutdown_connections 2023-08-18T20:43:27.656 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d80c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.657 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 --2- 172.21.15.122:0/634627283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d8152250 0x7f80d806a2a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.657 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 -- 172.21.15.122:0/634627283 >> 172.21.15.122:0/634627283 conn(0x7f80d80c6b10 msgr2=0x7f80d80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.657 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 -- 172.21.15.122:0/634627283 shutdown_connections 2023-08-18T20:43:27.657 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.653+0000 7f80dccea700 1 -- 172.21.15.122:0/634627283 wait complete. 2023-08-18T20:43:27.657 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.655+0000 7f80dccea700 1 Processor -- start 2023-08-18T20:43:27.658 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.656+0000 7f80dccea700 1 -- start start 2023-08-18T20:43:27.659 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 0x7f80d8149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.659 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.659 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80d659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 0x7f80d8149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.660 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80d659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 0x7f80d8149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47208/0 (socket says 172.21.15.122:47208) 2023-08-18T20:43:27.660 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80d8152250 0x7f80d8148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.660 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8072500 con 0x7f80d8152250 2023-08-18T20:43:27.660 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d814d510 con 0x7f80d806a7e0 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80dccea700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d814a980 con 0x7f80d814fb90 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.658+0000 7f80d5d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:37064/0 (socket says 172.21.15.122:37064) 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 -- 172.21.15.122:0/2290289225 learned_addr learned my addr 172.21.15.122:0/2290289225 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d6d9d700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80d8152250 0x7f80d8148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 -- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 msgr2=0x7f80d8149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 0x7f80d8149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.661 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 -- 172.21.15.122:0/2290289225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80d8152250 msgr2=0x7f80d8148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.662 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80d8152250 0x7f80d8148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.662 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 -- 172.21.15.122:0/2290289225 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0094a0 con 0x7f80d814fb90 2023-08-18T20:43:27.662 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80d5d9b700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80c8013000 tx=0x7f80c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.662 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80036a0 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c801f070 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8003a40 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.659+0000 7f80dccea700 1 -- 172.21.15.122:0/2290289225 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c8009550 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.660+0000 7f80dccea700 1 -- 172.21.15.122:0/2290289225 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80709f0 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.660+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80c8021030 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.660+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f80c801a450 con 0x7f80d814fb90 2023-08-18T20:43:27.663 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.661+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b00052f0 con 0x7f80d814fb90 2023-08-18T20:43:27.665 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.664+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f80c8015020 con 0x7f80d814fb90 2023-08-18T20:43:27.757 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.756+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd new", "uuid": "872749f0-a678-4b59-b4a7-766fc52aceae", "id": 7} v 0) v1 -- 0x7f80b0005640 con 0x7f80d814fb90 2023-08-18T20:43:27.764 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.764+0000 7f80c6ffd700 1 -- 172.21.15.122:0/2290289225 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "872749f0-a678-4b59-b4a7-766fc52aceae", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80c801a730 con 0x7f80d814fb90 2023-08-18T20:43:27.765 INFO:teuthology.orchestra.run.smithi122.stdout:7 2023-08-18T20:43:27.766 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 msgr2=0x7f80d8147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.766 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80c8013000 tx=0x7f80c8004750 comp rx=0 tx=0).stop 2023-08-18T20:43:27.766 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 shutdown_connections 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80d8152250 0x7f80d8148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80d806a7e0 0x7f80d8149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 --2- 172.21.15.122:0/2290289225 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80d814fb90 0x7f80d8147fd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 >> 172.21.15.122:0/2290289225 conn(0x7f80d80c6b10 msgr2=0x7f80d8155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 shutdown_connections 2023-08-18T20:43:27.767 INFO:teuthology.orchestra.run.smithi122.stderr:2023-08-18T20:43:27.765+0000 7f80c4ff9700 1 -- 172.21.15.122:0/2290289225 wait complete. 2023-08-18T20:43:27.777 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-18T20:43:27.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-18T20:43:27.779 INFO:tasks.ceph.osd.0:Started 2023-08-18T20:43:27.780 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-18T20:43:27.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-18T20:43:27.782 INFO:tasks.ceph.osd.1:Started 2023-08-18T20:43:27.782 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-18T20:43:27.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-18T20:43:27.784 INFO:tasks.ceph.osd.2:Started 2023-08-18T20:43:27.785 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-18T20:43:27.785 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-18T20:43:27.787 INFO:tasks.ceph.osd.3:Started 2023-08-18T20:43:27.787 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-18T20:43:27.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-18T20:43:27.789 INFO:tasks.ceph.osd.4:Started 2023-08-18T20:43:27.790 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-18T20:43:27.790 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-18T20:43:27.792 INFO:tasks.ceph.osd.5:Started 2023-08-18T20:43:27.792 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-18T20:43:27.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-18T20:43:27.794 INFO:tasks.ceph.osd.6:Started 2023-08-18T20:43:27.795 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-18T20:43:27.795 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-18T20:43:27.797 INFO:tasks.ceph.osd.7:Started 2023-08-18T20:43:27.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:27.908 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:27.907+0000 7f1dd8d0e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-18T20:43:27.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.959+0000 7f3a8a1cc700 1 Processor -- start 2023-08-18T20:43:27.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.959+0000 7f3a8a1cc700 1 -- start start 2023-08-18T20:43:27.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a8a1cc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3a8414ed30 0x7f3a840c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a8a1cc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a840c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a8a1cc700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840c2260 con 0x7f3a8414e950 2023-08-18T20:43:27.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a8a1cc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840a6630 con 0x7f3a8414ed30 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a8a1cc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84151d90 con 0x7f3a84070950 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3a8414ed30 0x7f3a840c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3a8414ed30 0x7f3a840c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39386/0 (socket says 172.21.15.121:39386) 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a837fe700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3a8414e950 0x7f3a840c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55088/0 (socket says 172.21.15.121:55088) 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 -- 172.21.15.121:0/550531340 learned_addr learned my addr 172.21.15.121:0/550531340 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a83fff700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a840c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 -- 172.21.15.121:0/550531340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 msgr2=0x7f3a840c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a840c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 -- 172.21.15.121:0/550531340 >> v1:172.21.15.122:6789/0 conn(0x7f3a8414e950 legacy=0x7f3a840c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a827fc700 1 -- 172.21.15.121:0/550531340 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471271469 0 0) 0x7f3a840c2260 con 0x7f3a8414e950 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 -- 172.21.15.121:0/550531340 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84152070 con 0x7f3a8414ed30 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.960+0000 7f3a82ffd700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a840c2ed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a780098f0 tx=0x7f3a78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8c4ca895cc7a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a827fc700 1 -- 172.21.15.121:0/550531340 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78011830 con 0x7f3a8414ed30 2023-08-18T20:43:27.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a827fc700 1 -- 172.21.15.121:0/550531340 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78011990 con 0x7f3a8414ed30 2023-08-18T20:43:27.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a827fc700 1 -- 172.21.15.121:0/550531340 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78011d20 con 0x7f3a8414ed30 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/550531340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 msgr2=0x7f3a840c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a840c2ed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a780098f0 tx=0x7f3a78009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/550531340 shutdown_connections 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a840c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/550531340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a840c2ed0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/550531340 >> 172.21.15.121:0/550531340 conn(0x7f3a840c6b10 msgr2=0x7f3a840c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/550531340 shutdown_connections 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.961+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/550531340 wait complete. 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.962+0000 7f3a8a1cc700 1 Processor -- start 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 -- start start 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a8414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8414e950 0x7f3a840c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:27.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8414a5c0 con 0x7f3a8414ed30 2023-08-18T20:43:27.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8414b5d0 con 0x7f3a8414e950 2023-08-18T20:43:27.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a8a1cc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8414b8b0 con 0x7f3a84070950 2023-08-18T20:43:27.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a83fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a83fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39394/0 (socket says 172.21.15.121:39394) 2023-08-18T20:43:27.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a83fff700 1 -- 172.21.15.121:0/2207511709 learned_addr learned my addr 172.21.15.121:0/2207511709 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:27.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a82ffd700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8414e950 0x7f3a840c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.963+0000 7f3a837fe700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a8414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 -- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 msgr2=0x7f3a8414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a8414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 -- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8414e950 msgr2=0x7f3a840c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8414e950 0x7f3a840c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 -- 172.21.15.121:0/2207511709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78009550 con 0x7f3a8414ed30 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a83fff700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00efc0 tx=0x7f3a7c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:27.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00cad0 con 0x7f3a8414ed30 2023-08-18T20:43:27.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00f040 con 0x7f3a8414ed30 2023-08-18T20:43:27.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8414a7f0 con 0x7f3a8414ed30 2023-08-18T20:43:27.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00ce70 con 0x7f3a8414ed30 2023-08-18T20:43:27.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a840c3d10 con 0x7f3a8414ed30 2023-08-18T20:43:27.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a7c014780 con 0x7f3a8414ed30 2023-08-18T20:43:27.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.964+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3a7c0133e0 con 0x7f3a8414ed30 2023-08-18T20:43:27.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.965+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8414ad10 con 0x7f3a8414ed30 2023-08-18T20:43:27.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:27.968+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3a7c03bb00 con 0x7f3a8414ed30 2023-08-18T20:43:27.978 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:27.977+0000 7f1dd8d0e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-18T20:43:28.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.045+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a84074730 con 0x7f3a8414ed30 2023-08-18T20:43:28.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.046+0000 7f3a6bfff700 1 -- 172.21.15.121:0/2207511709 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3a7c02a020 con 0x7f3a8414ed30 2023-08-18T20:43:28.047 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:28.047 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":10,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:27.759189+0000","last_up_change":"0.000000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.046+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 msgr2=0x7f3a841ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.046+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00efc0 tx=0x7f3a7c00c0c0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 shutdown_connections 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a8414ed30 0x7f3a841ea630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a84070950 0x7f3a8414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 --2- 172.21.15.121:0/2207511709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8414e950 0x7f3a840c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 >> 172.21.15.121:0/2207511709 conn(0x7f3a840c6b10 msgr2=0x7f3a840c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:28.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 shutdown_connections 2023-08-18T20:43:28.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:28.047+0000 7f3a8a1cc700 1 -- 172.21.15.121:0/2207511709 wait complete. 2023-08-18T20:43:28.059 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-18T20:43:28.060 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-18T20:43:28.156 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-08-18T20:43:28.155+0000 7f316b8e2640 -1 Falling back to public interface 2023-08-18T20:43:28.161 INFO:tasks.ceph.osd.0.smithi121.stderr:2023-08-18T20:43:28.160+0000 7fd8f11f5640 -1 Falling back to public interface 2023-08-18T20:43:28.164 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-08-18T20:43:28.163+0000 7f4e2ad5e640 -1 Falling back to public interface 2023-08-18T20:43:28.331 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:28.330+0000 7efd39285200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-18T20:43:28.398 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-08-18T20:43:28.397+0000 7f99722b6640 -1 Falling back to public interface 2023-08-18T20:43:28.410 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:28.410+0000 7efd39285200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-18T20:43:28.411 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-08-18T20:43:28.410+0000 7f94cc7d4640 -1 Falling back to public interface 2023-08-18T20:43:28.420 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-08-18T20:43:28.419+0000 7f8ec4790640 -1 Falling back to public interface 2023-08-18T20:43:28.423 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-08-18T20:43:28.422+0000 7fcfaa3a1640 -1 Falling back to public interface 2023-08-18T20:43:28.424 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-08-18T20:43:28.423+0000 7f19a00e8640 -1 Falling back to public interface 2023-08-18T20:43:28.556 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:28.556+0000 7efd39285200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-18T20:43:28.672 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:28.671+0000 7f1dd8d0e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-18T20:43:28.751 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:28.751+0000 7f1dd8d0e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-18T20:43:28.797 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:28.797+0000 7efd39285200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-18T20:43:28.866 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:28.892 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:28.891+0000 7f1dd8d0e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-18T20:43:28.980 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.979+0000 7f6eeba5b700 1 Processor -- start 2023-08-18T20:43:28.980 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.979+0000 7f6eeba5b700 1 -- start start 2023-08-18T20:43:28.981 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6eeba5b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6ee414e9d0 0x7f6ee40c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:28.981 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6eeba5b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ee40c4d00 0x7f6ee415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:28.981 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6eeba5b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee4155130 con 0x7f6ee413dbc0 2023-08-18T20:43:28.981 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6eeba5b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee40c8da0 con 0x7f6ee414e9d0 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6eeba5b700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee4155640 con 0x7f6ee40c4d00 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6ee97f7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6ee414e9d0 0x7f6ee40c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6ee8ff6700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6ee413dbc0 0x7f6ee40c9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45978/0 (socket says 172.21.15.121:45978) 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6ee8ff6700 1 -- 172.21.15.121:0/2890608687 learned_addr learned my addr 172.21.15.121:0/2890608687 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.980+0000 7f6ee9ff8700 1 --2- 172.21.15.121:0/2890608687 >> v2:172.21.15.122:3300/0 conn(0x7f6ee40c4d00 0x7f6ee415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:28.982 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6ee97f7700 1 -- 172.21.15.121:0/2890608687 >> v2:172.21.15.122:3300/0 conn(0x7f6ee40c4d00 msgr2=0x7f6ee415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:28.983 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6ee97f7700 1 --2- 172.21.15.121:0/2890608687 >> v2:172.21.15.122:3300/0 conn(0x7f6ee40c4d00 0x7f6ee415ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.983 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6ee97f7700 1 -- 172.21.15.121:0/2890608687 >> v1:172.21.15.121:6789/0 conn(0x7f6ee413dbc0 legacy=0x7f6ee40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:28.983 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6ee97f7700 1 -- 172.21.15.121:0/2890608687 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee413d810 con 0x7f6ee414e9d0 2023-08-18T20:43:28.983 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6ee97f7700 1 --2- 172.21.15.121:0/2890608687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee414e9d0 0x7f6ee40c47c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ee406a410 tx=0x7f6ee0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea739e6f6f829d5b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:28.985 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6edbfff700 1 -- 172.21.15.121:0/2890608687 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011830 con 0x7f6ee414e9d0 2023-08-18T20:43:28.985 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6edbfff700 1 -- 172.21.15.121:0/2890608687 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0011990 con 0x7f6ee414e9d0 2023-08-18T20:43:28.986 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.981+0000 7f6edbfff700 1 -- 172.21.15.121:0/2890608687 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011d20 con 0x7f6ee414e9d0 2023-08-18T20:43:28.986 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2890608687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee414e9d0 msgr2=0x7f6ee40c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:28.986 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2890608687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee414e9d0 0x7f6ee40c47c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ee406a410 tx=0x7f6ee0009b20 comp rx=0 tx=0).stop 2023-08-18T20:43:28.986 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2890608687 shutdown_connections 2023-08-18T20:43:28.986 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2890608687 >> v2:172.21.15.122:3300/0 conn(0x7f6ee40c4d00 0x7f6ee415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.987 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2890608687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee414e9d0 0x7f6ee40c47c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.987 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2890608687 >> 172.21.15.121:0/2890608687 conn(0x7f6ee40c9e40 msgr2=0x7f6ee40ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:28.987 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2890608687 shutdown_connections 2023-08-18T20:43:28.987 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.982+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2890608687 wait complete. 2023-08-18T20:43:28.987 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.983+0000 7f6eeba5b700 1 Processor -- start 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.983+0000 7f6eeba5b700 1 -- start start 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee40c4d00 0x7f6ee41e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ee414e9d0 0x7f6ee40bf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41e9a20 con 0x7f6ee413dbc0 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40c1d50 con 0x7f6ee40c4d00 2023-08-18T20:43:28.988 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6eeba5b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41ed6f0 con 0x7f6ee414e9d0 2023-08-18T20:43:28.989 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:28.989 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39404/0 (socket says 172.21.15.121:39404) 2023-08-18T20:43:28.989 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 -- 172.21.15.121:0/2032200551 learned_addr learned my addr 172.21.15.121:0/2032200551 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:28.989 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee97f7700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee40c4d00 0x7f6ee41e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:28.989 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee9ff8700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ee414e9d0 0x7f6ee40bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 -- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ee414e9d0 msgr2=0x7f6ee40bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ee414e9d0 0x7f6ee40bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 -- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee40c4d00 msgr2=0x7f6ee41e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee40c4d00 0x7f6ee41e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 -- 172.21.15.121:0/2032200551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094a0 con 0x7f6ee413dbc0 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.984+0000 7f6ee8ff6700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:28.990 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4005d70 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40070d0 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4007440 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee41e96d0 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ed4012400 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee41ed990 con 0x7f6ee413dbc0 2023-08-18T20:43:28.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.985+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6ed401ba80 con 0x7f6ee413dbc0 2023-08-18T20:43:28.992 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.986+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee41edb80 con 0x7f6ee413dbc0 2023-08-18T20:43:28.992 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:28.988+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6ed4017070 con 0x7f6ee413dbc0 2023-08-18T20:43:29.012 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.012+0000 7efd39285200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-18T20:43:29.057 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.057+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ee404ee70 con 0x7f6ee413dbc0 2023-08-18T20:43:29.058 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.057+0000 7f6ed9ffb700 1 -- 172.21.15.121:0/2032200551 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6ed401bc40 con 0x7f6ee413dbc0 2023-08-18T20:43:29.058 INFO:teuthology.misc.health.smithi121.stdout: 2023-08-18T20:43:29.058 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":10,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:27.759189+0000","last_up_change":"0.000000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:29.059 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.058+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 msgr2=0x7f6ee413a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:29.059 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.058+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c810 comp rx=0 tx=0).stop 2023-08-18T20:43:29.059 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 shutdown_connections 2023-08-18T20:43:29.059 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ee414e9d0 0x7f6ee40bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:29.060 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ee40c4d00 0x7f6ee41e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:29.060 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 --2- 172.21.15.121:0/2032200551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ee413dbc0 0x7f6ee413a190 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:29.060 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 >> 172.21.15.121:0/2032200551 conn(0x7f6ee40c9e40 msgr2=0x7f6ee40c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:29.060 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 shutdown_connections 2023-08-18T20:43:29.060 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:29.059+0000 7f6eeba5b700 1 -- 172.21.15.121:0/2032200551 wait complete. 2023-08-18T20:43:29.070 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-18T20:43:29.130 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.129+0000 7f1dd8d0e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-18T20:43:29.150 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.150+0000 7efd39285200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-18T20:43:29.341 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.340+0000 7f1dd8d0e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-18T20:43:29.374 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.374+0000 7efd39285200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-18T20:43:29.473 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.472+0000 7f1dd8d0e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-18T20:43:29.536 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.535+0000 7efd39285200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-18T20:43:29.657 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.656+0000 7efd39285200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-18T20:43:29.694 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.693+0000 7f1dd8d0e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-18T20:43:29.851 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.850+0000 7f1dd8d0e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-18T20:43:29.966 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:29.965+0000 7f1dd8d0e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-18T20:43:29.987 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:29.986+0000 7efd39285200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-18T20:43:30.089 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:30.089+0000 7efd39285200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-18T20:43:30.276 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:30.275+0000 7efd39285200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-18T20:43:30.285 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:30.284+0000 7f1dd8d0e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-18T20:43:30.387 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:30.386+0000 7f1dd8d0e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-18T20:43:30.575 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:30.574+0000 7f1dd8d0e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-18T20:43:30.879 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:30.879+0000 7efd39285200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-18T20:43:31.221 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-08-18T20:43:31.220+0000 7f1dd8d0e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-18T20:43:31.620 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-08-18T20:43:31.620+0000 7f316b8e2640 -1 osd.5 0 log_to_monitors true 2023-08-18T20:43:31.701 INFO:tasks.ceph.osd.0.smithi121.stderr:2023-08-18T20:43:31.701+0000 7fd8f11f5640 -1 osd.0 0 log_to_monitors true 2023-08-18T20:43:31.708 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-08-18T20:43:31.707+0000 7f4e2ad5e640 -1 osd.4 0 log_to_monitors true 2023-08-18T20:43:31.905 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:31.905+0000 7efcf12c1700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-18T20:43:31.907 INFO:tasks.ceph.mgr.y.smithi121.stderr:2023-08-18T20:43:31.907+0000 7efcf12c1700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-18T20:43:31.921 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-08-18T20:43:31.920+0000 7f99722b6640 -1 osd.6 0 log_to_monitors true 2023-08-18T20:43:31.940 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-08-18T20:43:31.939+0000 7f94cc7d4640 -1 osd.1 0 log_to_monitors true 2023-08-18T20:43:31.954 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-08-18T20:43:31.954+0000 7f19a00e8640 -1 osd.2 0 log_to_monitors true 2023-08-18T20:43:31.961 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-08-18T20:43:31.960+0000 7fcfaa3a1640 -1 osd.7 0 log_to_monitors true 2023-08-18T20:43:31.972 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-08-18T20:43:31.971+0000 7f8ec4790640 -1 osd.3 0 log_to_monitors true 2023-08-18T20:43:34.447 INFO:tasks.ceph.osd.0.smithi121.stderr:2023-08-18T20:43:34.446+0000 7fd8e4dac700 -1 osd.0 0 waiting for initial osdmap 2023-08-18T20:43:34.511 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-08-18T20:43:34.510+0000 7f94c038b700 -1 osd.1 0 waiting for initial osdmap 2023-08-18T20:43:34.525 INFO:tasks.ceph.osd.0.smithi121.stderr:2023-08-18T20:43:34.525+0000 7fd8dd187700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:34.561 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-08-18T20:43:34.561+0000 7f94b8766700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:34.664 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-08-18T20:43:34.664+0000 7f9965e6d700 -1 osd.6 0 waiting for initial osdmap 2023-08-18T20:43:34.682 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-08-18T20:43:34.682+0000 7f995e248700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:34.688 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-08-18T20:43:34.688+0000 7f315f499700 -1 osd.5 0 waiting for initial osdmap 2023-08-18T20:43:34.697 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-08-18T20:43:34.697+0000 7f3157874700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:34.721 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-08-18T20:43:34.720+0000 7f4e1e915700 -1 osd.4 0 waiting for initial osdmap 2023-08-18T20:43:34.731 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-08-18T20:43:34.731+0000 7f4e16cf0700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:35.007 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-08-18T20:43:35.006+0000 7fcf9df58700 -1 osd.7 0 waiting for initial osdmap 2023-08-18T20:43:35.010 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-08-18T20:43:35.009+0000 7fcf96333700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:35.292 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-08-18T20:43:35.291+0000 7f1993c9f700 -1 osd.2 0 waiting for initial osdmap 2023-08-18T20:43:35.295 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-08-18T20:43:35.294+0000 7f8eb8347700 -1 osd.3 0 waiting for initial osdmap 2023-08-18T20:43:35.308 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-08-18T20:43:35.308+0000 7f8eb0722700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:35.309 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-08-18T20:43:35.309+0000 7f198c07a700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-18T20:43:35.877 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:35.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.990+0000 7f357023e700 1 Processor -- start 2023-08-18T20:43:35.991 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.990+0000 7f357023e700 1 -- start start 2023-08-18T20:43:35.994 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f357023e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35680a4e30 0x7f35680c0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:35.994 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f357023e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35680c0d60 0x7f356815b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:35.994 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f357023e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35680c4080 con 0x7f3568153b90 2023-08-18T20:43:35.994 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f357023e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35680c45b0 con 0x7f35680a4e30 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f357023e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35680c0390 con 0x7f35680c0d60 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.991+0000 7f356d7d9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35680a4e30 0x7f35680c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35680a4e30 0x7f35680c0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39616/0 (socket says 172.21.15.121:39616) 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356dfda700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3568153b90 0x7f35680c2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46196/0 (socket says 172.21.15.121:46196) 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 -- 172.21.15.121:0/1745960831 learned_addr learned my addr 172.21.15.121:0/1745960831 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356e7db700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35680c0d60 0x7f356815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:35.995 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 -- 172.21.15.121:0/1745960831 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35680c0d60 msgr2=0x7f356815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:35.996 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35680c0d60 0x7f356815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:35.996 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 -- 172.21.15.121:0/1745960831 >> v1:172.21.15.121:6789/0 conn(0x7f3568153b90 legacy=0x7f35680c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:35.996 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 -- 172.21.15.121:0/1745960831 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568153f70 con 0x7f35680a4e30 2023-08-18T20:43:35.996 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356cfd8700 1 -- 172.21.15.121:0/1745960831 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204639124 0 0) 0x7f35680c4080 con 0x7f3568153b90 2023-08-18T20:43:35.996 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f35680c0820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3558009920 tx=0x7f3558009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79de84001813fbf server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356cfd8700 1 -- 172.21.15.121:0/1745960831 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800ba20 con 0x7f35680a4e30 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356cfd8700 1 -- 172.21.15.121:0/1745960831 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800bb80 con 0x7f35680a4e30 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.992+0000 7f356cfd8700 1 -- 172.21.15.121:0/1745960831 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558009e70 con 0x7f35680a4e30 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 -- 172.21.15.121:0/1745960831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 msgr2=0x7f35680c0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f35680c0820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3558009920 tx=0x7f3558009c30 comp rx=0 tx=0).stop 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 -- 172.21.15.121:0/1745960831 shutdown_connections 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35680c0d60 0x7f356815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:35.997 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 --2- 172.21.15.121:0/1745960831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f35680c0820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:35.998 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 -- 172.21.15.121:0/1745960831 >> 172.21.15.121:0/1745960831 conn(0x7f35680a7d20 msgr2=0x7f356806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:35.998 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 -- 172.21.15.121:0/1745960831 shutdown_connections 2023-08-18T20:43:35.998 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.993+0000 7f357023e700 1 -- 172.21.15.121:0/1745960831 wait complete. 2023-08-18T20:43:36.000 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.994+0000 7f357023e700 1 Processor -- start 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.994+0000 7f357023e700 1 -- start start 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 0x7f35680a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3568153b90 0x7f35680a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680a9f60 con 0x7f35680a4e30 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680a7310 con 0x7f35680c0d60 2023-08-18T20:43:36.001 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f357023e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35680ab080 con 0x7f3568153b90 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f356dfda700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f356dfda700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39620/0 (socket says 172.21.15.121:39620) 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.995+0000 7f356dfda700 1 -- 172.21.15.121:0/1581519313 learned_addr learned my addr 172.21.15.121:0/1581519313 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356e7db700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3568153b90 0x7f35680a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 0x7f35680a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 -- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3568153b90 msgr2=0x7f35680a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.002 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3568153b90 0x7f35680a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 -- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 msgr2=0x7f35680a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 0x7f35680a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 -- 172.21.15.121:0/1581519313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009550 con 0x7f35680a4e30 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 0x7f35680a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f356dfda700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f356400c550 tx=0x7f356400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564004c80 con 0x7f35680a4e30 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564004e00 con 0x7f35680a4e30 2023-08-18T20:43:36.003 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35680a9350 con 0x7f35680a4e30 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564007310 con 0x7f35680a4e30 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.996+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35680a9910 con 0x7f35680a4e30 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.997+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f3564007470 con 0x7f35680a4e30 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.997+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35680a5400 con 0x7f35680a4e30 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.998+0000 7f355e7fc700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 0x7f354c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.004 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.998+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f3564087ab0 con 0x7f35680a4e30 2023-08-18T20:43:36.005 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.998+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 0x7f354c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.005 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:35.998+0000 7f356d7d9700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 0x7f354c06c540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35681517c0 tx=0x7f3558008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:36.005 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.003+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3564053940 con 0x7f35680a4e30 2023-08-18T20:43:36.203 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.203+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f356804ee70 con 0x7f35680a4e30 2023-08-18T20:43:36.204 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.204+0000 7f355e7fc700 1 -- 172.21.15.121:0/1581519313 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10956 (secure 0 0 0) 0x7f3564056f60 con 0x7f35680a4e30 2023-08-18T20:43:36.204 INFO:teuthology.misc.health.smithi121.stdout: 2023-08-18T20:43:36.204 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":14,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:35.533896+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:36.206 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 msgr2=0x7f354c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.206 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 0x7f354c06c540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35681517c0 tx=0x7f3558008030 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 msgr2=0x7f3568147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f356400c550 tx=0x7f356400c910 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 shutdown_connections 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3568153b90 0x7f35680a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354c06a080 0x7f354c06c540 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35680a4e30 0x7f3568147d80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 --2- 172.21.15.121:0/1581519313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35680c0d60 0x7f35680a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.207 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 >> 172.21.15.121:0/1581519313 conn(0x7f35680a7d20 msgr2=0x7f35680c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:36.208 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 shutdown_connections 2023-08-18T20:43:36.208 INFO:teuthology.misc.health.smithi121.stderr:2023-08-18T20:43:36.206+0000 7f357023e700 1 -- 172.21.15.121:0/1581519313 wait complete. 2023-08-18T20:43:36.217 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-18T20:43:36.218 INFO:tasks.ceph:Creating RBD pool 2023-08-18T20:43:36.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-18T20:43:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.339+0000 7fd630de8700 1 Processor -- start 2023-08-18T20:43:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.339+0000 7fd630de8700 1 -- start start 2023-08-18T20:43:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd62c0c0c50 0x7fd62c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 0x7fd62c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0c5e50 con 0x7fd62c0c0c50 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0c4f40 con 0x7fd62c0a6290 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd630de8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c6120 con 0x7fd62c06a7e0 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd62a59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd62c0c0c50 0x7fd62c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.340+0000 7fd62a59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd62c0c0c50 0x7fd62c06a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39632/0 (socket says 172.21.15.121:39632) 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 -- 172.21.15.121:0/775677481 learned_addr learned my addr 172.21.15.121:0/775677481 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd629d9b700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62ad9d700 1 --2- 172.21.15.121:0/775677481 >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 0x7fd62c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 -- 172.21.15.121:0/775677481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 msgr2=0x7fd62c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c0c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 -- 172.21.15.121:0/775677481 >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 msgr2=0x7fd62c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 --2- 172.21.15.121:0/775677481 >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 0x7fd62c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 -- 172.21.15.121:0/775677481 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c1551f0 con 0x7fd62c0c0c50 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62ad9d700 1 --2- 172.21.15.121:0/775677481 >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 0x7fd62c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62a59c700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0c0c50 0x7fd62c06a2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0708e0 tx=0x7fd61c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acb29e3352bf096 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62959a700 1 -- 172.21.15.121:0/775677481 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00b870 con 0x7fd62c0c0c50 2023-08-18T20:43:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62959a700 1 -- 172.21.15.121:0/775677481 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c00b9d0 con 0x7fd62c0c0c50 2023-08-18T20:43:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd62959a700 1 -- 172.21.15.121:0/775677481 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00bd60 con 0x7fd62c0c0c50 2023-08-18T20:43:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd630de8700 1 -- 172.21.15.121:0/775677481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0c0c50 msgr2=0x7fd62c06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.341+0000 7fd630de8700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0c0c50 0x7fd62c06a2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0708e0 tx=0x7fd61c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 -- 172.21.15.121:0/775677481 shutdown_connections 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 --2- 172.21.15.121:0/775677481 >> v2:172.21.15.122:3300/0 conn(0x7fd62c0a6290 0x7fd62c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0c0c50 0x7fd62c06a2a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 --2- 172.21.15.121:0/775677481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 -- 172.21.15.121:0/775677481 >> 172.21.15.121:0/775677481 conn(0x7fd62c0c6b10 msgr2=0x7fd62c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:36.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 -- 172.21.15.121:0/775677481 shutdown_connections 2023-08-18T20:43:36.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.342+0000 7fd630de8700 1 -- 172.21.15.121:0/775677481 wait complete. 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.343+0000 7fd630de8700 1 Processor -- start 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.343+0000 7fd630de8700 1 -- start start 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd62c0c0c50 0x7fd62c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c157180 con 0x7fd62c0a6290 2023-08-18T20:43:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c1ed3b0 con 0x7fd62c0c0c50 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c1ed690 con 0x7fd62c06a7e0 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd62a59c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39640/0 (socket says 172.21.15.121:39640) 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd62a59c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36048/0 (socket says 172.21.15.121:36048) 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 -- 172.21.15.121:0/165138641 learned_addr learned my addr 172.21.15.121:0/165138641 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:36.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd62ad9d700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd62c0c0c50 0x7fd62c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 -- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 msgr2=0x7fd62c149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 -- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd62c0c0c50 msgr2=0x7fd62c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd62c0c0c50 0x7fd62c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 -- 172.21.15.121:0/165138641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c009550 con 0x7fd62c0a6290 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd629d9b700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd62000e810 tx=0x7fd62000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000c070 con 0x7fd62c0a6290 2023-08-18T20:43:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620013610 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c156b30 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.344+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6200139a0 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.345+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c1e6ec0 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.345+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c1572f0 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.346+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fd620013b00 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.347+0000 7fd61affd700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 0x7fd60c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.347+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd620087af0 con 0x7fd62c0a6290 2023-08-18T20:43:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.347+0000 7fd62a59c700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 0x7fd60c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:36.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.347+0000 7fd62a59c700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 0x7fd60c06c510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd61c014040 tx=0x7fd61c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:36.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.351+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd620053980 con 0x7fd62c0a6290 2023-08-18T20:43:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:36.550+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd62c074730 con 0x7fd62c0a6290 2023-08-18T20:43:37.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.541+0000 7fd61affd700 1 -- 172.21.15.121:0/165138641 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd620009440 con 0x7fd62c0a6290 2023-08-18T20:43:37.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.544+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 msgr2=0x7fd60c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.544+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 0x7fd60c06c510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd61c014040 tx=0x7fd61c008030 comp rx=0 tx=0).stop 2023-08-18T20:43:37.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.544+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 msgr2=0x7fd62c149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.544+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd62000e810 tx=0x7fd62000eb20 comp rx=0 tx=0).stop 2023-08-18T20:43:37.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 shutdown_connections 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd62c0c0c50 0x7fd62c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd62c06a7e0 0x7fd62c149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd60c06a050 0x7fd60c06c510 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 --2- 172.21.15.121:0/165138641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd62c0a6290 0x7fd62c149e40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 >> 172.21.15.121:0/165138641 conn(0x7fd62c0c6b10 msgr2=0x7fd62c0a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 shutdown_connections 2023-08-18T20:43:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.545+0000 7fd630de8700 1 -- 172.21.15.121:0/165138641 wait complete. 2023-08-18T20:43:37.547 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'rbd' created 2023-08-18T20:43:37.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-18T20:43:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.683+0000 7f3aae0fa700 1 Processor -- start 2023-08-18T20:43:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 -- start start 2023-08-18T20:43:37.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3aa806a510 0x7f3aa814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3aa80c3af0 0x7f3aa814b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80a5d30 con 0x7f3aa80c0250 2023-08-18T20:43:37.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa80c4a70 con 0x7f3aa80c3af0 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aae0fa700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa8155330 con 0x7f3aa806a510 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aa7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3aa80c3af0 0x7f3aa814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aa7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3aa80c3af0 0x7f3aa814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39690/0 (socket says 172.21.15.121:39690) 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aa7fff700 1 -- 172.21.15.121:0/2344458440 learned_addr learned my addr 172.21.15.121:0/2344458440 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.684+0000 7f3aa6ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3aa80c0250 0x7f3aa80c33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46274/0 (socket says 172.21.15.121:46274) 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa77fe700 1 --2- 172.21.15.121:0/2344458440 >> v2:172.21.15.122:3300/0 conn(0x7f3aa806a510 0x7f3aa814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa7fff700 1 -- 172.21.15.121:0/2344458440 >> v2:172.21.15.122:3300/0 conn(0x7f3aa806a510 msgr2=0x7f3aa814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa7fff700 1 --2- 172.21.15.121:0/2344458440 >> v2:172.21.15.122:3300/0 conn(0x7f3aa806a510 0x7f3aa814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa7fff700 1 -- 172.21.15.121:0/2344458440 >> v1:172.21.15.121:6789/0 conn(0x7f3aa80c0250 legacy=0x7f3aa80c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa67fc700 1 -- 172.21.15.121:0/2344458440 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409128874 0 0) 0x7f3aa80a5d30 con 0x7f3aa80c0250 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa7fff700 1 -- 172.21.15.121:0/2344458440 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80a5fd0 con 0x7f3aa80c3af0 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa7fff700 1 --2- 172.21.15.121:0/2344458440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c3af0 0x7f3aa814b040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806aeb0 tx=0x7f3aa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78268c0074ca7d22 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa67fc700 1 -- 172.21.15.121:0/2344458440 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011830 con 0x7f3aa80c3af0 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa67fc700 1 -- 172.21.15.121:0/2344458440 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0011990 con 0x7f3aa80c3af0 2023-08-18T20:43:37.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.685+0000 7f3aa67fc700 1 -- 172.21.15.121:0/2344458440 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011d20 con 0x7f3aa80c3af0 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 -- 172.21.15.121:0/2344458440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c3af0 msgr2=0x7f3aa814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/2344458440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c3af0 0x7f3aa814b040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806aeb0 tx=0x7f3aa0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 -- 172.21.15.121:0/2344458440 shutdown_connections 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/2344458440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c3af0 0x7f3aa814b040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/2344458440 >> v2:172.21.15.122:3300/0 conn(0x7f3aa806a510 0x7f3aa814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 -- 172.21.15.121:0/2344458440 >> 172.21.15.121:0/2344458440 conn(0x7f3aa80a8770 msgr2=0x7f3aa80a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 -- 172.21.15.121:0/2344458440 shutdown_connections 2023-08-18T20:43:37.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.686+0000 7f3aae0fa700 1 -- 172.21.15.121:0/2344458440 wait complete. 2023-08-18T20:43:37.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.687+0000 7f3aae0fa700 1 Processor -- start 2023-08-18T20:43:37.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.687+0000 7f3aae0fa700 1 -- start start 2023-08-18T20:43:37.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3aa806a510 0x7f3aa81e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa80c3af0 0x7f3aa81e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa814f910 con 0x7f3aa80c0250 2023-08-18T20:43:37.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa814a310 con 0x7f3aa80c3af0 2023-08-18T20:43:37.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aae0fa700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa814eb70 con 0x7f3aa806a510 2023-08-18T20:43:37.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39696/0 (socket says 172.21.15.121:39696) 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.688+0000 7f3aa6ffd700 1 -- 172.21.15.121:0/849186003 learned_addr learned my addr 172.21.15.121:0/849186003 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa77fe700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3aa806a510 0x7f3aa81e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 -- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3aa806a510 msgr2=0x7f3aa81e9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3aa806a510 0x7f3aa81e9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa7fff700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa80c3af0 0x7f3aa81e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 -- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa80c3af0 msgr2=0x7f3aa81e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa80c3af0 0x7f3aa81e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 -- 172.21.15.121:0/849186003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009550 con 0x7f3aa80c0250 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aa6ffd700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00c750 tx=0x7f3a9c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c004c80 con 0x7f3aa80c0250 2023-08-18T20:43:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c004e00 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa814ee20 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c007310 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.689+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8151b50 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.690+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa8074730 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.690+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f3a9c007470 con 0x7f3aa80c0250 2023-08-18T20:43:37.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.691+0000 7f3a8ffff700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 0x7f3a9406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.691+0000 7f3aa77fe700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 0x7f3a9406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.691+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f3a9c087e50 con 0x7f3aa80c0250 2023-08-18T20:43:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.691+0000 7f3aa77fe700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 0x7f3a9406c510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8158a90 tx=0x7f3a9800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.696+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3a9c053980 con 0x7f3aa80c0250 2023-08-18T20:43:37.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:37.894+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3aa806ac00 con 0x7f3aa80c0250 2023-08-18T20:43:38.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.543+0000 7f3a8ffff700 1 -- 172.21.15.121:0/849186003 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3a9c056fa0 con 0x7f3aa80c0250 2023-08-18T20:43:38.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 msgr2=0x7f3a9406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 0x7f3a9406c510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8158a90 tx=0x7f3a9800b040 comp rx=0 tx=0).stop 2023-08-18T20:43:38.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 msgr2=0x7f3aa8149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00c750 tx=0x7f3a9c00cb10 comp rx=0 tx=0).stop 2023-08-18T20:43:38.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 shutdown_connections 2023-08-18T20:43:38.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa80c3af0 0x7f3aa81e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3aa806a510 0x7f3aa81e9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3a9406a050 0x7f3a9406c510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 --2- 172.21.15.121:0/849186003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3aa80c0250 0x7f3aa8149dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 >> 172.21.15.121:0/849186003 conn(0x7f3aa80a8770 msgr2=0x7f3aa8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:38.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 shutdown_connections 2023-08-18T20:43:38.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.547+0000 7f3aae0fa700 1 -- 172.21.15.121:0/849186003 wait complete. 2023-08-18T20:43:38.553 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-18T20:43:38.561 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-18T20:43:38.562 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-18T20:43:38.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-18T20:43:38.564 INFO:tasks.ceph.mds.a:Started 2023-08-18T20:43:38.564 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-18T20:43:38.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-18T20:43:38.566 INFO:tasks.ceph.mds.c:Started 2023-08-18T20:43:38.567 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-18T20:43:38.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-18T20:43:38.570 INFO:tasks.ceph.mds.b:Started 2023-08-18T20:43:38.570 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-18T20:43:38.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-18T20:43:38.572 INFO:tasks.ceph.mds.d:Started 2023-08-18T20:43:38.573 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-18T20:43:38.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:38.657 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2023-08-18T20:43:38.658 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2023-08-18T20:43:38.663 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-08-18T20:43:38.663 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-08-18T20:43:38.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.714+0000 7fca3d4c4700 1 Processor -- start 2023-08-18T20:43:38.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.715+0000 7fca3d4c4700 1 -- start start 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.715+0000 7fca3d4c4700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 0x7fca3806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca3d4c4700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 0x7fca38071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca3d4c4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380c4f40 con 0x7fca3806a7e0 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca3d4c4700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380c6120 con 0x7fca380c5ae0 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca3d4c4700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca381551f0 con 0x7fca380c0c50 2023-08-18T20:43:38.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca367fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fca3806a7e0 0x7fca380c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46346/0 (socket says 172.21.15.121:46346) 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca367fc700 1 -- 172.21.15.121:0/949301102 learned_addr learned my addr 172.21.15.121:0/949301102 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 --2- 172.21.15.121:0/949301102 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 0x7fca3806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca377fe700 1 --2- 172.21.15.121:0/949301102 >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 0x7fca38071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca35ffb700 1 -- 172.21.15.121:0/949301102 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513642891 0 0) 0x7fca380c4f40 con 0x7fca3806a7e0 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca35ffb700 1 -- 172.21.15.121:0/949301102 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca200035b0 con 0x7fca3806a7e0 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 -- 172.21.15.121:0/949301102 >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 msgr2=0x7fca38071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 --2- 172.21.15.121:0/949301102 >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 0x7fca38071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 -- 172.21.15.121:0/949301102 >> v1:172.21.15.121:6789/0 conn(0x7fca3806a7e0 legacy=0x7fca380c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 -- 172.21.15.121:0/949301102 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380c63a0 con 0x7fca380c0c50 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca377fe700 1 --2- 172.21.15.121:0/949301102 >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 0x7fca38071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca36ffd700 1 --2- 172.21.15.121:0/949301102 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 0x7fca3806a2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca28009840 tx=0x7fca28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0e830dc74570ed server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca35ffb700 1 -- 172.21.15.121:0/949301102 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28011830 con 0x7fca380c0c50 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca35ffb700 1 -- 172.21.15.121:0/949301102 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca28011990 con 0x7fca380c0c50 2023-08-18T20:43:38.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.716+0000 7fca35ffb700 1 -- 172.21.15.121:0/949301102 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28011d20 con 0x7fca380c0c50 2023-08-18T20:43:38.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 -- 172.21.15.121:0/949301102 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 msgr2=0x7fca3806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/949301102 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 0x7fca3806a2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca28009840 tx=0x7fca28009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 -- 172.21.15.121:0/949301102 shutdown_connections 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/949301102 >> v2:172.21.15.122:3300/0 conn(0x7fca380c5ae0 0x7fca38071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/949301102 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca380c0c50 0x7fca3806a2a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 -- 172.21.15.121:0/949301102 >> 172.21.15.121:0/949301102 conn(0x7fca380c6b10 msgr2=0x7fca380c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 -- 172.21.15.121:0/949301102 shutdown_connections 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.717+0000 7fca3d4c4700 1 -- 172.21.15.121:0/949301102 wait complete. 2023-08-18T20:43:38.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.718+0000 7fca3d4c4700 1 Processor -- start 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.718+0000 7fca3d4c4700 1 -- start start 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 0x7fca381535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 0x7fca3814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3814ba10 con 0x7fca380c0c50 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380a9b00 con 0x7fca380c5ae0 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca3d4c4700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3814f8e0 con 0x7fca3806a7e0 2023-08-18T20:43:38.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39772/0 (socket says 172.21.15.121:39772) 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 -- 172.21.15.121:0/2655067617 learned_addr learned my addr 172.21.15.121:0/2655067617 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca36ffd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 0x7fca381535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca377fe700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 0x7fca3814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 -- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 msgr2=0x7fca381535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 0x7fca381535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 -- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 msgr2=0x7fca3814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.719+0000 7fca367fc700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 0x7fca3814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca367fc700 1 -- 172.21.15.121:0/2655067617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009a70 con 0x7fca380c0c50 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca36ffd700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 0x7fca381535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca377fe700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 0x7fca3814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca367fc700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001eb0 tx=0x7fca2c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00cea0 con 0x7fca380c0c50 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c005d70 con 0x7fca380c0c50 2023-08-18T20:43:38.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0072f0 con 0x7fca380c0c50 2023-08-18T20:43:38.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca280094a0 con 0x7fca380c0c50 2023-08-18T20:43:38.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.720+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca380a9d50 con 0x7fca380c0c50 2023-08-18T20:43:38.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.721+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca38074730 con 0x7fca380c0c50 2023-08-18T20:43:38.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.722+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fca2c007450 con 0x7fca380c0c50 2023-08-18T20:43:38.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.722+0000 7fca1f7fe700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 0x7fca2406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:38.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.722+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca2c087550 con 0x7fca380c0c50 2023-08-18T20:43:38.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.722+0000 7fca36ffd700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 0x7fca2406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:38.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.723+0000 7fca36ffd700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 0x7fca2406c540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca28000c00 tx=0x7fca28008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:38.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.727+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fca2c052fd0 con 0x7fca380c0c50 2023-08-18T20:43:38.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.946+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca3806a2a0 con 0x7fca380c0c50 2023-08-18T20:43:38.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.947+0000 7fca1f7fe700 1 -- 172.21.15.121:0/2655067617 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14653 (secure 0 0 0) 0x7fca2c0565f0 con 0x7fca380c0c50 2023-08-18T20:43:38.948 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:38.948 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:38.540900+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:38.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.949+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 msgr2=0x7fca2406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.949+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 0x7fca2406c540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca28000c00 tx=0x7fca28008030 comp rx=0 tx=0).stop 2023-08-18T20:43:38.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.949+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 msgr2=0x7fca3814af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:38.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.949+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001eb0 tx=0x7fca2c00c7b0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 shutdown_connections 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca380c5ae0 0x7fca3814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3806a7e0 0x7fca381535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2406a080 0x7fca2406c540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 --2- 172.21.15.121:0/2655067617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca380c0c50 0x7fca3814af90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 >> 172.21.15.121:0/2655067617 conn(0x7fca380c6b10 msgr2=0x7fca3806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 shutdown_connections 2023-08-18T20:43:38.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:38.950+0000 7fca3d4c4700 1 -- 172.21.15.121:0/2655067617 wait complete. 2023-08-18T20:43:38.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:43:38.965 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:43:39.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.091+0000 7f47ba78d700 1 Processor -- start 2023-08-18T20:43:39.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.092+0000 7f47ba78d700 1 -- start start 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.092+0000 7f47ba78d700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f47b414e950 0x7f47b40c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47ba78d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f47b414ed30 0x7f47b40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47ba78d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b40c19d0 0x7f47b40c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47ba78d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40a6630 con 0x7f47b414ed30 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47ba78d700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40c2260 con 0x7f47b414e950 2023-08-18T20:43:39.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47ba78d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4151d90 con 0x7f47b40c19d0 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f47b414ed30 0x7f47b40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f47b414ed30 0x7f47b40c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39788/0 (socket says 172.21.15.121:39788) 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 -- 172.21.15.121:0/1126194486 learned_addr learned my addr 172.21.15.121:0/1126194486 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b3fff700 1 --2- 172.21.15.121:0/1126194486 >> v2:172.21.15.122:3300/0 conn(0x7f47b414e950 0x7f47b40c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b8d2a700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b40c19d0 0x7f47b40c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 -- 172.21.15.121:0/1126194486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b40c19d0 msgr2=0x7f47b40c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b40c19d0 0x7f47b40c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 -- 172.21.15.121:0/1126194486 >> v2:172.21.15.122:3300/0 conn(0x7f47b414e950 msgr2=0x7f47b40c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:39.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 --2- 172.21.15.121:0/1126194486 >> v2:172.21.15.122:3300/0 conn(0x7f47b414e950 0x7f47b40c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 -- 172.21.15.121:0/1126194486 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4152070 con 0x7f47b414ed30 2023-08-18T20:43:39.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b37fe700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b414ed30 0x7f47b40c1490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47b40acdc0 tx=0x7f47a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c328747e1efec7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b2ffd700 1 -- 172.21.15.121:0/1126194486 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8011830 con 0x7f47b414ed30 2023-08-18T20:43:39.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b2ffd700 1 -- 172.21.15.121:0/1126194486 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8011990 con 0x7f47b414ed30 2023-08-18T20:43:39.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.093+0000 7f47b2ffd700 1 -- 172.21.15.121:0/1126194486 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8011d20 con 0x7f47b414ed30 2023-08-18T20:43:39.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 -- 172.21.15.121:0/1126194486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b414ed30 msgr2=0x7f47b40c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b414ed30 0x7f47b40c1490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47b40acdc0 tx=0x7f47a8009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 -- 172.21.15.121:0/1126194486 shutdown_connections 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 --2- 172.21.15.121:0/1126194486 >> v2:172.21.15.122:3300/0 conn(0x7f47b414e950 0x7f47b40c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b40c19d0 0x7f47b40c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 --2- 172.21.15.121:0/1126194486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b414ed30 0x7f47b40c1490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 -- 172.21.15.121:0/1126194486 >> 172.21.15.121:0/1126194486 conn(0x7f47b40c6b10 msgr2=0x7f47b40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 -- 172.21.15.121:0/1126194486 shutdown_connections 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.094+0000 7f47ba78d700 1 -- 172.21.15.121:0/1126194486 wait complete. 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.096+0000 7f47ba78d700 1 Processor -- start 2023-08-18T20:43:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.096+0000 7f47ba78d700 1 -- start start 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 0x7f47b41eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b414ed30 0x7f47b40bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41ead30 con 0x7f47b40c19d0 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40a9c90 con 0x7f47b414e950 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47ba78d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40ac0c0 con 0x7f47b414ed30 2023-08-18T20:43:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b37fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 0x7f47b41eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39792/0 (socket says 172.21.15.121:39792) 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 -- 172.21.15.121:0/3490585740 learned_addr learned my addr 172.21.15.121:0/3490585740 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b8d2a700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b414ed30 0x7f47b40bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 -- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b414ed30 msgr2=0x7f47b40bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b414ed30 0x7f47b40bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 -- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 msgr2=0x7f47b41eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 0x7f47b41eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 -- 172.21.15.121:0/3490585740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009550 con 0x7f47b40c19d0 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b37fe700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 0x7f47b41eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b3fff700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9b0 tx=0x7f47a400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.097+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4009710 con 0x7f47b40c19d0 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.098+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400ee50 con 0x7f47b40c19d0 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.098+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ca50 con 0x7f47b40c19d0 2023-08-18T20:43:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.098+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40ab820 con 0x7f47b40c19d0 2023-08-18T20:43:39.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.098+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40abde0 con 0x7f47b40c19d0 2023-08-18T20:43:39.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.099+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b41eafa0 con 0x7f47b40c19d0 2023-08-18T20:43:39.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.099+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f47a400cbb0 con 0x7f47b40c19d0 2023-08-18T20:43:39.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.099+0000 7f47b0ff9700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 0x7f47a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.099+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f47a4088070 con 0x7f47b40c19d0 2023-08-18T20:43:39.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.104+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f47a4053b90 con 0x7f47b40c19d0 2023-08-18T20:43:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.110+0000 7f47b37fe700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 0x7f47a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.110+0000 7f47b37fe700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 0x7f47a006c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.303+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47b40a8580 con 0x7f47b40c19d0 2023-08-18T20:43:39.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.304+0000 7f47b0ff9700 1 -- 172.21.15.121:0/3490585740 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47a400ce60 con 0x7f47b40c19d0 2023-08-18T20:43:39.304 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:43:39.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 msgr2=0x7f47a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 0x7f47a006c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8008030 comp rx=0 tx=0).stop 2023-08-18T20:43:39.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 msgr2=0x7f47b41d87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9b0 tx=0x7f47a400ecc0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 shutdown_connections 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47b414ed30 0x7f47b40bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47a006a050 0x7f47a006c510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b40c19d0 0x7f47b41d87f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 --2- 172.21.15.121:0/3490585740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47b414e950 0x7f47b41eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 >> 172.21.15.121:0/3490585740 conn(0x7f47b40c6b10 msgr2=0x7f47b40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:39.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 shutdown_connections 2023-08-18T20:43:39.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.306+0000 7f47ba78d700 1 -- 172.21.15.121:0/3490585740 wait complete. 2023-08-18T20:43:39.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:43:39.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.445+0000 7fd49400e700 1 Processor -- start 2023-08-18T20:43:39.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.445+0000 7fd49400e700 1 -- start start 2023-08-18T20:43:39.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd49400e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd48c0c0c50 0x7fd48c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd49400e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd48c06a7e0 0x7fd48c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd49400e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0c4f40 con 0x7fd48c0a6290 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd49400e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0c6120 con 0x7fd48c0c0c50 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd49400e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c1551f0 con 0x7fd48c06a7e0 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd48c0c0c50 0x7fd48c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd48c0c0c50 0x7fd48c06a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39810/0 (socket says 172.21.15.121:39810) 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 -- 172.21.15.121:0/3044981877 learned_addr learned my addr 172.21.15.121:0/3044981877 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd4915a9700 1 --2- 172.21.15.121:0/3044981877 >> v2:172.21.15.122:3300/0 conn(0x7fd48c06a7e0 0x7fd48c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 -- 172.21.15.121:0/3044981877 >> v2:172.21.15.122:3300/0 conn(0x7fd48c06a7e0 msgr2=0x7fd48c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 --2- 172.21.15.121:0/3044981877 >> v2:172.21.15.122:3300/0 conn(0x7fd48c06a7e0 0x7fd48c0c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.446+0000 7fd491daa700 1 -- 172.21.15.121:0/3044981877 >> v1:172.21.15.122:6789/0 conn(0x7fd48c0a6290 legacy=0x7fd48c071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.447+0000 7fd491daa700 1 -- 172.21.15.121:0/3044981877 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0c63a0 con 0x7fd48c0c0c50 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.447+0000 7fd491daa700 1 --2- 172.21.15.121:0/3044981877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0c0c50 0x7fd48c06a2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0c45c0 tx=0x7fd488009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702ff313f7413b1a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.447+0000 7fd490da8700 1 -- 172.21.15.121:0/3044981877 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488004230 con 0x7fd48c0c0c50 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.447+0000 7fd490da8700 1 -- 172.21.15.121:0/3044981877 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488004390 con 0x7fd48c0c0c50 2023-08-18T20:43:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.447+0000 7fd490da8700 1 -- 172.21.15.121:0/3044981877 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880036a0 con 0x7fd48c0c0c50 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 -- 172.21.15.121:0/3044981877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0c0c50 msgr2=0x7fd48c06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 --2- 172.21.15.121:0/3044981877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0c0c50 0x7fd48c06a2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0c45c0 tx=0x7fd488009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 -- 172.21.15.121:0/3044981877 shutdown_connections 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 --2- 172.21.15.121:0/3044981877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0c0c50 0x7fd48c06a2a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 --2- 172.21.15.121:0/3044981877 >> v2:172.21.15.122:3300/0 conn(0x7fd48c06a7e0 0x7fd48c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 -- 172.21.15.121:0/3044981877 >> 172.21.15.121:0/3044981877 conn(0x7fd48c0c6b10 msgr2=0x7fd48c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 -- 172.21.15.121:0/3044981877 shutdown_connections 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.448+0000 7fd49400e700 1 -- 172.21.15.121:0/3044981877 wait complete. 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.449+0000 7fd49400e700 1 Processor -- start 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.449+0000 7fd49400e700 1 -- start start 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd48c06a7e0 0x7fd48c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd48c0c0c50 0x7fd48c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1573d0 con 0x7fd48c0a6290 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c156730 con 0x7fd48c06a7e0 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1ed480 con 0x7fd48c0c0c50 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39818/0 (socket says 172.21.15.121:39818) 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 -- 172.21.15.121:0/3586614514 learned_addr learned my addr 172.21.15.121:0/3586614514 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd491daa700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd48c06a7e0 0x7fd48c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4925ab700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd48c0c0c50 0x7fd48c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 -- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd48c0c0c50 msgr2=0x7fd48c157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd48c0c0c50 0x7fd48c157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 -- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd48c06a7e0 msgr2=0x7fd48c153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd48c06a7e0 0x7fd48c153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 -- 172.21.15.121:0/3586614514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009550 con 0x7fd48c0a6290 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4915a9700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c7f0 tx=0x7fd47c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c011800 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c011960 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c011cd0 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c1ed760 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.450+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c157060 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.451+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c157580 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.452+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fd47c010350 con 0x7fd48c0a6290 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.452+0000 7fd4827fc700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 0x7fd47006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.452+0000 7fd491daa700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 0x7fd47006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.452+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd47c087ac0 con 0x7fd48c0a6290 2023-08-18T20:43:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.453+0000 7fd491daa700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 0x7fd47006c4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd488009130 tx=0x7fd488008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.457+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd48c157580 con 0x7fd48c0a6290 2023-08-18T20:43:39.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.659+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd48c074730 con 0x7fd48c0a6290 2023-08-18T20:43:39.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.659+0000 7fd4827fc700 1 -- 172.21.15.121:0/3586614514 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd47c01f0a0 con 0x7fd48c0a6290 2023-08-18T20:43:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:43:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 msgr2=0x7fd47006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 0x7fd47006c4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd488009130 tx=0x7fd488008030 comp rx=0 tx=0).stop 2023-08-18T20:43:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 msgr2=0x7fd48c14c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c7f0 tx=0x7fd47c00cb00 comp rx=0 tx=0).stop 2023-08-18T20:43:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 shutdown_connections 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd48c0c0c50 0x7fd48c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd48c06a7e0 0x7fd48c153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd47006a020 0x7fd47006c4e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 --2- 172.21.15.121:0/3586614514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd48c0a6290 0x7fd48c14c030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 >> 172.21.15.121:0/3586614514 conn(0x7fd48c0c6b10 msgr2=0x7fd48c0c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 shutdown_connections 2023-08-18T20:43:39.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.661+0000 7fd49400e700 1 -- 172.21.15.121:0/3586614514 wait complete. 2023-08-18T20:43:39.674 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:43:39.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.796+0000 7f60176c6700 1 Processor -- start 2023-08-18T20:43:39.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.796+0000 7f60176c6700 1 -- start start 2023-08-18T20:43:39.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f60176c6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60100bc9f0 0x7f60100c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f60176c6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f601006a680 0x7f6010154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f60176c6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601006ab10 con 0x7f601006a2a0 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f60176c6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100bbbf0 con 0x7f601006a680 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f60176c6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6010152050 con 0x7f60100bc9f0 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f6015462700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f601006a2a0 0x7f60100c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46410/0 (socket says 172.21.15.121:46410) 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f6015462700 1 -- 172.21.15.121:0/4171283605 learned_addr learned my addr 172.21.15.121:0/4171283605 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.797+0000 7f6015c63700 1 --2- 172.21.15.121:0/4171283605 >> v2:172.21.15.121:3300/0 conn(0x7f601006a680 0x7f6010154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6014c61700 1 --2- 172.21.15.121:0/4171283605 >> v2:172.21.15.122:3300/0 conn(0x7f60100bc9f0 0x7f60100c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6007fff700 1 -- 172.21.15.121:0/4171283605 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220619833 0 0) 0x7f600c001110 con 0x7f601006a2a0 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6007fff700 1 -- 172.21.15.121:0/4171283605 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ffc0035b0 con 0x7f601006a2a0 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6015c63700 1 -- 172.21.15.121:0/4171283605 >> v2:172.21.15.122:3300/0 conn(0x7f60100bc9f0 msgr2=0x7f60100c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6015c63700 1 --2- 172.21.15.121:0/4171283605 >> v2:172.21.15.122:3300/0 conn(0x7f60100bc9f0 0x7f60100c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6015c63700 1 -- 172.21.15.121:0/4171283605 >> v1:172.21.15.121:6789/0 conn(0x7f601006a2a0 legacy=0x7f60100c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6015c63700 1 -- 172.21.15.121:0/4171283605 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010154400 con 0x7f601006a680 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6015c63700 1 --2- 172.21.15.121:0/4171283605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a680 0x7f6010154be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60100a9800 tx=0x7f600800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd4824cd21d7056 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6007fff700 1 -- 172.21.15.121:0/4171283605 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800e070 con 0x7f601006a680 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6007fff700 1 -- 172.21.15.121:0/4171283605 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800bb20 con 0x7f601006a680 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.798+0000 7f6007fff700 1 -- 172.21.15.121:0/4171283605 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008012430 con 0x7f601006a680 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 -- 172.21.15.121:0/4171283605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a680 msgr2=0x7f6010154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 --2- 172.21.15.121:0/4171283605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a680 0x7f6010154be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60100a9800 tx=0x7f600800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 -- 172.21.15.121:0/4171283605 shutdown_connections 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 --2- 172.21.15.121:0/4171283605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a680 0x7f6010154be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 --2- 172.21.15.121:0/4171283605 >> v2:172.21.15.122:3300/0 conn(0x7f60100bc9f0 0x7f60100c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 -- 172.21.15.121:0/4171283605 >> 172.21.15.121:0/4171283605 conn(0x7f60100c35a0 msgr2=0x7f60100c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:39.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 -- 172.21.15.121:0/4171283605 shutdown_connections 2023-08-18T20:43:39.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.799+0000 7f60176c6700 1 -- 172.21.15.121:0/4171283605 wait complete. 2023-08-18T20:43:39.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.800+0000 7f60176c6700 1 Processor -- start 2023-08-18T20:43:39.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.800+0000 7f60176c6700 1 -- start start 2023-08-18T20:43:39.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f601006a680 0x7f601014c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60100bc9f0 0x7f601006d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601006ea20 con 0x7f601006a2a0 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601006cdc0 con 0x7f601006a680 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f60176c6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601006ca90 con 0x7f60100bc9f0 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39834/0 (socket says 172.21.15.121:39834) 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 -- 172.21.15.121:0/2024317325 learned_addr learned my addr 172.21.15.121:0/2024317325 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6014c61700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f601006a680 0x7f601014c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015c63700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60100bc9f0 0x7f601006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 -- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60100bc9f0 msgr2=0x7f601006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60100bc9f0 0x7f601006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 -- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f601006a680 msgr2=0x7f601014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f601006a680 0x7f601014c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:39.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.801+0000 7f6015462700 1 -- 172.21.15.121:0/2024317325 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009a70 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f6015462700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f600c007fd0 tx=0x7f600c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c005d70 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c0070d0 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60101ea9c0 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c007460 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.802+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601014c910 con 0x7f601006a2a0 2023-08-18T20:43:39.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.803+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601006d0a0 con 0x7f601006a2a0 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.803+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f600c0075c0 con 0x7f601006a2a0 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.804+0000 7f6005ffb700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 0x7f5ff406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.804+0000 7f6014c61700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 0x7f5ff406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.804+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f600c0873d0 con 0x7f601006a2a0 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.804+0000 7f6014c61700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 0x7f5ff406c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6010156ad0 tx=0x7f6000009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.808+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f600c052ef0 con 0x7f601006a2a0 2023-08-18T20:43:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:39.815+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f600c0532c0 con 0x7f601006a2a0 2023-08-18T20:43:40.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.055+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f601006ab10 con 0x7f601006a2a0 2023-08-18T20:43:40.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.056+0000 7f6005ffb700 1 -- 172.21.15.121:0/2024317325 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f601006ab10 con 0x7f601006a2a0 2023-08-18T20:43:40.056 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:40.057 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-18T20:43:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 msgr2=0x7f5ff406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 0x7f5ff406c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6010156ad0 tx=0x7f6000009210 comp rx=0 tx=0).stop 2023-08-18T20:43:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 msgr2=0x7f6010156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f600c007fd0 tx=0x7f600c00c9e0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 shutdown_connections 2023-08-18T20:43:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60100bc9f0 0x7f601006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ff406a050 0x7f5ff406c510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f601006a2a0 0x7f6010156590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 --2- 172.21.15.121:0/2024317325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f601006a680 0x7f601014c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 >> 172.21.15.121:0/2024317325 conn(0x7f60100c35a0 msgr2=0x7f60101539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 shutdown_connections 2023-08-18T20:43:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.058+0000 7f60176c6700 1 -- 172.21.15.121:0/2024317325 wait complete. 2023-08-18T20:43:40.062 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 3 2023-08-18T20:43:40.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:40.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.195+0000 7fa8001cd700 1 Processor -- start 2023-08-18T20:43:40.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.195+0000 7fa8001cd700 1 -- start start 2023-08-18T20:43:40.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa8001cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 0x7fa7f80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa8001cd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80c21f0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa8001cd700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80c5b20 con 0x7fa7f8157c10 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa8001cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c2ba0 con 0x7fa7f806a510 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fd768700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa7f80c1cf0 0x7fa7f8151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46424/0 (socket says 172.21.15.121:46424) 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fd768700 1 -- 172.21.15.121:0/2753135111 learned_addr learned my addr 172.21.15.121:0/2753135111 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2753135111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 0x7fa7f80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627182515 0 0) 0x7fa7f80c21f0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e40035b0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355463032 0 0) 0x7fa7f80c5b20 con 0x7fa7f8157c10 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f80c21f0 con 0x7fa7f8157c10 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fdf69700 1 -- 172.21.15.121:0/2753135111 >> v1:172.21.15.122:6789/0 conn(0x7fa7f8157c10 legacy=0x7fa7f81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fdf69700 1 -- 172.21.15.121:0/2753135111 >> v1:172.21.15.121:6789/0 conn(0x7fa7f80c1cf0 legacy=0x7fa7f8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.196+0000 7fa7fdf69700 1 -- 172.21.15.121:0/2753135111 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80c6510 con 0x7fa7f806a510 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2753135111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 0x7fa7f80c5490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009870 tx=0x7fa7f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fe6abf842c869e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4011830 con 0x7fa7f806a510 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4011990 con 0x7fa7f806a510 2023-08-18T20:43:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa7fcf67700 1 -- 172.21.15.121:0/2753135111 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4011d20 con 0x7fa7f806a510 2023-08-18T20:43:40.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 -- 172.21.15.121:0/2753135111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 msgr2=0x7fa7f80c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2753135111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 0x7fa7f80c5490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009870 tx=0x7fa7f4009b80 comp rx=0 tx=0).stop 2023-08-18T20:43:40.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 -- 172.21.15.121:0/2753135111 shutdown_connections 2023-08-18T20:43:40.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2753135111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f806a510 0x7fa7f80c5490 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 -- 172.21.15.121:0/2753135111 >> 172.21.15.121:0/2753135111 conn(0x7fa7f80c6b10 msgr2=0x7fa7f80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 -- 172.21.15.121:0/2753135111 shutdown_connections 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.197+0000 7fa8001cd700 1 -- 172.21.15.121:0/2753135111 wait complete. 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.198+0000 7fa8001cd700 1 Processor -- start 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 -- start start 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 0x7fa7f80a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f8157c10 0x7fa7f81e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80ab9e0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f814ed10 con 0x7fa7f806a510 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa8001cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81523b0 con 0x7fa7f8157c10 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa7fd768700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa7fd768700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39850/0 (socket says 172.21.15.121:39850) 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa7fd768700 1 -- 172.21.15.121:0/2849276162 learned_addr learned my addr 172.21.15.121:0/2849276162 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 0x7fa7f80a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.199+0000 7fa7fe76a700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f8157c10 0x7fa7f81e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 -- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f8157c10 msgr2=0x7fa7f81e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f8157c10 0x7fa7f81e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 -- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 msgr2=0x7fa7f80a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 0x7fa7f80a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 -- 172.21.15.121:0/2849276162 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40094a0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 0x7fa7f80a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7fd768700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c700 tx=0x7fa7e800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8005d70 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f81ea1b0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e80070d0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8007460 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.200+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f80ab700 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.201+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f8072a20 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.201+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7e80075c0 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.202+0000 7fa7ee7fc700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 0x7fa7dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.202+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7e8087870 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.202+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 0x7fa7dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.202+0000 7fa7fdf69700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 0x7fa7dc06c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097c0 tx=0x7fa7f401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.208+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa7f8072a20 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.407+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7f8072a20 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.408+0000 7fa7ee7fc700 1 -- 172.21.15.121:0/2849276162 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14627 (secure 0 0 0) 0x7fa7f8072a20 con 0x7fa7f80c1cf0 2023-08-18T20:43:40.409 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:40.409 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:39.542612+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 msgr2=0x7fa7dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 0x7fa7dc06c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097c0 tx=0x7fa7f401c040 comp rx=0 tx=0).stop 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 msgr2=0x7fa7f81e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c700 tx=0x7fa7e800cac0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 shutdown_connections 2023-08-18T20:43:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7f8157c10 0x7fa7f81e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7f806a510 0x7fa7f80a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa7dc06a0e0 0x7fa7dc06c5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 --2- 172.21.15.121:0/2849276162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7f80c1cf0 0x7fa7f81e9730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.410+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 >> 172.21.15.121:0/2849276162 conn(0x7fa7f80c6b10 msgr2=0x7fa7f80c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.411+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 shutdown_connections 2023-08-18T20:43:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.411+0000 7fa8001cd700 1 -- 172.21.15.121:0/2849276162 wait complete. 2023-08-18T20:43:40.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:43:40.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:43:40.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.549+0000 7fe2849db700 1 Processor -- start 2023-08-18T20:43:40.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.549+0000 7fe2849db700 1 -- start start 2023-08-18T20:43:40.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe2849db700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe2800c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe2849db700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe280152450 0x7fe2800c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe2849db700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2801529a0 con 0x7fe2801559c0 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe2849db700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe280152c80 con 0x7fe280152450 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe2849db700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe280152f60 con 0x7fe28006fd30 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe27ed9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe2801559c0 0x7fe28014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46442/0 (socket says 172.21.15.121:46442) 2023-08-18T20:43:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.550+0000 7fe27ed9d700 1 -- 172.21.15.121:0/2872077910 learned_addr learned my addr 172.21.15.121:0/2872077910 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2872077910 >> v2:172.21.15.122:3300/0 conn(0x7fe280152450 0x7fe2800c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27e59c700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe2800c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829540936 0 0) 0x7fe2801529a0 con 0x7fe2801559c0 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2680035b0 con 0x7fe2801559c0 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 433507826 0 0) 0x7fe2680035b0 con 0x7fe2801559c0 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 msgr2=0x7fe2800c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:40.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe2800c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 >> v2:172.21.15.122:3300/0 conn(0x7fe280152450 msgr2=0x7fe2800c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 --2- 172.21.15.121:0/2872077910 >> v2:172.21.15.122:3300/0 conn(0x7fe280152450 0x7fe2800c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280153240 con 0x7fe2801559c0 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fe270001670 con 0x7fe2801559c0 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 >> v1:172.21.15.121:6789/0 conn(0x7fe2801559c0 legacy=0x7fe28014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe268003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe268003f80 0x7fe268004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268004d90 0x7fe268005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280152c80 con 0x7fe268004d90 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280152f60 con 0x7fe268003f80 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26800ba60 con 0x7fe28006fd30 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe268003f80 0x7fe268004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27e59c700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe268003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27ed9d700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268004d90 0x7fe268005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27dd9b700 1 -- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 msgr2=0x7fe268003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:40.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.551+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe28006fd30 0x7fe268003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27dd9b700 1 -- 172.21.15.121:0/2872077910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268004d90 msgr2=0x7fe268005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:40.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268004d90 0x7fe268005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27dd9b700 1 -- 172.21.15.121:0/2872077910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2680035b0 con 0x7fe268003f80 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27ed9d700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268004d90 0x7fe268005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe268003f80 0x7fe268004850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b30 tx=0x7fe268005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5767b3efd50f33a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400e6c0 con 0x7fe268003f80 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27400e820 con 0x7fe268003f80 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27d59a700 1 -- 172.21.15.121:0/2872077910 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400eb90 con 0x7fe268003f80 2023-08-18T20:43:40.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe2849db700 1 -- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe268003f80 msgr2=0x7fe268004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe2849db700 1 --2- 172.21.15.121:0/2872077910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe268003f80 0x7fe268004850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b30 tx=0x7fe268005880 comp rx=0 tx=0).stop 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe27ed9d700 1 -- 172.21.15.121:0/2872077910 reap_dead start 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe2849db700 1 -- 172.21.15.121:0/2872077910 shutdown_connections 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.552+0000 7fe2849db700 1 -- 172.21.15.121:0/2872077910 >> 172.21.15.121:0/2872077910 conn(0x7fe2800c7bf0 msgr2=0x7fe2800c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.553+0000 7fe2849db700 1 -- 172.21.15.121:0/2872077910 shutdown_connections 2023-08-18T20:43:40.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.553+0000 7fe2849db700 1 -- 172.21.15.121:0/2872077910 wait complete. 2023-08-18T20:43:40.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.554+0000 7fe2849db700 1 Processor -- start 2023-08-18T20:43:40.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.554+0000 7fe2849db700 1 -- start start 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 0x7fe280148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 0x7fe2801547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801ea840 con 0x7fe268003f80 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801e7c50 con 0x7fe2801487c0 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe280148c40 con 0x7fe2800a8920 2023-08-18T20:43:40.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39868/0 (socket says 172.21.15.121:39868) 2023-08-18T20:43:40.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 -- 172.21.15.121:0/2717748766 learned_addr learned my addr 172.21.15.121:0/2717748766 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:40.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27ed9d700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 0x7fe2801547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 0x7fe280148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 -- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 msgr2=0x7fe280148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 0x7fe280148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 -- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 msgr2=0x7fe2801547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 0x7fe2801547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 -- 172.21.15.121:0/2717748766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2801eaa50 con 0x7fe268003f80 2023-08-18T20:43:40.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27ed9d700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 0x7fe2801547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:40.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 0x7fe280148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:40.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe27e59c700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe278011e60 tx=0x7fe27800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800e040 con 0x7fe268003f80 2023-08-18T20:43:40.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800f040 con 0x7fe268003f80 2023-08-18T20:43:40.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2801e7600 con 0x7fe268003f80 2023-08-18T20:43:40.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278015650 con 0x7fe268003f80 2023-08-18T20:43:40.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.555+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2800a9230 con 0x7fe268003f80 2023-08-18T20:43:40.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.556+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe280074730 con 0x7fe268003f80 2023-08-18T20:43:40.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.556+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2780157b0 con 0x7fe268003f80 2023-08-18T20:43:40.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.557+0000 7fe26effd700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 0x7fe26006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.557+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 0x7fe26006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.557+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe278088e40 con 0x7fe268003f80 2023-08-18T20:43:40.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.557+0000 7fe27dd9b700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 0x7fe26006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe274008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.561+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe278054860 con 0x7fe268003f80 2023-08-18T20:43:40.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.755+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2800c5580 con 0x7fe268003f80 2023-08-18T20:43:40.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.755+0000 7fe26effd700 1 -- 172.21.15.121:0/2717748766 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe278057e80 con 0x7fe268003f80 2023-08-18T20:43:40.756 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 msgr2=0x7fe26006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 0x7fe26006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe274008030 comp rx=0 tx=0).stop 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 msgr2=0x7fe280146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe278011e60 tx=0x7fe27800f490 comp rx=0 tx=0).stop 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 shutdown_connections 2023-08-18T20:43:40.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2801487c0 0x7fe2801547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe26006a0e0 0x7fe26006c5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe268003f80 0x7fe280146a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 --2- 172.21.15.121:0/2717748766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2800a8920 0x7fe280148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 >> 172.21.15.121:0/2717748766 conn(0x7fe2800c7bf0 msgr2=0x7fe280150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 shutdown_connections 2023-08-18T20:43:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.757+0000 7fe2849db700 1 -- 172.21.15.121:0/2717748766 wait complete. 2023-08-18T20:43:40.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:43:40.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.894+0000 7fc629026700 1 Processor -- start 2023-08-18T20:43:40.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.894+0000 7fc629026700 1 -- start start 2023-08-18T20:43:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc629026700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc6240c0c50 0x7fc62406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc629026700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240c4f40 con 0x7fc6240c5ae0 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc629026700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240c6120 con 0x7fc62406a7e0 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc629026700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6241551f0 con 0x7fc6240c0c50 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc62359e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc6240c5ae0 0x7fc624071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46462/0 (socket says 172.21.15.121:46462) 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc62359e700 1 -- 172.21.15.121:0/2886350573 learned_addr learned my addr 172.21.15.121:0/2886350573 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc622d9d700 1 --2- 172.21.15.121:0/2886350573 >> v2:172.21.15.121:3300/0 conn(0x7fc6240c0c50 0x7fc62406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc622d9d700 1 -- 172.21.15.121:0/2886350573 >> v1:172.21.15.122:6789/0 conn(0x7fc62406a7e0 legacy=0x7fc6240c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc622d9d700 1 -- 172.21.15.121:0/2886350573 >> v1:172.21.15.121:6789/0 conn(0x7fc6240c5ae0 legacy=0x7fc624071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc622d9d700 1 -- 172.21.15.121:0/2886350573 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240c63a0 con 0x7fc6240c0c50 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc621d9b700 1 -- 172.21.15.121:0/2886350573 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387711453 0 0) 0x7fc6240c6120 con 0x7fc62406a7e0 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc622d9d700 1 --2- 172.21.15.121:0/2886350573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6240c0c50 0x7fc62406a2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc618009840 tx=0x7fc618009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe801d58a010ddeb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.895+0000 7fc621d9b700 1 -- 172.21.15.121:0/2886350573 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618004230 con 0x7fc6240c0c50 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc621d9b700 1 -- 172.21.15.121:0/2886350573 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618004390 con 0x7fc6240c0c50 2023-08-18T20:43:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc621d9b700 1 -- 172.21.15.121:0/2886350573 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180036a0 con 0x7fc6240c0c50 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 -- 172.21.15.121:0/2886350573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6240c0c50 msgr2=0x7fc62406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 --2- 172.21.15.121:0/2886350573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6240c0c50 0x7fc62406a2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc618009840 tx=0x7fc618009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 -- 172.21.15.121:0/2886350573 shutdown_connections 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 --2- 172.21.15.121:0/2886350573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6240c0c50 0x7fc62406a2a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 -- 172.21.15.121:0/2886350573 >> 172.21.15.121:0/2886350573 conn(0x7fc6240c6b10 msgr2=0x7fc6240c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 -- 172.21.15.121:0/2886350573 shutdown_connections 2023-08-18T20:43:40.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.896+0000 7fc629026700 1 -- 172.21.15.121:0/2886350573 wait complete. 2023-08-18T20:43:40.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 Processor -- start 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 -- start start 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6240c0c50 0x7fc624155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 0x7fc62414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624158610 con 0x7fc62406a7e0 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240aa630 con 0x7fc6240c5ae0 2023-08-18T20:43:40.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc629026700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240aa880 con 0x7fc6240c0c50 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc622d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc622d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39882/0 (socket says 172.21.15.121:39882) 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.898+0000 7fc622d9d700 1 -- 172.21.15.121:0/2508847450 learned_addr learned my addr 172.21.15.121:0/2508847450 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc62359e700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 0x7fc62414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc62259c700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6240c0c50 0x7fc624155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 -- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6240c0c50 msgr2=0x7fc624155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6240c0c50 0x7fc624155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 -- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 msgr2=0x7fc62414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 0x7fc62414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 -- 172.21.15.121:0/2508847450 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180094a0 con 0x7fc62406a7e0 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc62359e700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 0x7fc62414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc622d9d700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6180090b0 tx=0x7fc618004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011830 con 0x7fc62406a7e0 2023-08-18T20:43:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61801f070 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6240aab60 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011bd0 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.899+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6241582a0 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.900+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624158430 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.901+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc618011d30 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.901+0000 7fc60b7fe700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 0x7fc61006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.901+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc618021070 con 0x7fc62406a7e0 2023-08-18T20:43:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.901+0000 7fc62259c700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 0x7fc61006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:40.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.901+0000 7fc62259c700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 0x7fc61006c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6241e7480 tx=0x7fc614009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:40.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:40.905+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc618055830 con 0x7fc62406a7e0 2023-08-18T20:43:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.104+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc624154e70 con 0x7fc62406a7e0 2023-08-18T20:43:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.105+0000 7fc60b7fe700 1 -- 172.21.15.121:0/2508847450 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc618058e50 con 0x7fc62406a7e0 2023-08-18T20:43:41.105 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:43:41.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.106+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 msgr2=0x7fc61006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.106+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 0x7fc61006c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6241e7480 tx=0x7fc614009040 comp rx=0 tx=0).stop 2023-08-18T20:43:41.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.106+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 msgr2=0x7fc6240ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.106+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6180090b0 tx=0x7fc618004750 comp rx=0 tx=0).stop 2023-08-18T20:43:41.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 shutdown_connections 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6240c5ae0 0x7fc62414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc61006a0e0 0x7fc61006c5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62406a7e0 0x7fc6240ab450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 --2- 172.21.15.121:0/2508847450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6240c0c50 0x7fc624155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 >> 172.21.15.121:0/2508847450 conn(0x7fc6240c6b10 msgr2=0x7fc6240a6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 shutdown_connections 2023-08-18T20:43:41.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.107+0000 7fc629026700 1 -- 172.21.15.121:0/2508847450 wait complete. 2023-08-18T20:43:41.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-18T20:43:41.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.239+0000 7f7f7cc2e700 1 Processor -- start 2023-08-18T20:43:41.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.239+0000 7f7f7cc2e700 1 -- start start 2023-08-18T20:43:41.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7cc2e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f78155070 0x7f7f780c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7cc2e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f780c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7cc2e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f781554d0 con 0x7f7f7814e6c0 2023-08-18T20:43:41.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7cc2e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7806e980 con 0x7f7f78155070 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7cc2e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806f920 con 0x7f7f780c8060 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f78155070 0x7f7f780c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f78155070 0x7f7f780c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39892/0 (socket says 172.21.15.121:39892) 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 -- 172.21.15.121:0/3883516166 learned_addr learned my addr 172.21.15.121:0/3883516166 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f76d9d700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f780c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 -- 172.21.15.121:0/3883516166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 msgr2=0x7f7f780c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f780c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 -- 172.21.15.121:0/3883516166 >> v1:172.21.15.121:6789/0 conn(0x7f7f7814e6c0 legacy=0x7f7f780a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f7559a700 1 -- 172.21.15.121:0/3883516166 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755994496 0 0) 0x7f7f781554d0 con 0x7f7f7814e6c0 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.240+0000 7f7f75d9b700 1 -- 172.21.15.121:0/3883516166 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7806eb60 con 0x7f7f78155070 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f75d9b700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c7b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0098f0 tx=0x7f7f6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17f3238e57a72bc server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7559a700 1 -- 172.21.15.121:0/3883516166 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00b8a0 con 0x7f7f78155070 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7559a700 1 -- 172.21.15.121:0/3883516166 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00ba00 con 0x7f7f78155070 2023-08-18T20:43:41.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7559a700 1 -- 172.21.15.121:0/3883516166 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00bd90 con 0x7f7f78155070 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/3883516166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 msgr2=0x7f7f780c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c7b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0098f0 tx=0x7f7f6c009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/3883516166 shutdown_connections 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f780c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/3883516166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c7b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/3883516166 >> 172.21.15.121:0/3883516166 conn(0x7f7f780a96a0 msgr2=0x7f7f780a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/3883516166 shutdown_connections 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.241+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/3883516166 wait complete. 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 Processor -- start 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 -- start start 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f781541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7814e6c0 0x7f7f78150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78151310 con 0x7f7f78155070 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781ea410 con 0x7f7f7814e6c0 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f7cc2e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781ea900 con 0x7f7f780c8060 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f76d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f76d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39900/0 (socket says 172.21.15.121:39900) 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.243+0000 7f7f76d9d700 1 -- 172.21.15.121:0/1654346218 learned_addr learned my addr 172.21.15.121:0/1654346218 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f75d9b700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7814e6c0 0x7f7f78150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f7659c700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f781541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 -- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 msgr2=0x7f7f781541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f781541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 -- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7814e6c0 msgr2=0x7f7f78150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7814e6c0 0x7f7f78150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 -- 172.21.15.121:0/1654346218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c009550 con 0x7f7f78155070 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f76d9d700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007e60 tx=0x7f7f7000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ecd0 con 0x7f7f78155070 2023-08-18T20:43:41.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000ee50 con 0x7f7f78155070 2023-08-18T20:43:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70014660 con 0x7f7f78155070 2023-08-18T20:43:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f78153ab0 con 0x7f7f78155070 2023-08-18T20:43:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.244+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f781586a0 con 0x7f7f78155070 2023-08-18T20:43:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.245+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f78154d70 con 0x7f7f78155070 2023-08-18T20:43:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.246+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f700147c0 con 0x7f7f78155070 2023-08-18T20:43:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.246+0000 7f7f66ffd700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 0x7f7f5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.246+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7f700887b0 con 0x7f7f78155070 2023-08-18T20:43:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.246+0000 7f7f7659c700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 0x7f7f5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.246+0000 7f7f7659c700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 0x7f7f5806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000f60 tx=0x7f7f68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.250+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7f70054280 con 0x7f7f78155070 2023-08-18T20:43:41.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.448+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7f7806f3d0 con 0x7f7f78155070 2023-08-18T20:43:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.448+0000 7f7f66ffd700 1 -- 172.21.15.121:0/1654346218 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7f700578a0 con 0x7f7f78155070 2023-08-18T20:43:41.449 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:41.449 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2023-08-18T20:43:41.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2023-08-18T20:43:41.450 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:43:41.451 INFO:teuthology.orchestra.run.smithi121.stdout:] 2023-08-18T20:43:41.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 msgr2=0x7f7f5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 0x7f7f5806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000f60 tx=0x7f7f68009040 comp rx=0 tx=0).stop 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 msgr2=0x7f7f780c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007e60 tx=0x7f7f7000e3c0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 shutdown_connections 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f5806a0e0 0x7f7f5806c5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f78155070 0x7f7f780c4940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f780c8060 0x7f7f781541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 --2- 172.21.15.121:0/1654346218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7814e6c0 0x7f7f78150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 >> 172.21.15.121:0/1654346218 conn(0x7f7f780a96a0 msgr2=0x7f7f780c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:41.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 shutdown_connections 2023-08-18T20:43:41.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.450+0000 7f7f7cc2e700 1 -- 172.21.15.121:0/1654346218 wait complete. 2023-08-18T20:43:41.463 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-18T20:43:41.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-18T20:43:41.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.592+0000 7f2f9b6cb700 1 Processor -- start 2023-08-18T20:43:41.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.592+0000 7f2f9b6cb700 1 -- start start 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f9b6cb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 0x7f2f940c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f9b6cb700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2f940abf10 0x7f2f94151690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f9b6cb700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f94066180 con 0x7f2f94151bd0 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f9b6cb700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f94066700 con 0x7f2f940abf10 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f9b6cb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94155410 con 0x7f2f940c1720 2023-08-18T20:43:41.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f98c66700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2f940abf10 0x7f2f94151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f99467700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 0x7f2f940c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f98c66700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2f940abf10 0x7f2f94151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:49742/0 (socket says 172.21.15.121:49742) 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f99467700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 0x7f2f940c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36314/0 (socket says 172.21.15.121:36314) 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f99c68700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2f94151bd0 0x7f2f9406a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55612/0 (socket says 172.21.15.121:55612) 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.593+0000 7f2f98c66700 1 -- 172.21.15.121:0/2895762493 learned_addr learned my addr 172.21.15.121:0/2895762493 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f98c66700 1 -- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 msgr2=0x7f2f940c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:41.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f98c66700 1 --2- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 0x7f2f940c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f98c66700 1 -- 172.21.15.121:0/2895762493 >> v1:172.21.15.122:6789/0 conn(0x7f2f94151bd0 legacy=0x7f2f9406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f98c66700 1 -- 172.21.15.121:0/2895762493 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94154e70 con 0x7f2f940abf10 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f8bfff700 1 -- 172.21.15.121:0/2895762493 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806405887 0 0) 0x7f2f94066180 con 0x7f2f94151bd0 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f98c66700 1 --2- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f940abf10 0x7f2f94151690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009920 tx=0x7f2f90009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec2ce058bbc9e779 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f8bfff700 1 -- 172.21.15.121:0/2895762493 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90011830 con 0x7f2f940abf10 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f8bfff700 1 -- 172.21.15.121:0/2895762493 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90011990 con 0x7f2f940abf10 2023-08-18T20:43:41.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f8bfff700 1 -- 172.21.15.121:0/2895762493 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90011d20 con 0x7f2f940abf10 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f940abf10 msgr2=0x7f2f94151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.594+0000 7f2f9b6cb700 1 --2- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f940abf10 0x7f2f94151690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009920 tx=0x7f2f90009c30 comp rx=0 tx=0).stop 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/2895762493 shutdown_connections 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 --2- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940c1720 0x7f2f940c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 --2- 172.21.15.121:0/2895762493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f940abf10 0x7f2f94151690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/2895762493 >> 172.21.15.121:0/2895762493 conn(0x7f2f9406bdc0 msgr2=0x7f2f9406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:41.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/2895762493 shutdown_connections 2023-08-18T20:43:41.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.595+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/2895762493 wait complete. 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 Processor -- start 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 -- start start 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940abf10 0x7f2f940c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f94151bd0 0x7f2f941e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940a9f90 con 0x7f2f940c1720 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940c4e90 con 0x7f2f94151bd0 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.596+0000 7f2f9b6cb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940aaf60 con 0x7f2f940abf10 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39912/0 (socket says 172.21.15.121:39912) 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 -- 172.21.15.121:0/503199218 learned_addr learned my addr 172.21.15.121:0/503199218 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f99467700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940abf10 0x7f2f940c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f99c68700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f94151bd0 0x7f2f941e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 -- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940abf10 msgr2=0x7f2f940c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940abf10 0x7f2f940c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 -- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f94151bd0 msgr2=0x7f2f941e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f94151bd0 0x7f2f941e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 -- 172.21.15.121:0/503199218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009550 con 0x7f2f940c1720 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f98c66700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f90014040 tx=0x7f2f90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900044d0 con 0x7f2f940c1720 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9001e070 con 0x7f2f940c1720 2023-08-18T20:43:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900038e0 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/503199218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f940c44c0 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.597+0000 7f2f9b6cb700 1 -- 172.21.15.121:0/503199218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f940a96c0 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.598+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f700052f0 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.599+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f90003a40 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.599+0000 7f2f89ffb700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 0x7f2f7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.599+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2f90088fa0 con 0x7f2f940c1720 2023-08-18T20:43:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.599+0000 7f2f99467700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 0x7f2f7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:41.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.600+0000 7f2f99467700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 0x7f2f7806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009be0 tx=0x7f2f84009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:41.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.604+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2f900bb940 con 0x7f2f940c1720 2023-08-18T20:43:41.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:41.801+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f70005640 con 0x7f2f940c1720 2023-08-18T20:43:42.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.590+0000 7f2f89ffb700 1 -- 172.21.15.121:0/503199218 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f900200b0 con 0x7f2f940c1720 2023-08-18T20:43:42.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 msgr2=0x7f2f7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 0x7f2f7806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009be0 tx=0x7f2f84009210 comp rx=0 tx=0).stop 2023-08-18T20:43:42.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 msgr2=0x7f2f940bf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f90014040 tx=0x7f2f90004750 comp rx=0 tx=0).stop 2023-08-18T20:43:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 shutdown_connections 2023-08-18T20:43:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f94151bd0 0x7f2f941e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f940abf10 0x7f2f940c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f7806a0e0 0x7f2f7806c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 --2- 172.21.15.121:0/503199218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f940c1720 0x7f2f940bf860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.593+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 >> 172.21.15.121:0/503199218 conn(0x7f2f9406bdc0 msgr2=0x7f2f941497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:42.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.594+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 shutdown_connections 2023-08-18T20:43:42.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.595+0000 7f2f777fe700 1 -- 172.21.15.121:0/503199218 wait complete. 2023-08-18T20:43:42.597 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2023-08-18T20:43:42.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-18T20:43:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.736+0000 7f8303ac1700 1 Processor -- start 2023-08-18T20:43:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.737+0000 7f8303ac1700 1 -- start start 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f8303ac1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f8303ac1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f8303ac1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82fc151be0 con 0x7f82fc0c2c80 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f8303ac1700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82fc14ed20 con 0x7f82fc0c6560 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f8303ac1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0c20d0 con 0x7f82fc0c6120 2023-08-18T20:43:42.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830105c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36328/0 (socket says 172.21.15.121:36328) 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830105c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:49758/0 (socket says 172.21.15.121:49758) 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830205e700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f82fc0c2c80 0x7f82fc0c4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55626/0 (socket says 172.21.15.121:55626) 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 -- 172.21.15.121:0/3835611354 learned_addr learned my addr 172.21.15.121:0/3835611354 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 -- 172.21.15.121:0/3835611354 >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 msgr2=0x7f82fc0bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:42.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 --2- 172.21.15.121:0/3835611354 >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.738+0000 7f830185d700 1 -- 172.21.15.121:0/3835611354 >> v1:172.21.15.122:6789/0 conn(0x7f82fc0c2c80 legacy=0x7f82fc0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830185d700 1 -- 172.21.15.121:0/3835611354 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0c23b0 con 0x7f82fc0c6120 2023-08-18T20:43:42.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830105c700 1 --2- 172.21.15.121:0/3835611354 >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:42.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830185d700 1 --2- 172.21.15.121:0/3835611354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1242e40f0209edb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:42.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830085b700 1 -- 172.21.15.121:0/3835611354 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011830 con 0x7f82fc0c6120 2023-08-18T20:43:42.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830085b700 1 -- 172.21.15.121:0/3835611354 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8011990 con 0x7f82fc0c6120 2023-08-18T20:43:42.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.739+0000 7f830085b700 1 -- 172.21.15.121:0/3835611354 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011d20 con 0x7f82fc0c6120 2023-08-18T20:43:42.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 -- 172.21.15.121:0/3835611354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 msgr2=0x7f82fc0bbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 --2- 172.21.15.121:0/3835611354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 -- 172.21.15.121:0/3835611354 shutdown_connections 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 --2- 172.21.15.121:0/3835611354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0bbd80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 --2- 172.21.15.121:0/3835611354 >> v2:172.21.15.122:3300/0 conn(0x7f82fc0c6560 0x7f82fc0bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 -- 172.21.15.121:0/3835611354 >> 172.21.15.121:0/3835611354 conn(0x7f82fc0c35a0 msgr2=0x7f82fc0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 -- 172.21.15.121:0/3835611354 shutdown_connections 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.740+0000 7f8303ac1700 1 -- 172.21.15.121:0/3835611354 wait complete. 2023-08-18T20:43:42.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.742+0000 7f8303ac1700 1 Processor -- start 2023-08-18T20:43:42.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.742+0000 7f8303ac1700 1 -- start start 2023-08-18T20:43:42.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0a76c0 con 0x7f82fc0c6560 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc153c10 con 0x7f82fc0c2c80 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f8303ac1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0c09d0 con 0x7f82fc0c6120 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830185d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830105c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830185d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:49762/0 (socket says 172.21.15.121:49762) 2023-08-18T20:43:42.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39928/0 (socket says 172.21.15.121:39928) 2023-08-18T20:43:42.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830105c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36336/0 (socket says 172.21.15.121:36336) 2023-08-18T20:43:42.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830185d700 1 -- 172.21.15.121:0/2000759757 learned_addr learned my addr 172.21.15.121:0/2000759757 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:42.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 -- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 msgr2=0x7f82fc0a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 -- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 msgr2=0x7f82fc0a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:42.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:42.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 -- 172.21.15.121:0/2000759757 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0094a0 con 0x7f82fc0c6560 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830105c700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830185d700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.743+0000 7f830205e700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82f4002230 tx=0x7f82f400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.744+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400a9e0 con 0x7f82fc0c6560 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.744+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400ab40 con 0x7f82fc0c6560 2023-08-18T20:43:42.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.744+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8009550 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.744+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4007070 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.744+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc0bed80 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.745+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc0c0ef0 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.745+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f82f40071d0 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.745+0000 7f82f27fc700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 0x7f82e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.746+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f82f4087d60 con 0x7f82fc0c6560 2023-08-18T20:43:42.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.746+0000 7f830185d700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 0x7f82e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:42.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.746+0000 7f830185d700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 0x7f82e006c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009130 tx=0x7f82f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:42.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.750+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f82f4053770 con 0x7f82fc0c6560 2023-08-18T20:43:42.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:42.969+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f82fc074730 con 0x7f82fc0c6560 2023-08-18T20:43:43.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.592+0000 7f82f27fc700 1 -- 172.21.15.121:0/2000759757 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f82f4017070 con 0x7f82fc0c6560 2023-08-18T20:43:43.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 msgr2=0x7f82e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 0x7f82e006c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009130 tx=0x7f82f8008030 comp rx=0 tx=0).stop 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 msgr2=0x7f82fc14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82f4002230 tx=0x7f82f400cd50 comp rx=0 tx=0).stop 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 shutdown_connections 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f82e006a0e0 0x7f82e006c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82fc0c6560 0x7f82fc14ae70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82fc0c2c80 0x7f82fc0a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 --2- 172.21.15.121:0/2000759757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82fc0c6120 0x7f82fc0a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 >> 172.21.15.121:0/2000759757 conn(0x7f82fc0c35a0 msgr2=0x7f82fc0712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 shutdown_connections 2023-08-18T20:43:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.597+0000 7f8303ac1700 1 -- 172.21.15.121:0/2000759757 wait complete. 2023-08-18T20:43:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2023-08-18T20:43:43.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-18T20:43:43.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.740+0000 7f6d7254e700 1 Processor -- start 2023-08-18T20:43:43.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.740+0000 7f6d7254e700 1 -- start start 2023-08-18T20:43:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d7254e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d6c14e950 0x7f6d6c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d7254e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6d6c14ed30 0x7f6d6c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d7254e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c0c2260 con 0x7f6d6c0c19d0 2023-08-18T20:43:43.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d7254e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a6630 con 0x7f6d6c14e950 2023-08-18T20:43:43.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d7254e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c151d90 con 0x7f6d6c14ed30 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d6c14e950 0x7f6d6c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d70aeb700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6d6c0c19d0 0x7f6d6c0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46518/0 (socket says 172.21.15.121:46518) 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d70aeb700 1 -- 172.21.15.121:0/3779341980 learned_addr learned my addr 172.21.15.121:0/3779341980 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6b7fe700 1 --2- 172.21.15.121:0/3779341980 >> v2:172.21.15.122:3300/0 conn(0x7f6d6c14ed30 0x7f6d6c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 -- 172.21.15.121:0/3779341980 >> v2:172.21.15.122:3300/0 conn(0x7f6d6c14ed30 msgr2=0x7f6d6c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:43.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 --2- 172.21.15.121:0/3779341980 >> v2:172.21.15.122:3300/0 conn(0x7f6d6c14ed30 0x7f6d6c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 -- 172.21.15.121:0/3779341980 >> v1:172.21.15.121:6789/0 conn(0x7f6d6c0c19d0 legacy=0x7f6d6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 -- 172.21.15.121:0/3779341980 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c152070 con 0x7f6d6c14e950 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6bfff700 1 --2- 172.21.15.121:0/3779341980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0c2ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0c7ba0 tx=0x7f6d5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ea8ca1c7c6f6b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6affd700 1 -- 172.21.15.121:0/3779341980 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011830 con 0x7f6d6c14e950 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6affd700 1 -- 172.21.15.121:0/3779341980 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c011990 con 0x7f6d6c14e950 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.741+0000 7f6d6affd700 1 -- 172.21.15.121:0/3779341980 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011d20 con 0x7f6d6c14e950 2023-08-18T20:43:43.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 -- 172.21.15.121:0/3779341980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 msgr2=0x7f6d6c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 --2- 172.21.15.121:0/3779341980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0c2ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0c7ba0 tx=0x7f6d5c009b20 comp rx=0 tx=0).stop 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 -- 172.21.15.121:0/3779341980 shutdown_connections 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 --2- 172.21.15.121:0/3779341980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0c2ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 --2- 172.21.15.121:0/3779341980 >> v2:172.21.15.122:3300/0 conn(0x7f6d6c14ed30 0x7f6d6c0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 -- 172.21.15.121:0/3779341980 >> 172.21.15.121:0/3779341980 conn(0x7f6d6c0c6b10 msgr2=0x7f6d6c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 -- 172.21.15.121:0/3779341980 shutdown_connections 2023-08-18T20:43:43.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.742+0000 7f6d7254e700 1 -- 172.21.15.121:0/3779341980 wait complete. 2023-08-18T20:43:43.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.743+0000 7f6d7254e700 1 Processor -- start 2023-08-18T20:43:43.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.743+0000 7f6d7254e700 1 -- start start 2023-08-18T20:43:43.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d6c0c19d0 0x7f6d6c0a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d6c14ed30 0x7f6d6c0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0acc00 con 0x7f6d6c14e950 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a5dd0 con 0x7f6d6c14ed30 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d7254e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1467a0 con 0x7f6d6c0c19d0 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39940/0 (socket says 172.21.15.121:39940) 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 -- 172.21.15.121:0/2467533857 learned_addr learned my addr 172.21.15.121:0/2467533857 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:43.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6bfff700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d6c0c19d0 0x7f6d6c0a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d70aeb700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d6c14ed30 0x7f6d6c0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 -- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d6c0c19d0 msgr2=0x7f6d6c0a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d6c0c19d0 0x7f6d6c0a7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 -- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d6c14ed30 msgr2=0x7f6d6c0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d6c14ed30 0x7f6d6c0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 -- 172.21.15.121:0/2467533857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0094a0 con 0x7f6d6c14e950 2023-08-18T20:43:43.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.744+0000 7f6d6b7fe700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000d800 tx=0x7f6d6000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:43.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.745+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600125f0 con 0x7f6d6c14e950 2023-08-18T20:43:43.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.745+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60012750 con 0x7f6d6c14e950 2023-08-18T20:43:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.745+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0a9fd0 con 0x7f6d6c14e950 2023-08-18T20:43:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.745+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60012b00 con 0x7f6d6c14e950 2023-08-18T20:43:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.745+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0ac920 con 0x7f6d6c14e950 2023-08-18T20:43:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.746+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0a9da0 con 0x7f6d6c14e950 2023-08-18T20:43:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.746+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6d60012c60 con 0x7f6d6c14e950 2023-08-18T20:43:43.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.747+0000 7f6d68ff9700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 0x7f6d5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:43.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.747+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6d60088450 con 0x7f6d6c14e950 2023-08-18T20:43:43.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.747+0000 7f6d6bfff700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 0x7f6d5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:43.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.747+0000 7f6d6bfff700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 0x7f6d5806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0090b0 tx=0x7f6d5c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:43.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.751+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6d6c0a9da0 con 0x7f6d6c14e950 2023-08-18T20:43:43.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:43.993+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d6c0aa160 con 0x7f6d6c14e950 2023-08-18T20:43:44.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.599+0000 7f6d68ff9700 1 -- 172.21.15.121:0/2467533857 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6d60053ce0 con 0x7f6d6c14e950 2023-08-18T20:43:44.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.605+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 msgr2=0x7f6d5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.605+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 0x7f6d5806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0090b0 tx=0x7f6d5c008030 comp rx=0 tx=0).stop 2023-08-18T20:43:44.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.605+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 msgr2=0x7f6d6c0a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.605+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000d800 tx=0x7f6d6000db10 comp rx=0 tx=0).stop 2023-08-18T20:43:44.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 shutdown_connections 2023-08-18T20:43:44.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d6c14ed30 0x7f6d6c0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d6c0c19d0 0x7f6d6c0a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a0e0 0x7f6d5806c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 --2- 172.21.15.121:0/2467533857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6c14e950 0x7f6d6c0a7670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.606+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 >> 172.21.15.121:0/2467533857 conn(0x7f6d6c0c6b10 msgr2=0x7f6d6c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:44.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.607+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 shutdown_connections 2023-08-18T20:43:44.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.607+0000 7f6d7254e700 1 -- 172.21.15.121:0/2467533857 wait complete. 2023-08-18T20:43:44.622 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 3 and data pool 4 2023-08-18T20:43:44.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:44.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 Processor -- start 2023-08-18T20:43:44.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 -- start start 2023-08-18T20:43:44.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7340bd5a0 0x7ff7340c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:44.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7341588f0 con 0x7ff7340c60c0 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff734157b30 con 0x7ff7341544a0 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.751+0000 7ff7390dd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff734155040 con 0x7ff7340bd5a0 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff73259c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7340bd5a0 0x7ff7340c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff732d9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff7340c60c0 0x7ff73406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46540/0 (socket says 172.21.15.121:46540) 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff732d9d700 1 -- 172.21.15.121:0/2811543378 learned_addr learned my addr 172.21.15.121:0/2811543378 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff731d9b700 1 -- 172.21.15.121:0/2811543378 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259992984 0 0) 0x7ff7341588f0 con 0x7ff7340c60c0 2023-08-18T20:43:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff731d9b700 1 -- 172.21.15.121:0/2811543378 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71c0035b0 con 0x7ff7340c60c0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff73259c700 1 -- 172.21.15.121:0/2811543378 >> v1:172.21.15.122:6789/0 conn(0x7ff7341544a0 legacy=0x7ff734154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff73259c700 1 -- 172.21.15.121:0/2811543378 >> v1:172.21.15.121:6789/0 conn(0x7ff7340c60c0 legacy=0x7ff73406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff73259c700 1 -- 172.21.15.121:0/2811543378 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff734157e10 con 0x7ff7340bd5a0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff73259c700 1 --2- 172.21.15.121:0/2811543378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340bd5a0 0x7ff7340c64a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff728009840 tx=0x7ff728009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c515e8032e11f484 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff731d9b700 1 -- 172.21.15.121:0/2811543378 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728011830 con 0x7ff7340bd5a0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff731d9b700 1 -- 172.21.15.121:0/2811543378 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728011990 con 0x7ff7340bd5a0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.752+0000 7ff731d9b700 1 -- 172.21.15.121:0/2811543378 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728011d20 con 0x7ff7340bd5a0 2023-08-18T20:43:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 -- 172.21.15.121:0/2811543378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340bd5a0 msgr2=0x7ff7340c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 --2- 172.21.15.121:0/2811543378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340bd5a0 0x7ff7340c64a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff728009840 tx=0x7ff728009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 -- 172.21.15.121:0/2811543378 shutdown_connections 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 --2- 172.21.15.121:0/2811543378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340bd5a0 0x7ff7340c64a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 -- 172.21.15.121:0/2811543378 >> 172.21.15.121:0/2811543378 conn(0x7ff7340c35a0 msgr2=0x7ff7340c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 -- 172.21.15.121:0/2811543378 shutdown_connections 2023-08-18T20:43:44.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.753+0000 7ff7390dd700 1 -- 172.21.15.121:0/2811543378 wait complete. 2023-08-18T20:43:44.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.754+0000 7ff7390dd700 1 Processor -- start 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.754+0000 7ff7390dd700 1 -- start start 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7340bd5a0 0x7ff7341ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7341544a0 0x7ff7341e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341e9a00 con 0x7ff7340c60c0 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341edd20 con 0x7ff7341544a0 2023-08-18T20:43:44.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff7390dd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c5200 con 0x7ff7340bd5a0 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39966/0 (socket says 172.21.15.121:39966) 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 -- 172.21.15.121:0/4086225241 learned_addr learned my addr 172.21.15.121:0/4086225241 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff732d9d700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7340bd5a0 0x7ff7341ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73359e700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7341544a0 0x7ff7341e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 -- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7340bd5a0 msgr2=0x7ff7341ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7340bd5a0 0x7ff7341ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 -- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7341544a0 msgr2=0x7ff7341e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7341544a0 0x7ff7341e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.755+0000 7ff73259c700 1 -- 172.21.15.121:0/4086225241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280094a0 con 0x7ff7340c60c0 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff73259c700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7280090b0 tx=0x7ff728004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280036a0 con 0x7ff7340c60c0 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72801f070 con 0x7ff7340c60c0 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73414f310 con 0x7ff7340c60c0 2023-08-18T20:43:44.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728003a60 con 0x7ff7340c60c0 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.756+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73414f8d0 con 0x7ff7340c60c0 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.757+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7341e9b70 con 0x7ff7340c60c0 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.758+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff728003bc0 con 0x7ff7340c60c0 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.758+0000 7ff71b7fe700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 0x7ff72006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.758+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff728021070 con 0x7ff7340c60c0 2023-08-18T20:43:44.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.758+0000 7ff732d9d700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 0x7ff72006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:44.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.759+0000 7ff732d9d700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 0x7ff72006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff724007fd0 tx=0x7ff724007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:44.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.762+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff7280555a0 con 0x7ff7340c60c0 2023-08-18T20:43:44.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.962+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7341e9b40 con 0x7ff7340c60c0 2023-08-18T20:43:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.964+0000 7ff71b7fe700 1 -- 172.21.15.121:0/4086225241 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18282 (secure 0 0 0) 0x7ff728015090 con 0x7ff7340c60c0 2023-08-18T20:43:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:44.965 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":21,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:43.995109+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 msgr2=0x7ff72006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 0x7ff72006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff724007fd0 tx=0x7ff724007dc0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 msgr2=0x7ff73414d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7280090b0 tx=0x7ff728004750 comp rx=0 tx=0).stop 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 shutdown_connections 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7341544a0 0x7ff7341e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7340bd5a0 0x7ff7341ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff72006a0e0 0x7ff72006c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 --2- 172.21.15.121:0/4086225241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340c60c0 0x7ff73414d660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 >> 172.21.15.121:0/4086225241 conn(0x7ff7340c35a0 msgr2=0x7ff734153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:44.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 shutdown_connections 2023-08-18T20:43:44.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:44.966+0000 7ff7390dd700 1 -- 172.21.15.121:0/4086225241 wait complete. 2023-08-18T20:43:44.980 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:45.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.101+0000 7f95a8d29700 1 Processor -- start 2023-08-18T20:43:45.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.101+0000 7f95a8d29700 1 -- start start 2023-08-18T20:43:45.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.102+0000 7f95a8d29700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95a406b520 0x7f95a4072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.102+0000 7f95a8d29700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a4066380 con 0x7f95a4152d30 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.102+0000 7f95a8d29700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a41531b0 con 0x7f95a4155820 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.102+0000 7f95a8d29700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a4066080 con 0x7f95a406b520 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f95a4152d30 0x7f95a414f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46556/0 (socket says 172.21.15.121:46556) 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 -- 172.21.15.121:0/3608254875 learned_addr learned my addr 172.21.15.121:0/3608254875 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a259c700 1 --2- 172.21.15.121:0/3608254875 >> v2:172.21.15.122:3300/0 conn(0x7f95a406b520 0x7f95a4072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756491148 0 0) 0x7f95a4066380 con 0x7f95a4152d30 2023-08-18T20:43:45.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c0035b0 con 0x7f95a4152d30 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356218976 0 0) 0x7f958c0035b0 con 0x7f95a4152d30 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 >> v2:172.21.15.122:3300/0 conn(0x7f95a406b520 msgr2=0x7f95a4072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 --2- 172.21.15.121:0/3608254875 >> v2:172.21.15.122:3300/0 conn(0x7f95a406b520 0x7f95a4072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 >> v1:172.21.15.122:6789/0 conn(0x7f95a4155820 legacy=0x7f95a4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a406d0f0 con 0x7f95a4152d30 2023-08-18T20:43:45.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f95980017f0 con 0x7f95a4152d30 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 >> v1:172.21.15.121:6789/0 conn(0x7f95a4152d30 legacy=0x7f95a414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f958c003a70 0x7f958c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f958c005330 0x7f958c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a4066080 con 0x7f958c004850 2023-08-18T20:43:45.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00c1e0 con 0x7f958c005330 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00c3a0 con 0x7f958c003a70 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a259c700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f958c003a70 0x7f958c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a2d9d700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f958c005330 0x7f958c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 -- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f958c003a70 msgr2=0x7f958c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:45.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f958c003a70 0x7f958c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 -- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f958c005330 msgr2=0x7f958c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:45.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f958c005330 0x7f958c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a2d9d700 1 -- 172.21.15.121:0/3608254875 reap_dead start 2023-08-18T20:43:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a1d9b700 1 -- 172.21.15.121:0/3608254875 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0035b0 con 0x7f958c004850 2023-08-18T20:43:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.103+0000 7f95a259c700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f958c003a70 0x7f958c003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f958c004cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f959800c210 tx=0x7f958c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b952348422a5c716 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598007bd0 con 0x7f958c004850 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800cdd0 con 0x7f958c004850 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a159a700 1 -- 172.21.15.121:0/3608254875 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598007310 con 0x7f958c004850 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 -- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 msgr2=0x7f958c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f958c004cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f959800c210 tx=0x7f958c005880 comp rx=0 tx=0).stop 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 -- 172.21.15.121:0/3608254875 shutdown_connections 2023-08-18T20:43:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 --2- 172.21.15.121:0/3608254875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 -- 172.21.15.121:0/3608254875 >> 172.21.15.121:0/3608254875 conn(0x7f95a40c2ca0 msgr2=0x7f95a40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 -- 172.21.15.121:0/3608254875 shutdown_connections 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.104+0000 7f95a8d29700 1 -- 172.21.15.121:0/3608254875 wait complete. 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 Processor -- start 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 -- start start 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 0x7f95a4142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a4143110 0x7f95a41435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41ecd20 con 0x7f958c004850 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41ecf70 con 0x7f95a4141e10 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.106+0000 7f95a8d29700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41ed250 con 0x7f95a4143110 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39984/0 (socket says 172.21.15.121:39984) 2023-08-18T20:43:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 -- 172.21.15.121:0/733004394 learned_addr learned my addr 172.21.15.121:0/733004394 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 0x7f95a4142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a2d9d700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a4143110 0x7f95a41435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 -- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a4143110 msgr2=0x7f95a41435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a4143110 0x7f95a41435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 -- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 msgr2=0x7f95a4142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 0x7f95a4142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 -- 172.21.15.121:0/733004394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a41ed530 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 0x7f95a4142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a259c700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9594011590 tx=0x7f9594011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594004220 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594004380 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a41ed810 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940036a0 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.107+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a4150120 con 0x7f958c004850 2023-08-18T20:43:45.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.108+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a4074730 con 0x7f958c004850 2023-08-18T20:43:45.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.109+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9594003800 con 0x7f958c004850 2023-08-18T20:43:45.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.109+0000 7f9592ffd700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 0x7f958406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.109+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 0x7f958406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.109+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9594088810 con 0x7f958c004850 2023-08-18T20:43:45.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.109+0000 7f95a1d9b700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 0x7f958406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9598000ef0 tx=0x7f959800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.114+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9594053f90 con 0x7f958c004850 2023-08-18T20:43:45.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.309+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95a40c2340 con 0x7f958c004850 2023-08-18T20:43:45.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.310+0000 7f9592ffd700 1 -- 172.21.15.121:0/733004394 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f95940575b0 con 0x7f958c004850 2023-08-18T20:43:45.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:45.312 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":21,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:43.995109+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.312+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 msgr2=0x7f958406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.312+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 0x7f958406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9598000ef0 tx=0x7f959800a000 comp rx=0 tx=0).stop 2023-08-18T20:43:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.312+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 msgr2=0x7f95a40bf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.312+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9594011590 tx=0x7f9594011950 comp rx=0 tx=0).stop 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 shutdown_connections 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a4143110 0x7f95a41435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f958406a0e0 0x7f958406c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f958c004850 0x7f95a40bf7c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 --2- 172.21.15.121:0/733004394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a4141e10 0x7f95a4142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 >> 172.21.15.121:0/733004394 conn(0x7f95a40c2ca0 msgr2=0x7f95a41492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:45.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 shutdown_connections 2023-08-18T20:43:45.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.313+0000 7f95a8d29700 1 -- 172.21.15.121:0/733004394 wait complete. 2023-08-18T20:43:45.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-18T20:43:45.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.452+0000 7fb855113700 1 Processor -- start 2023-08-18T20:43:45.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.452+0000 7fb855113700 1 -- start start 2023-08-18T20:43:45.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb855113700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb8501585a0 0x7fb8500c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb855113700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb850155370 con 0x7fb8500c7380 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb855113700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500c7760 con 0x7fb8500a6ed0 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb855113700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500c4390 con 0x7fb8501585a0 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84ed9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb8500c7380 0x7fb85006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46574/0 (socket says 172.21.15.121:46574) 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84ed9d700 1 -- 172.21.15.121:0/613324000 learned_addr learned my addr 172.21.15.121:0/613324000 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84f59e700 1 --2- 172.21.15.121:0/613324000 >> v2:172.21.15.122:3300/0 conn(0x7fb8501585a0 0x7fb8500c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042486314 0 0) 0x7fb850155370 con 0x7fb8500c7380 2023-08-18T20:43:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8380035b0 con 0x7fb8500c7380 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.453+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145094957 0 0) 0x7fb8500c7760 con 0x7fb8500a6ed0 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850155370 con 0x7fb8500a6ed0 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84f59e700 1 -- 172.21.15.121:0/613324000 >> v1:172.21.15.122:6789/0 conn(0x7fb8500a6ed0 legacy=0x7fb8500c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84f59e700 1 -- 172.21.15.121:0/613324000 >> v1:172.21.15.121:6789/0 conn(0x7fb8500c7380 legacy=0x7fb85006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84f59e700 1 -- 172.21.15.121:0/613324000 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850154760 con 0x7fb8501585a0 2023-08-18T20:43:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84f59e700 1 --2- 172.21.15.121:0/613324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8500c3e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb848009d90 tx=0x7fb84800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93b758678579e2a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800e070 con 0x7fb8501585a0 2023-08-18T20:43:45.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800bb20 con 0x7fb8501585a0 2023-08-18T20:43:45.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.454+0000 7fb84dd9b700 1 -- 172.21.15.121:0/613324000 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848012430 con 0x7fb8501585a0 2023-08-18T20:43:45.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 -- 172.21.15.121:0/613324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 msgr2=0x7fb8500c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 --2- 172.21.15.121:0/613324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8500c3e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb848009d90 tx=0x7fb84800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:45.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 -- 172.21.15.121:0/613324000 shutdown_connections 2023-08-18T20:43:45.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 --2- 172.21.15.121:0/613324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8500c3e50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 -- 172.21.15.121:0/613324000 >> 172.21.15.121:0/613324000 conn(0x7fb8500c7bf0 msgr2=0x7fb8500c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 -- 172.21.15.121:0/613324000 shutdown_connections 2023-08-18T20:43:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.455+0000 7fb855113700 1 -- 172.21.15.121:0/613324000 wait complete. 2023-08-18T20:43:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.457+0000 7fb855113700 1 Processor -- start 2023-08-18T20:43:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.457+0000 7fb855113700 1 -- start start 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500c7380 0x7fb8501e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8501e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8501e9460 con 0x7fb8500a6ed0 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850157370 con 0x7fb8501585a0 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb855113700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c14b0 con 0x7fb8500c7380 2023-08-18T20:43:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb84ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb84ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39998/0 (socket says 172.21.15.121:39998) 2023-08-18T20:43:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb84ed9d700 1 -- 172.21.15.121:0/2927300663 learned_addr learned my addr 172.21.15.121:0/2927300663 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb84f59e700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8501e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.458+0000 7fb84e59c700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500c7380 0x7fb8501e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 -- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500c7380 msgr2=0x7fb8501e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500c7380 0x7fb8501e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 -- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 msgr2=0x7fb8501e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8501e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 -- 172.21.15.121:0/2927300663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009a70 con 0x7fb8500a6ed0 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb84ed9d700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c4d0 tx=0x7fb84000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000cea0 con 0x7fb8500a6ed0 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840005d70 con 0x7fb8500a6ed0 2023-08-18T20:43:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500c1700 con 0x7fb8500a6ed0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400072f0 con 0x7fb8500a6ed0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.459+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500befa0 con 0x7fb8500a6ed0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.460+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850074730 con 0x7fb8500a6ed0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.460+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb840007450 con 0x7fb8500a6ed0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.461+0000 7fb8377fe700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 0x7fb83c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.461+0000 7fb84e59c700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 0x7fb83c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.461+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb840087860 con 0x7fb8500a6ed0 2023-08-18T20:43:45.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.461+0000 7fb84e59c700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 0x7fb83c06c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8500a6dc0 tx=0x7fb844009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:45.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.465+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb840052fe0 con 0x7fb8500a6ed0 2023-08-18T20:43:45.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:45.711+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb8500c5580 con 0x7fb8500a6ed0 2023-08-18T20:43:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.612+0000 7fb8377fe700 1 -- 172.21.15.121:0/2927300663 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb840056600 con 0x7fb8500a6ed0 2023-08-18T20:43:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.614+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 msgr2=0x7fb83c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.614+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 0x7fb83c06c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8500a6dc0 tx=0x7fb844009040 comp rx=0 tx=0).stop 2023-08-18T20:43:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.614+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 msgr2=0x7fb85006b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.614+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c4d0 tx=0x7fb84000c7e0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 shutdown_connections 2023-08-18T20:43:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8501585a0 0x7fb8501e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb83c06a0e0 0x7fb83c06c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8500a6ed0 0x7fb85006b620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 --2- 172.21.15.121:0/2927300663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500c7380 0x7fb8501e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 >> 172.21.15.121:0/2927300663 conn(0x7fb8500c7bf0 msgr2=0x7fb8500a96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:46.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 shutdown_connections 2023-08-18T20:43:46.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.615+0000 7fb855113700 1 -- 172.21.15.121:0/2927300663 wait complete. 2023-08-18T20:43:46.627 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-18T20:43:46.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-18T20:43:46.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.751+0000 7f7dfe454700 1 Processor -- start 2023-08-18T20:43:46.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 -- start start 2023-08-18T20:43:46.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7df814ed30 0x7f7df80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 0x7f7df80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80a6630 con 0x7f7df814ed30 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80c2260 con 0x7f7df80c19d0 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7dfe454700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8151d90 con 0x7f7df814e950 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7df77fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7df814ed30 0x7f7df80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7df77fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7df814ed30 0x7f7df80c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40008/0 (socket says 172.21.15.121:40008) 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.752+0000 7f7df77fe700 1 -- 172.21.15.121:0/3070543596 learned_addr learned my addr 172.21.15.121:0/3070543596 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df7fff700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7dfc9f1700 1 --2- 172.21.15.121:0/3070543596 >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 0x7f7df80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 -- 172.21.15.121:0/3070543596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 msgr2=0x7f7df80c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df80c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 -- 172.21.15.121:0/3070543596 >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 msgr2=0x7f7df80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 --2- 172.21.15.121:0/3070543596 >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 0x7f7df80c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 -- 172.21.15.121:0/3070543596 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8152070 con 0x7f7df814ed30 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df7fff700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df80c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7dfc9f1700 1 --2- 172.21.15.121:0/3070543596 >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 0x7f7df80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df77fe700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df80c1490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7df8068540 tx=0x7f7dec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a378ede6247260 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df6ffd700 1 -- 172.21.15.121:0/3070543596 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00b870 con 0x7f7df814ed30 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df6ffd700 1 -- 172.21.15.121:0/3070543596 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00b9d0 con 0x7f7df814ed30 2023-08-18T20:43:46.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.753+0000 7f7df6ffd700 1 -- 172.21.15.121:0/3070543596 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00bd60 con 0x7f7df814ed30 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 -- 172.21.15.121:0/3070543596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 msgr2=0x7f7df80c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df80c1490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7df8068540 tx=0x7f7dec009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 -- 172.21.15.121:0/3070543596 shutdown_connections 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 --2- 172.21.15.121:0/3070543596 >> v2:172.21.15.122:3300/0 conn(0x7f7df80c19d0 0x7f7df80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df80c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 --2- 172.21.15.121:0/3070543596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df80c1490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 -- 172.21.15.121:0/3070543596 >> 172.21.15.121:0/3070543596 conn(0x7f7df80c6b10 msgr2=0x7f7df80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:46.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 -- 172.21.15.121:0/3070543596 shutdown_connections 2023-08-18T20:43:46.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.754+0000 7f7dfe454700 1 -- 172.21.15.121:0/3070543596 wait complete. 2023-08-18T20:43:46.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.755+0000 7f7dfe454700 1 Processor -- start 2023-08-18T20:43:46.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.755+0000 7f7dfe454700 1 -- start start 2023-08-18T20:43:46.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7df80c19d0 0x7f7df806a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df814be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df814fdc0 con 0x7f7df814ed30 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8150c00 con 0x7f7df80c19d0 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df814fff0 con 0x7f7df814e950 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40016/0 (socket says 172.21.15.121:40016) 2023-08-18T20:43:46.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 -- 172.21.15.121:0/2154010405 learned_addr learned my addr 172.21.15.121:0/2154010405 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7df7fff700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7df80c19d0 0x7f7df806a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7df77fe700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df814be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 -- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 msgr2=0x7f7df814be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df814be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 -- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7df80c19d0 msgr2=0x7f7df806a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7df80c19d0 0x7f7df806a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:46.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 -- 172.21.15.121:0/2154010405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009550 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfc9f1700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df0007e10 tx=0x7f7df000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000dd20 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000f040 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0003c60 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.756+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df81502d0 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.757+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8150890 con 0x7f7df814ed30 2023-08-18T20:43:46.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.757+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df8074730 con 0x7f7df814ed30 2023-08-18T20:43:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.758+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7df0004030 con 0x7f7df814ed30 2023-08-18T20:43:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.758+0000 7f7df4ff9700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 0x7f7de406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.758+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7df0088560 con 0x7f7df814ed30 2023-08-18T20:43:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.758+0000 7f7df7fff700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 0x7f7de406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.759+0000 7f7df7fff700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 0x7f7de406c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7de8006f10 tx=0x7f7de8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:46.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:46.767+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7df0053c50 con 0x7f7df814ed30 2023-08-18T20:43:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.011+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7df806aa50 con 0x7f7df814ed30 2023-08-18T20:43:47.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.620+0000 7f7df4ff9700 1 -- 172.21.15.121:0/2154010405 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7df0057270 con 0x7f7df814ed30 2023-08-18T20:43:47.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 msgr2=0x7f7de406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 0x7f7de406c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7de8006f10 tx=0x7f7de8008040 comp rx=0 tx=0).stop 2023-08-18T20:43:47.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 msgr2=0x7f7df814c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df0007e10 tx=0x7f7df000d3b0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 shutdown_connections 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7de406a0e0 0x7f7de406c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7df814ed30 0x7f7df814c3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7df80c19d0 0x7f7df806a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 --2- 172.21.15.121:0/2154010405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7df814e950 0x7f7df814be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.622+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 >> 172.21.15.121:0/2154010405 conn(0x7f7df80c6b10 msgr2=0x7f7df80a8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:47.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.623+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 shutdown_connections 2023-08-18T20:43:47.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.623+0000 7f7dfe454700 1 -- 172.21.15.121:0/2154010405 wait complete. 2023-08-18T20:43:47.635 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-18T20:43:47.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:43:47.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.758+0000 7f31e5228700 1 Processor -- start 2023-08-18T20:43:47.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.758+0000 7f31e5228700 1 -- start start 2023-08-18T20:43:47.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31e5228700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 0x7f31e00c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31e5228700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31e00a71f0 0x7f31e00c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31e5228700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e0152200 con 0x7f31e0152fa0 2023-08-18T20:43:47.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31e5228700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00aa740 con 0x7f31e00a71f0 2023-08-18T20:43:47.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31e5228700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e01565c0 con 0x7f31e00c4170 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31de59c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f31e0152fa0 0x7f31e00c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46604/0 (socket says 172.21.15.121:46604) 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31df59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31e00a71f0 0x7f31e00c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31de59c700 1 -- 172.21.15.121:0/3905613237 learned_addr learned my addr 172.21.15.121:0/3905613237 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.759+0000 7f31ded9d700 1 --2- 172.21.15.121:0/3905613237 >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 0x7f31e00c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31df59e700 1 -- 172.21.15.121:0/3905613237 >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 msgr2=0x7f31e00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31df59e700 1 --2- 172.21.15.121:0/3905613237 >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 0x7f31e00c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31df59e700 1 -- 172.21.15.121:0/3905613237 >> v1:172.21.15.121:6789/0 conn(0x7f31e0152fa0 legacy=0x7f31e00c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31df59e700 1 -- 172.21.15.121:0/3905613237 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e01524c0 con 0x7f31e00a71f0 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31ded9d700 1 --2- 172.21.15.121:0/3905613237 >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 0x7f31e00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31df59e700 1 --2- 172.21.15.121:0/3905613237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00a71f0 0x7f31e00c62a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31e006e0e0 tx=0x7f31d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2411a42b74a79f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31ddd9b700 1 -- 172.21.15.121:0/3905613237 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800e070 con 0x7f31e00a71f0 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31ddd9b700 1 -- 172.21.15.121:0/3905613237 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800bbd0 con 0x7f31e00a71f0 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31ddd9b700 1 -- 172.21.15.121:0/3905613237 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8012430 con 0x7f31e00a71f0 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 -- 172.21.15.121:0/3905613237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00a71f0 msgr2=0x7f31e00c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 --2- 172.21.15.121:0/3905613237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00a71f0 0x7f31e00c62a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31e006e0e0 tx=0x7f31d800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 -- 172.21.15.121:0/3905613237 shutdown_connections 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 --2- 172.21.15.121:0/3905613237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00a71f0 0x7f31e00c62a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 --2- 172.21.15.121:0/3905613237 >> v2:172.21.15.122:3300/0 conn(0x7f31e00c4170 0x7f31e00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 -- 172.21.15.121:0/3905613237 >> 172.21.15.121:0/3905613237 conn(0x7f31e00a9a90 msgr2=0x7f31e00a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 -- 172.21.15.121:0/3905613237 shutdown_connections 2023-08-18T20:43:47.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.760+0000 7f31e5228700 1 -- 172.21.15.121:0/3905613237 wait complete. 2023-08-18T20:43:47.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.762+0000 7f31e5228700 1 Processor -- start 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.762+0000 7f31e5228700 1 -- start start 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 0x7f31e01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e0152fa0 0x7f31e014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01ead70 con 0x7f31e00c4170 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e014bcc0 con 0x7f31e0152fa0 2023-08-18T20:43:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0153ca0 con 0x7f31e00a71f0 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40028/0 (socket says 172.21.15.121:40028) 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 -- 172.21.15.121:0/98259633 learned_addr learned my addr 172.21.15.121:0/98259633 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31df59e700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e0152fa0 0x7f31e014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31ded9d700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 0x7f31e01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 -- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 msgr2=0x7f31e01540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 0x7f31e01540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 -- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e0152fa0 msgr2=0x7f31e014b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e0152fa0 0x7f31e014b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 -- 172.21.15.121:0/98259633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009a70 con 0x7f31e00c4170 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31ded9d700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 0x7f31e01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31de59c700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c520 tx=0x7f31d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4005d70 con 0x7f31e00c4170 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d40070d0 con 0x7f31e00c4170 2023-08-18T20:43:47.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.763+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01536e0 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.764+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4007440 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.764+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e006bb60 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.764+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e00c6cb0 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.765+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31d40075a0 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.765+0000 7f31c77fe700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 0x7f31cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.765+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31d4087840 con 0x7f31e00c4170 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.765+0000 7f31ded9d700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 0x7f31cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:47.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.766+0000 7f31ded9d700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 0x7f31cc06c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31d00099f0 tx=0x7f31d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:47.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:47.770+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f31d4053070 con 0x7f31e00c4170 2023-08-18T20:43:48.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.008+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e0074730 con 0x7f31e00c4170 2023-08-18T20:43:48.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.009+0000 7f31c77fe700 1 -- 172.21.15.121:0/98259633 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7f31d4056690 con 0x7f31e00c4170 2023-08-18T20:43:48.010 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:48.010 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:43:48.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 msgr2=0x7f31cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 0x7f31cc06c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31d00099f0 tx=0x7f31d0008040 comp rx=0 tx=0).stop 2023-08-18T20:43:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 msgr2=0x7f31e014b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c520 tx=0x7f31d400c830 comp rx=0 tx=0).stop 2023-08-18T20:43:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 shutdown_connections 2023-08-18T20:43:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e0152fa0 0x7f31e014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31e00a71f0 0x7f31e01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f31cc06a0e0 0x7f31cc06c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 --2- 172.21.15.121:0/98259633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e00c4170 0x7f31e014b240 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 >> 172.21.15.121:0/98259633 conn(0x7f31e00a9a90 msgr2=0x7f31e01517b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 shutdown_connections 2023-08-18T20:43:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.011+0000 7f31e5228700 1 -- 172.21.15.121:0/98259633 wait complete. 2023-08-18T20:43:48.014 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:43:48.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:48.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.144+0000 7fe4f2a3f700 1 Processor -- start 2023-08-18T20:43:48.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.144+0000 7fe4f2a3f700 1 -- start start 2023-08-18T20:43:48.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f2a3f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec0c0c50 0x7fe4ec06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f2a3f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4ec06a7e0 0x7fe4ec0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f2a3f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0c4f40 con 0x7fe4ec0a6290 2023-08-18T20:43:48.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f2a3f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c6120 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f2a3f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1551f0 con 0x7fe4ec0c0c50 2023-08-18T20:43:48.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f0fdc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe4ec0a6290 0x7fe4ec071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46620/0 (socket says 172.21.15.121:46620) 2023-08-18T20:43:48.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4f0fdc700 1 -- 172.21.15.121:0/3911858052 learned_addr learned my addr 172.21.15.121:0/3911858052 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:48.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4ebfff700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec0c0c50 0x7fe4ec06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.145+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/3911858052 >> v2:172.21.15.122:3300/0 conn(0x7fe4ec06a7e0 0x7fe4ec0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eaffd700 1 -- 172.21.15.121:0/3911858052 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584654919 0 0) 0x7fe4ec0c4f40 con 0x7fe4ec0a6290 2023-08-18T20:43:48.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eaffd700 1 -- 172.21.15.121:0/3911858052 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d80035b0 con 0x7fe4ec0a6290 2023-08-18T20:43:48.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec0c0c50 msgr2=0x7fe4ec06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:48.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec0c0c50 0x7fe4ec06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/3911858052 >> v1:172.21.15.121:6789/0 conn(0x7fe4ec0a6290 legacy=0x7fe4ec071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/3911858052 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0c63a0 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec06a7e0 0x7fe4ec0c53d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009840 tx=0x7fe4d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2fe244bca0c26d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eaffd700 1 -- 172.21.15.121:0/3911858052 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4011830 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eaffd700 1 -- 172.21.15.121:0/3911858052 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4011990 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.146+0000 7fe4eaffd700 1 -- 172.21.15.121:0/3911858052 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4011d00 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec06a7e0 msgr2=0x7fe4ec0c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec06a7e0 0x7fe4ec0c53d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009840 tx=0x7fe4d4009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:48.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/3911858052 shutdown_connections 2023-08-18T20:43:48.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec0c0c50 0x7fe4ec06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/3911858052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec06a7e0 0x7fe4ec0c53d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/3911858052 >> 172.21.15.121:0/3911858052 conn(0x7fe4ec0c6b10 msgr2=0x7fe4ec0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/3911858052 shutdown_connections 2023-08-18T20:43:48.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.147+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/3911858052 wait complete. 2023-08-18T20:43:48.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.148+0000 7fe4f2a3f700 1 Processor -- start 2023-08-18T20:43:48.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.148+0000 7fe4f2a3f700 1 -- start start 2023-08-18T20:43:48.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec06a7e0 0x7fe4ec070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec0c0c50 0x7fe4ec14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec14ea70 con 0x7fe4ec0a6290 2023-08-18T20:43:48.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec071510 con 0x7fe4ec0c0c50 2023-08-18T20:43:48.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1edb10 con 0x7fe4ec06a7e0 2023-08-18T20:43:48.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40042/0 (socket says 172.21.15.121:40042) 2023-08-18T20:43:48.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/443759939 learned_addr learned my addr 172.21.15.121:0/443759939 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:48.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f0fdc700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec0c0c50 0x7fe4ec14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4ebfff700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec06a7e0 0x7fe4ec070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec06a7e0 msgr2=0x7fe4ec070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec06a7e0 0x7fe4ec070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec0c0c50 msgr2=0x7fe4ec14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec0c0c50 0x7fe4ec14de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 -- 172.21.15.121:0/443759939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d40094a0 con 0x7fe4ec0a6290 2023-08-18T20:43:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4eb7fe700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40036a0 con 0x7fe4ec0a6290 2023-08-18T20:43:48.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d401e070 con 0x7fe4ec0a6290 2023-08-18T20:43:48.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0ac380 con 0x7fe4ec0a6290 2023-08-18T20:43:48.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003a20 con 0x7fe4ec0a6290 2023-08-18T20:43:48.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.149+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0ac940 con 0x7fe4ec0a6290 2023-08-18T20:43:48.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.150+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec151cb0 con 0x7fe4ec0a6290 2023-08-18T20:43:48.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.151+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4d4003b80 con 0x7fe4ec0a6290 2023-08-18T20:43:48.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.152+0000 7fe4e8ff9700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 0x7fe4cc06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.152+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4d40899d0 con 0x7fe4ec0a6290 2023-08-18T20:43:48.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.152+0000 7fe4ebfff700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 0x7fe4cc06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.152+0000 7fe4ebfff700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 0x7fe4cc06c570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009b70 tx=0x7fe4dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.155+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe4d4055150 con 0x7fe4ec0a6290 2023-08-18T20:43:48.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.351+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4ec074730 con 0x7fe4ec0a6290 2023-08-18T20:43:48.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.352+0000 7fe4e8ff9700 1 -- 172.21.15.121:0/443759939 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fe4d4058770 con 0x7fe4ec0a6290 2023-08-18T20:43:48.353 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:48.353 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:48.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 msgr2=0x7fe4cc06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 0x7fe4cc06c570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009b70 tx=0x7fe4dc008040 comp rx=0 tx=0).stop 2023-08-18T20:43:48.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 msgr2=0x7fe4ec150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4004750 comp rx=0 tx=0).stop 2023-08-18T20:43:48.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 shutdown_connections 2023-08-18T20:43:48.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4ec0c0c50 0x7fe4ec14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4ec06a7e0 0x7fe4ec070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4cc06a0b0 0x7fe4cc06c570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 --2- 172.21.15.121:0/443759939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4ec0a6290 0x7fe4ec150a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 >> 172.21.15.121:0/443759939 conn(0x7fe4ec0c6b10 msgr2=0x7fe4ec0a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 shutdown_connections 2023-08-18T20:43:48.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.354+0000 7fe4f2a3f700 1 -- 172.21.15.121:0/443759939 wait complete. 2023-08-18T20:43:48.367 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-18T20:43:48.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:43:48.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.488+0000 7f4200d75700 1 Processor -- start 2023-08-18T20:43:48.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.488+0000 7f4200d75700 1 -- start start 2023-08-18T20:43:48.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f4200d75700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41fc14ad80 0x7f41fc0c0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f4200d75700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f4200d75700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc0c42c0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f4200d75700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc06ab30 con 0x7f41fc14ad80 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f4200d75700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc154500 con 0x7f41fc06a700 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41f9d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f41fc06a2a0 0x7f41fc0c3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46630/0 (socket says 172.21.15.121:46630) 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41f9d9b700 1 -- 172.21.15.121:0/2103330863 learned_addr learned my addr 172.21.15.121:0/2103330863 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2103330863 >> v2:172.21.15.122:3300/0 conn(0x7f41fc14ad80 0x7f41fc0c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fad9d700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41f959a700 1 -- 172.21.15.121:0/2103330863 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233077967 0 0) 0x7f41fc0c42c0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41f959a700 1 -- 172.21.15.121:0/2103330863 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e40035b0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fa59c700 1 -- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 msgr2=0x7f41fc0c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:48.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc0c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fa59c700 1 -- 172.21.15.121:0/2103330863 >> v1:172.21.15.121:6789/0 conn(0x7f41fc06a2a0 legacy=0x7f41fc0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.489+0000 7f41fa59c700 1 -- 172.21.15.121:0/2103330863 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc1547e0 con 0x7f41fc14ad80 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0c0840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009840 tx=0x7f41f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=416a0efb2e540f40 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f41f959a700 1 -- 172.21.15.121:0/2103330863 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0011830 con 0x7f41fc14ad80 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f41f959a700 1 -- 172.21.15.121:0/2103330863 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0011990 con 0x7f41fc14ad80 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f41f959a700 1 -- 172.21.15.121:0/2103330863 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0011d00 con 0x7f41fc14ad80 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 -- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 msgr2=0x7f41fc0c0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0c0840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009840 tx=0x7f41f0009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 -- 172.21.15.121:0/2103330863 shutdown_connections 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 --2- 172.21.15.121:0/2103330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0c0840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.490+0000 7f4200d75700 1 -- 172.21.15.121:0/2103330863 >> 172.21.15.121:0/2103330863 conn(0x7f41fc06b9e0 msgr2=0x7f41fc0a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.491+0000 7f4200d75700 1 -- 172.21.15.121:0/2103330863 shutdown_connections 2023-08-18T20:43:48.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.491+0000 7f4200d75700 1 -- 172.21.15.121:0/2103330863 wait complete. 2023-08-18T20:43:48.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 Processor -- start 2023-08-18T20:43:48.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 -- start start 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc06d2c0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.492+0000 7f4200d75700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc06c9b0 con 0x7f41fc14ad80 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f4200d75700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1ea290 con 0x7f41fc06a700 2023-08-18T20:43:48.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40052/0 (socket says 172.21.15.121:40052) 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 -- 172.21.15.121:0/2428020267 learned_addr learned my addr 172.21.15.121:0/2428020267 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 -- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 msgr2=0x7f41fc147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 -- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 msgr2=0x7f41fc0a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fad9d700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 -- 172.21.15.121:0/2428020267 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00094a0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41fa59c700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009fd0 tx=0x7f41f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00045d0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f001e070 con 0x7f41fc06a2a0 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc06cc70 con 0x7f41fc06a2a0 2023-08-18T20:43:48.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00038a0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.493+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc0720c0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.494+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc155060 con 0x7f41fc06a2a0 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.494+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41f0003a00 con 0x7f41fc06a2a0 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.495+0000 7f41eaffd700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 0x7f41dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.495+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41f00894d0 con 0x7f41fc06a2a0 2023-08-18T20:43:48.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.495+0000 7f41f9d9b700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 0x7f41dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.495+0000 7f41f9d9b700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 0x7f41dc06c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41ec007fd0 tx=0x7f41ec007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.500+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f41fc155060 con 0x7f41fc06a2a0 2023-08-18T20:43:48.679 INFO:tasks.ceph.mds.a.smithi121.stderr:2023-08-18T20:43:48.678+0000 7f645b434700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:43:48.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.691+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41fc154da0 con 0x7f41dc06a0e0 2023-08-18T20:43:48.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.700+0000 7f41eaffd700 1 -- 172.21.15.121:0/2428020267 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286941 (secure 0 0 0) 0x7f41ec005920 con 0x7f41dc06a0e0 2023-08-18T20:43:48.703 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 msgr2=0x7f41dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 0x7f41dc06c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41ec007fd0 tx=0x7f41ec007980 comp rx=0 tx=0).stop 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 msgr2=0x7f41fc071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009fd0 tx=0x7f41f0004750 comp rx=0 tx=0).stop 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 shutdown_connections 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc14ad80 0x7f41fc0a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f41dc06a0e0 0x7f41dc06c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41fc06a2a0 0x7f41fc071b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 --2- 172.21.15.121:0/2428020267 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc06a700 0x7f41fc147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 >> 172.21.15.121:0/2428020267 conn(0x7f41fc06b9e0 msgr2=0x7f41fc0c71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 shutdown_connections 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.703+0000 7f4200d75700 1 -- 172.21.15.121:0/2428020267 wait complete. 2023-08-18T20:43:48.706 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:43:48.716 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-18T20:43:46.905702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219088,"kb_used_data":2900,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755632,"statfs":{"total":773094113280,"available":772869767168,"internally_reserved":0,"allocated":2969600,"data_stored":1796953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.318605"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618129+0000","last_change":"2023-08-18T20:43:44.613436+0000","last_active":"2023-08-18T20:43:44.618129+0000","last_peered":"2023-08-18T20:43:44.618129+0000","last_clean":"2023-08-18T20:43:44.618129+0000","last_became_active":"2023-08-18T20:43:44.613171+0000","last_became_peered":"2023-08-18T20:43:44.613171+0000","last_unstale":"2023-08-18T20:43:44.618129+0000","last_undegraded":"2023-08-18T20:43:44.618129+0000","last_fullsized":"2023-08-18T20:43:44.618129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:57:06.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624412+0000","last_change":"2023-08-18T20:43:44.619506+0000","last_active":"2023-08-18T20:43:44.624412+0000","last_peered":"2023-08-18T20:43:44.624412+0000","last_clean":"2023-08-18T20:43:44.624412+0000","last_became_active":"2023-08-18T20:43:44.619216+0000","last_became_peered":"2023-08-18T20:43:44.619216+0000","last_unstale":"2023-08-18T20:43:44.624412+0000","last_undegraded":"2023-08-18T20:43:44.624412+0000","last_fullsized":"2023-08-18T20:43:44.624412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:19.797040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714146+0000","last_change":"2023-08-18T20:43:44.615835+0000","last_active":"2023-08-18T20:43:45.714146+0000","last_peered":"2023-08-18T20:43:45.714146+0000","last_clean":"2023-08-18T20:43:45.714146+0000","last_became_active":"2023-08-18T20:43:44.615439+0000","last_became_peered":"2023-08-18T20:43:44.615439+0000","last_unstale":"2023-08-18T20:43:45.714146+0000","last_undegraded":"2023-08-18T20:43:45.714146+0000","last_fullsized":"2023-08-18T20:43:45.714146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:18.373624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618189+0000","last_change":"2023-08-18T20:43:44.611672+0000","last_active":"2023-08-18T20:43:45.618189+0000","last_peered":"2023-08-18T20:43:45.618189+0000","last_clean":"2023-08-18T20:43:45.618189+0000","last_became_active":"2023-08-18T20:43:44.611355+0000","last_became_peered":"2023-08-18T20:43:44.611355+0000","last_unstale":"2023-08-18T20:43:45.618189+0000","last_undegraded":"2023-08-18T20:43:45.618189+0000","last_fullsized":"2023-08-18T20:43:45.618189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625799+0000","last_change":"2023-08-18T20:43:44.624219+0000","last_active":"2023-08-18T20:43:44.625799+0000","last_peered":"2023-08-18T20:43:44.625799+0000","last_clean":"2023-08-18T20:43:44.625799+0000","last_became_active":"2023-08-18T20:43:44.623964+0000","last_became_peered":"2023-08-18T20:43:44.623964+0000","last_unstale":"2023-08-18T20:43:44.625799+0000","last_undegraded":"2023-08-18T20:43:44.625799+0000","last_fullsized":"2023-08-18T20:43:44.625799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:17.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713758+0000","last_change":"2023-08-18T20:43:44.619846+0000","last_active":"2023-08-18T20:43:45.713758+0000","last_peered":"2023-08-18T20:43:45.713758+0000","last_clean":"2023-08-18T20:43:45.713758+0000","last_became_active":"2023-08-18T20:43:44.619591+0000","last_became_peered":"2023-08-18T20:43:44.619591+0000","last_unstale":"2023-08-18T20:43:45.713758+0000","last_undegraded":"2023-08-18T20:43:45.713758+0000","last_fullsized":"2023-08-18T20:43:45.713758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629583+0000","last_change":"2023-08-18T20:43:44.628859+0000","last_active":"2023-08-18T20:43:44.629583+0000","last_peered":"2023-08-18T20:43:44.629583+0000","last_clean":"2023-08-18T20:43:44.629583+0000","last_became_active":"2023-08-18T20:43:44.628585+0000","last_became_peered":"2023-08-18T20:43:44.628585+0000","last_unstale":"2023-08-18T20:43:44.629583+0000","last_undegraded":"2023-08-18T20:43:44.629583+0000","last_fullsized":"2023-08-18T20:43:44.629583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:24:32.949416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623937+0000","last_change":"2023-08-18T20:43:44.618307+0000","last_active":"2023-08-18T20:43:44.623937+0000","last_peered":"2023-08-18T20:43:44.623937+0000","last_clean":"2023-08-18T20:43:44.623937+0000","last_became_active":"2023-08-18T20:43:44.617977+0000","last_became_peered":"2023-08-18T20:43:44.617977+0000","last_unstale":"2023-08-18T20:43:44.623937+0000","last_undegraded":"2023-08-18T20:43:44.623937+0000","last_fullsized":"2023-08-18T20:43:44.623937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:50.135337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620511+0000","last_change":"2023-08-18T20:43:44.616362+0000","last_active":"2023-08-18T20:43:44.620511+0000","last_peered":"2023-08-18T20:43:44.620511+0000","last_clean":"2023-08-18T20:43:44.620511+0000","last_became_active":"2023-08-18T20:43:44.615973+0000","last_became_peered":"2023-08-18T20:43:44.615973+0000","last_unstale":"2023-08-18T20:43:44.620511+0000","last_undegraded":"2023-08-18T20:43:44.620511+0000","last_fullsized":"2023-08-18T20:43:44.620511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:10:37.114300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624380+0000","last_change":"2023-08-18T20:43:44.618993+0000","last_active":"2023-08-18T20:43:44.624380+0000","last_peered":"2023-08-18T20:43:44.624380+0000","last_clean":"2023-08-18T20:43:44.624380+0000","last_became_active":"2023-08-18T20:43:44.618718+0000","last_became_peered":"2023-08-18T20:43:44.618718+0000","last_unstale":"2023-08-18T20:43:44.624380+0000","last_undegraded":"2023-08-18T20:43:44.624380+0000","last_fullsized":"2023-08-18T20:43:44.624380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:48.562511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714250+0000","last_change":"2023-08-18T20:43:44.624641+0000","last_active":"2023-08-18T20:43:45.714250+0000","last_peered":"2023-08-18T20:43:45.714250+0000","last_clean":"2023-08-18T20:43:45.714250+0000","last_became_active":"2023-08-18T20:43:44.624090+0000","last_became_peered":"2023-08-18T20:43:44.624090+0000","last_unstale":"2023-08-18T20:43:45.714250+0000","last_undegraded":"2023-08-18T20:43:45.714250+0000","last_fullsized":"2023-08-18T20:43:45.714250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:21.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625951+0000","last_change":"2023-08-18T20:43:44.622302+0000","last_active":"2023-08-18T20:43:44.625951+0000","last_peered":"2023-08-18T20:43:44.625951+0000","last_clean":"2023-08-18T20:43:44.625951+0000","last_became_active":"2023-08-18T20:43:44.622083+0000","last_became_peered":"2023-08-18T20:43:44.622083+0000","last_unstale":"2023-08-18T20:43:44.625951+0000","last_undegraded":"2023-08-18T20:43:44.625951+0000","last_fullsized":"2023-08-18T20:43:44.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:56.332458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625940+0000","last_change":"2023-08-18T20:43:44.621350+0000","last_active":"2023-08-18T20:43:44.625940+0000","last_peered":"2023-08-18T20:43:44.625940+0000","last_clean":"2023-08-18T20:43:44.625940+0000","last_became_active":"2023-08-18T20:43:44.620947+0000","last_became_peered":"2023-08-18T20:43:44.620947+0000","last_unstale":"2023-08-18T20:43:44.625940+0000","last_undegraded":"2023-08-18T20:43:44.625940+0000","last_fullsized":"2023-08-18T20:43:44.625940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:27:57.704931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620536+0000","last_change":"2023-08-18T20:43:44.615387+0000","last_active":"2023-08-18T20:43:44.620536+0000","last_peered":"2023-08-18T20:43:44.620536+0000","last_clean":"2023-08-18T20:43:44.620536+0000","last_became_active":"2023-08-18T20:43:44.615141+0000","last_became_peered":"2023-08-18T20:43:44.615141+0000","last_unstale":"2023-08-18T20:43:44.620536+0000","last_undegraded":"2023-08-18T20:43:44.620536+0000","last_fullsized":"2023-08-18T20:43:44.620536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:25.637569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629770+0000","last_change":"2023-08-18T20:43:44.629068+0000","last_active":"2023-08-18T20:43:44.629770+0000","last_peered":"2023-08-18T20:43:44.629770+0000","last_clean":"2023-08-18T20:43:44.629770+0000","last_became_active":"2023-08-18T20:43:44.628499+0000","last_became_peered":"2023-08-18T20:43:44.628499+0000","last_unstale":"2023-08-18T20:43:44.629770+0000","last_undegraded":"2023-08-18T20:43:44.629770+0000","last_fullsized":"2023-08-18T20:43:44.629770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713784+0000","last_change":"2023-08-18T20:43:44.614503+0000","last_active":"2023-08-18T20:43:45.713784+0000","last_peered":"2023-08-18T20:43:45.713784+0000","last_clean":"2023-08-18T20:43:45.713784+0000","last_became_active":"2023-08-18T20:43:44.614201+0000","last_became_peered":"2023-08-18T20:43:44.614201+0000","last_unstale":"2023-08-18T20:43:45.713784+0000","last_undegraded":"2023-08-18T20:43:45.713784+0000","last_fullsized":"2023-08-18T20:43:45.713784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624155+0000","last_change":"2023-08-18T20:43:44.620433+0000","last_active":"2023-08-18T20:43:44.624155+0000","last_peered":"2023-08-18T20:43:44.624155+0000","last_clean":"2023-08-18T20:43:44.624155+0000","last_became_active":"2023-08-18T20:43:44.620183+0000","last_became_peered":"2023-08-18T20:43:44.620183+0000","last_unstale":"2023-08-18T20:43:44.624155+0000","last_undegraded":"2023-08-18T20:43:44.624155+0000","last_fullsized":"2023-08-18T20:43:44.624155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:25.637569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714292+0000","last_change":"2023-08-18T20:43:44.619040+0000","last_active":"2023-08-18T20:43:45.714292+0000","last_peered":"2023-08-18T20:43:45.714292+0000","last_clean":"2023-08-18T20:43:45.714292+0000","last_became_active":"2023-08-18T20:43:44.618758+0000","last_became_peered":"2023-08-18T20:43:44.618758+0000","last_unstale":"2023-08-18T20:43:45.714292+0000","last_undegraded":"2023-08-18T20:43:45.714292+0000","last_fullsized":"2023-08-18T20:43:45.714292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:40.432183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.615565+0000","last_change":"2023-08-18T20:43:44.610425+0000","last_active":"2023-08-18T20:43:44.615565+0000","last_peered":"2023-08-18T20:43:44.615565+0000","last_clean":"2023-08-18T20:43:44.615565+0000","last_became_active":"2023-08-18T20:43:44.610083+0000","last_became_peered":"2023-08-18T20:43:44.610083+0000","last_unstale":"2023-08-18T20:43:44.615565+0000","last_undegraded":"2023-08-18T20:43:44.615565+0000","last_fullsized":"2023-08-18T20:43:44.615565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:12.180440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714045+0000","last_change":"2023-08-18T20:43:44.617819+0000","last_active":"2023-08-18T20:43:45.714045+0000","last_peered":"2023-08-18T20:43:45.714045+0000","last_clean":"2023-08-18T20:43:45.714045+0000","last_became_active":"2023-08-18T20:43:44.617544+0000","last_became_peered":"2023-08-18T20:43:44.617544+0000","last_unstale":"2023-08-18T20:43:45.714045+0000","last_undegraded":"2023-08-18T20:43:45.714045+0000","last_fullsized":"2023-08-18T20:43:45.714045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:13.397598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629599+0000","last_change":"2023-08-18T20:43:44.628884+0000","last_active":"2023-08-18T20:43:44.629599+0000","last_peered":"2023-08-18T20:43:44.629599+0000","last_clean":"2023-08-18T20:43:44.629599+0000","last_became_active":"2023-08-18T20:43:44.628405+0000","last_became_peered":"2023-08-18T20:43:44.628405+0000","last_unstale":"2023-08-18T20:43:44.629599+0000","last_undegraded":"2023-08-18T20:43:44.629599+0000","last_fullsized":"2023-08-18T20:43:44.629599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:32.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.622743+0000","last_change":"2023-08-18T20:43:44.618393+0000","last_active":"2023-08-18T20:43:44.622743+0000","last_peered":"2023-08-18T20:43:44.622743+0000","last_clean":"2023-08-18T20:43:44.622743+0000","last_became_active":"2023-08-18T20:43:44.618136+0000","last_became_peered":"2023-08-18T20:43:44.618136+0000","last_unstale":"2023-08-18T20:43:44.622743+0000","last_undegraded":"2023-08-18T20:43:44.622743+0000","last_fullsized":"2023-08-18T20:43:44.622743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:38:55.345976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617524+0000","last_change":"2023-08-18T20:43:44.614686+0000","last_active":"2023-08-18T20:43:45.617524+0000","last_peered":"2023-08-18T20:43:45.617524+0000","last_clean":"2023-08-18T20:43:45.617524+0000","last_became_active":"2023-08-18T20:43:44.612205+0000","last_became_peered":"2023-08-18T20:43:44.612205+0000","last_unstale":"2023-08-18T20:43:45.617524+0000","last_undegraded":"2023-08-18T20:43:45.617524+0000","last_fullsized":"2023-08-18T20:43:45.617524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629601+0000","last_change":"2023-08-18T20:43:44.629057+0000","last_active":"2023-08-18T20:43:44.629601+0000","last_peered":"2023-08-18T20:43:44.629601+0000","last_clean":"2023-08-18T20:43:44.629601+0000","last_became_active":"2023-08-18T20:43:44.628753+0000","last_became_peered":"2023-08-18T20:43:44.628753+0000","last_unstale":"2023-08-18T20:43:44.629601+0000","last_undegraded":"2023-08-18T20:43:44.629601+0000","last_fullsized":"2023-08-18T20:43:44.629601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:36.173422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613163+0000","last_change":"2023-08-18T20:43:44.622856+0000","last_active":"2023-08-18T20:43:45.613163+0000","last_peered":"2023-08-18T20:43:45.613163+0000","last_clean":"2023-08-18T20:43:45.613163+0000","last_became_active":"2023-08-18T20:43:44.622446+0000","last_became_peered":"2023-08-18T20:43:44.622446+0000","last_unstale":"2023-08-18T20:43:45.613163+0000","last_undegraded":"2023-08-18T20:43:45.613163+0000","last_fullsized":"2023-08-18T20:43:45.613163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613287+0000","last_change":"2023-08-18T20:43:44.614336+0000","last_active":"2023-08-18T20:43:45.613287+0000","last_peered":"2023-08-18T20:43:45.613287+0000","last_clean":"2023-08-18T20:43:45.613287+0000","last_became_active":"2023-08-18T20:43:44.613311+0000","last_became_peered":"2023-08-18T20:43:44.613311+0000","last_unstale":"2023-08-18T20:43:45.613287+0000","last_undegraded":"2023-08-18T20:43:45.613287+0000","last_fullsized":"2023-08-18T20:43:45.613287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624532+0000","last_change":"2023-08-18T20:43:44.619472+0000","last_active":"2023-08-18T20:43:44.624532+0000","last_peered":"2023-08-18T20:43:44.624532+0000","last_clean":"2023-08-18T20:43:44.624532+0000","last_became_active":"2023-08-18T20:43:44.619129+0000","last_became_peered":"2023-08-18T20:43:44.619129+0000","last_unstale":"2023-08-18T20:43:44.624532+0000","last_undegraded":"2023-08-18T20:43:44.624532+0000","last_fullsized":"2023-08-18T20:43:44.624532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:48:48.254653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713985+0000","last_change":"2023-08-18T20:43:43.609894+0000","last_active":"2023-08-18T20:43:45.713985+0000","last_peered":"2023-08-18T20:43:45.713985+0000","last_clean":"2023-08-18T20:43:45.713985+0000","last_became_active":"2023-08-18T20:43:43.609607+0000","last_became_peered":"2023-08-18T20:43:43.609607+0000","last_unstale":"2023-08-18T20:43:45.713985+0000","last_undegraded":"2023-08-18T20:43:45.713985+0000","last_fullsized":"2023-08-18T20:43:45.713985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:01.890051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617654+0000","last_change":"2023-08-18T20:43:44.609769+0000","last_active":"2023-08-18T20:43:45.617654+0000","last_peered":"2023-08-18T20:43:45.617654+0000","last_clean":"2023-08-18T20:43:45.617654+0000","last_became_active":"2023-08-18T20:43:44.609493+0000","last_became_peered":"2023-08-18T20:43:44.609493+0000","last_unstale":"2023-08-18T20:43:45.617654+0000","last_undegraded":"2023-08-18T20:43:45.617654+0000","last_fullsized":"2023-08-18T20:43:45.617654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:16.085957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613008+0000","last_change":"2023-08-18T20:43:43.599440+0000","last_active":"2023-08-18T20:43:45.613008+0000","last_peered":"2023-08-18T20:43:45.613008+0000","last_clean":"2023-08-18T20:43:45.613008+0000","last_became_active":"2023-08-18T20:43:43.599128+0000","last_became_peered":"2023-08-18T20:43:43.599128+0000","last_unstale":"2023-08-18T20:43:45.613008+0000","last_undegraded":"2023-08-18T20:43:45.613008+0000","last_fullsized":"2023-08-18T20:43:45.613008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624751+0000","last_change":"2023-08-18T20:43:44.623290+0000","last_active":"2023-08-18T20:43:44.624751+0000","last_peered":"2023-08-18T20:43:44.624751+0000","last_clean":"2023-08-18T20:43:44.624751+0000","last_became_active":"2023-08-18T20:43:44.623038+0000","last_became_peered":"2023-08-18T20:43:44.623038+0000","last_unstale":"2023-08-18T20:43:44.624751+0000","last_undegraded":"2023-08-18T20:43:44.624751+0000","last_fullsized":"2023-08-18T20:43:44.624751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:09:15.360713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617757+0000","last_change":"2023-08-18T20:43:43.610873+0000","last_active":"2023-08-18T20:43:45.617757+0000","last_peered":"2023-08-18T20:43:45.617757+0000","last_clean":"2023-08-18T20:43:45.617757+0000","last_became_active":"2023-08-18T20:43:43.610621+0000","last_became_peered":"2023-08-18T20:43:43.610621+0000","last_unstale":"2023-08-18T20:43:45.617757+0000","last_undegraded":"2023-08-18T20:43:45.617757+0000","last_fullsized":"2023-08-18T20:43:45.617757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:10.811810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618237+0000","last_change":"2023-08-18T20:43:44.620235+0000","last_active":"2023-08-18T20:43:45.618237+0000","last_peered":"2023-08-18T20:43:45.618237+0000","last_clean":"2023-08-18T20:43:45.618237+0000","last_became_active":"2023-08-18T20:43:44.619362+0000","last_became_peered":"2023-08-18T20:43:44.619362+0000","last_unstale":"2023-08-18T20:43:45.618237+0000","last_undegraded":"2023-08-18T20:43:45.618237+0000","last_fullsized":"2023-08-18T20:43:45.618237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.606408+0000","last_change":"2023-08-18T20:43:43.610434+0000","last_active":"2023-08-18T20:43:44.606408+0000","last_peered":"2023-08-18T20:43:44.606408+0000","last_clean":"2023-08-18T20:43:44.606408+0000","last_became_active":"2023-08-18T20:43:43.610177+0000","last_became_peered":"2023-08-18T20:43:43.610177+0000","last_unstale":"2023-08-18T20:43:44.606408+0000","last_undegraded":"2023-08-18T20:43:44.606408+0000","last_fullsized":"2023-08-18T20:43:44.606408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:47.553311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618022+0000","last_change":"2023-08-18T20:43:44.600116+0000","last_active":"2023-08-18T20:43:45.618022+0000","last_peered":"2023-08-18T20:43:45.618022+0000","last_clean":"2023-08-18T20:43:45.618022+0000","last_became_active":"2023-08-18T20:43:44.599850+0000","last_became_peered":"2023-08-18T20:43:44.599850+0000","last_unstale":"2023-08-18T20:43:45.618022+0000","last_undegraded":"2023-08-18T20:43:45.618022+0000","last_fullsized":"2023-08-18T20:43:45.618022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:06.146312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.605207+0000","last_change":"2023-08-18T20:43:43.610800+0000","last_active":"2023-08-18T20:43:44.605207+0000","last_peered":"2023-08-18T20:43:44.605207+0000","last_clean":"2023-08-18T20:43:44.605207+0000","last_became_active":"2023-08-18T20:43:43.610488+0000","last_became_peered":"2023-08-18T20:43:43.610488+0000","last_unstale":"2023-08-18T20:43:44.605207+0000","last_undegraded":"2023-08-18T20:43:44.605207+0000","last_fullsized":"2023-08-18T20:43:44.605207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617668+0000","last_change":"2023-08-18T20:43:44.616549+0000","last_active":"2023-08-18T20:43:45.617668+0000","last_peered":"2023-08-18T20:43:45.617668+0000","last_clean":"2023-08-18T20:43:45.617668+0000","last_became_active":"2023-08-18T20:43:44.613672+0000","last_became_peered":"2023-08-18T20:43:44.613672+0000","last_unstale":"2023-08-18T20:43:45.617668+0000","last_undegraded":"2023-08-18T20:43:45.617668+0000","last_fullsized":"2023-08-18T20:43:45.617668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:31.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629187+0000","last_change":"2023-08-18T20:43:43.614627+0000","last_active":"2023-08-18T20:43:44.629187+0000","last_peered":"2023-08-18T20:43:44.629187+0000","last_clean":"2023-08-18T20:43:44.629187+0000","last_became_active":"2023-08-18T20:43:43.614337+0000","last_became_peered":"2023-08-18T20:43:43.614337+0000","last_unstale":"2023-08-18T20:43:44.629187+0000","last_undegraded":"2023-08-18T20:43:44.629187+0000","last_fullsized":"2023-08-18T20:43:44.629187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:55:16.358688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613191+0000","last_change":"2023-08-18T20:43:44.617560+0000","last_active":"2023-08-18T20:43:45.613191+0000","last_peered":"2023-08-18T20:43:45.613191+0000","last_clean":"2023-08-18T20:43:45.613191+0000","last_became_active":"2023-08-18T20:43:44.617204+0000","last_became_peered":"2023-08-18T20:43:44.617204+0000","last_unstale":"2023-08-18T20:43:45.613191+0000","last_undegraded":"2023-08-18T20:43:45.613191+0000","last_fullsized":"2023-08-18T20:43:45.613191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714256+0000","last_change":"2023-08-18T20:43:43.612457+0000","last_active":"2023-08-18T20:43:45.714256+0000","last_peered":"2023-08-18T20:43:45.714256+0000","last_clean":"2023-08-18T20:43:45.714256+0000","last_became_active":"2023-08-18T20:43:43.611975+0000","last_became_peered":"2023-08-18T20:43:43.611975+0000","last_unstale":"2023-08-18T20:43:45.714256+0000","last_undegraded":"2023-08-18T20:43:45.714256+0000","last_fullsized":"2023-08-18T20:43:45.714256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:48.357748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.616260+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.615966+0000","last_became_peered":"2023-08-18T20:43:44.615966+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:29.215124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.626029+0000","last_change":"2023-08-18T20:43:43.613070+0000","last_active":"2023-08-18T20:43:44.626029+0000","last_peered":"2023-08-18T20:43:44.626029+0000","last_clean":"2023-08-18T20:43:44.626029+0000","last_became_active":"2023-08-18T20:43:43.612736+0000","last_became_peered":"2023-08-18T20:43:43.612736+0000","last_unstale":"2023-08-18T20:43:44.626029+0000","last_undegraded":"2023-08-18T20:43:44.626029+0000","last_fullsized":"2023-08-18T20:43:44.626029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:05:16.415247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617756+0000","last_change":"2023-08-18T20:43:44.609790+0000","last_active":"2023-08-18T20:43:45.617756+0000","last_peered":"2023-08-18T20:43:45.617756+0000","last_clean":"2023-08-18T20:43:45.617756+0000","last_became_active":"2023-08-18T20:43:44.609536+0000","last_became_peered":"2023-08-18T20:43:44.609536+0000","last_unstale":"2023-08-18T20:43:45.617756+0000","last_undegraded":"2023-08-18T20:43:45.617756+0000","last_fullsized":"2023-08-18T20:43:45.617756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:40.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.608376+0000","last_change":"2023-08-18T20:43:43.611373+0000","last_active":"2023-08-18T20:43:44.608376+0000","last_peered":"2023-08-18T20:43:44.608376+0000","last_clean":"2023-08-18T20:43:44.608376+0000","last_became_active":"2023-08-18T20:43:43.611071+0000","last_became_peered":"2023-08-18T20:43:43.611071+0000","last_unstale":"2023-08-18T20:43:44.608376+0000","last_undegraded":"2023-08-18T20:43:44.608376+0000","last_fullsized":"2023-08-18T20:43:44.608376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:48:47.245453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624499+0000","last_change":"2023-08-18T20:43:44.618343+0000","last_active":"2023-08-18T20:43:44.624499+0000","last_peered":"2023-08-18T20:43:44.624499+0000","last_clean":"2023-08-18T20:43:44.624499+0000","last_became_active":"2023-08-18T20:43:44.618015+0000","last_became_peered":"2023-08-18T20:43:44.618015+0000","last_unstale":"2023-08-18T20:43:44.624499+0000","last_undegraded":"2023-08-18T20:43:44.624499+0000","last_fullsized":"2023-08-18T20:43:44.624499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:18:14.579789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.615853+0000","last_change":"2023-08-18T20:43:43.613459+0000","last_active":"2023-08-18T20:43:44.615853+0000","last_peered":"2023-08-18T20:43:44.615853+0000","last_clean":"2023-08-18T20:43:44.615853+0000","last_became_active":"2023-08-18T20:43:43.613116+0000","last_became_peered":"2023-08-18T20:43:43.613116+0000","last_unstale":"2023-08-18T20:43:44.615853+0000","last_undegraded":"2023-08-18T20:43:44.615853+0000","last_fullsized":"2023-08-18T20:43:44.615853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:34:15.469922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620372+0000","last_change":"2023-08-18T20:43:44.613785+0000","last_active":"2023-08-18T20:43:44.620372+0000","last_peered":"2023-08-18T20:43:44.620372+0000","last_clean":"2023-08-18T20:43:44.620372+0000","last_became_active":"2023-08-18T20:43:44.612998+0000","last_became_peered":"2023-08-18T20:43:44.612998+0000","last_unstale":"2023-08-18T20:43:44.620372+0000","last_undegraded":"2023-08-18T20:43:44.620372+0000","last_fullsized":"2023-08-18T20:43:44.620372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:42:03.998531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617840+0000","last_change":"2023-08-18T20:43:43.611887+0000","last_active":"2023-08-18T20:43:45.617840+0000","last_peered":"2023-08-18T20:43:45.617840+0000","last_clean":"2023-08-18T20:43:45.617840+0000","last_became_active":"2023-08-18T20:43:43.611272+0000","last_became_peered":"2023-08-18T20:43:43.611272+0000","last_unstale":"2023-08-18T20:43:45.617840+0000","last_undegraded":"2023-08-18T20:43:45.617840+0000","last_fullsized":"2023-08-18T20:43:45.617840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618290+0000","last_change":"2023-08-18T20:43:44.625002+0000","last_active":"2023-08-18T20:43:45.618290+0000","last_peered":"2023-08-18T20:43:45.618290+0000","last_clean":"2023-08-18T20:43:45.618290+0000","last_became_active":"2023-08-18T20:43:44.624280+0000","last_became_peered":"2023-08-18T20:43:44.624280+0000","last_unstale":"2023-08-18T20:43:45.618290+0000","last_undegraded":"2023-08-18T20:43:45.618290+0000","last_fullsized":"2023-08-18T20:43:45.618290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625065+0000","last_change":"2023-08-18T20:43:43.613335+0000","last_active":"2023-08-18T20:43:44.625065+0000","last_peered":"2023-08-18T20:43:44.625065+0000","last_clean":"2023-08-18T20:43:44.625065+0000","last_became_active":"2023-08-18T20:43:43.613099+0000","last_became_peered":"2023-08-18T20:43:43.613099+0000","last_unstale":"2023-08-18T20:43:44.625065+0000","last_undegraded":"2023-08-18T20:43:44.625065+0000","last_fullsized":"2023-08-18T20:43:44.625065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:08:47.643571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624427+0000","last_change":"2023-08-18T20:43:44.618882+0000","last_active":"2023-08-18T20:43:44.624427+0000","last_peered":"2023-08-18T20:43:44.624427+0000","last_clean":"2023-08-18T20:43:44.624427+0000","last_became_active":"2023-08-18T20:43:44.618569+0000","last_became_peered":"2023-08-18T20:43:44.618569+0000","last_unstale":"2023-08-18T20:43:44.624427+0000","last_undegraded":"2023-08-18T20:43:44.624427+0000","last_fullsized":"2023-08-18T20:43:44.624427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:20.563841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625923+0000","last_change":"2023-08-18T20:43:43.613693+0000","last_active":"2023-08-18T20:43:44.625923+0000","last_peered":"2023-08-18T20:43:44.625923+0000","last_clean":"2023-08-18T20:43:44.625923+0000","last_became_active":"2023-08-18T20:43:43.613209+0000","last_became_peered":"2023-08-18T20:43:43.613209+0000","last_unstale":"2023-08-18T20:43:44.625923+0000","last_undegraded":"2023-08-18T20:43:44.625923+0000","last_fullsized":"2023-08-18T20:43:44.625923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:14.366210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713787+0000","last_change":"2023-08-18T20:43:44.624612+0000","last_active":"2023-08-18T20:43:45.713787+0000","last_peered":"2023-08-18T20:43:45.713787+0000","last_clean":"2023-08-18T20:43:45.713787+0000","last_became_active":"2023-08-18T20:43:44.624178+0000","last_became_peered":"2023-08-18T20:43:44.624178+0000","last_unstale":"2023-08-18T20:43:45.713787+0000","last_undegraded":"2023-08-18T20:43:45.713787+0000","last_fullsized":"2023-08-18T20:43:45.713787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625924+0000","last_change":"2023-08-18T20:43:43.610565+0000","last_active":"2023-08-18T20:43:44.625924+0000","last_peered":"2023-08-18T20:43:44.625924+0000","last_clean":"2023-08-18T20:43:44.625924+0000","last_became_active":"2023-08-18T20:43:43.610257+0000","last_became_peered":"2023-08-18T20:43:43.610257+0000","last_unstale":"2023-08-18T20:43:44.625924+0000","last_undegraded":"2023-08-18T20:43:44.625924+0000","last_fullsized":"2023-08-18T20:43:44.625924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:44.297879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618026+0000","last_change":"2023-08-18T20:43:44.624063+0000","last_active":"2023-08-18T20:43:45.618026+0000","last_peered":"2023-08-18T20:43:45.618026+0000","last_clean":"2023-08-18T20:43:45.618026+0000","last_became_active":"2023-08-18T20:43:44.623724+0000","last_became_peered":"2023-08-18T20:43:44.623724+0000","last_unstale":"2023-08-18T20:43:45.618026+0000","last_undegraded":"2023-08-18T20:43:45.618026+0000","last_fullsized":"2023-08-18T20:43:45.618026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:21.323341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.603835+0000","last_change":"2023-08-18T20:43:43.609105+0000","last_active":"2023-08-18T20:43:44.603835+0000","last_peered":"2023-08-18T20:43:44.603835+0000","last_clean":"2023-08-18T20:43:44.603835+0000","last_became_active":"2023-08-18T20:43:43.608685+0000","last_became_peered":"2023-08-18T20:43:43.608685+0000","last_unstale":"2023-08-18T20:43:44.603835+0000","last_undegraded":"2023-08-18T20:43:44.603835+0000","last_fullsized":"2023-08-18T20:43:44.603835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623979+0000","last_change":"2023-08-18T20:43:44.618819+0000","last_active":"2023-08-18T20:43:44.623979+0000","last_peered":"2023-08-18T20:43:44.623979+0000","last_clean":"2023-08-18T20:43:44.623979+0000","last_became_active":"2023-08-18T20:43:44.618612+0000","last_became_peered":"2023-08-18T20:43:44.618612+0000","last_unstale":"2023-08-18T20:43:44.623979+0000","last_undegraded":"2023-08-18T20:43:44.623979+0000","last_fullsized":"2023-08-18T20:43:44.623979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:19.797040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618091+0000","last_change":"2023-08-18T20:43:43.612421+0000","last_active":"2023-08-18T20:43:45.618091+0000","last_peered":"2023-08-18T20:43:45.618091+0000","last_clean":"2023-08-18T20:43:45.618091+0000","last_became_active":"2023-08-18T20:43:43.612128+0000","last_became_peered":"2023-08-18T20:43:43.612128+0000","last_unstale":"2023-08-18T20:43:45.618091+0000","last_undegraded":"2023-08-18T20:43:45.618091+0000","last_fullsized":"2023-08-18T20:43:45.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714114+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:45.714114+0000","last_peered":"2023-08-18T20:43:45.714114+0000","last_clean":"2023-08-18T20:43:45.714114+0000","last_became_active":"2023-08-18T20:43:44.620147+0000","last_became_peered":"2023-08-18T20:43:44.620147+0000","last_unstale":"2023-08-18T20:43:45.714114+0000","last_undegraded":"2023-08-18T20:43:45.714114+0000","last_fullsized":"2023-08-18T20:43:45.714114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:44.950335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618011+0000","last_change":"2023-08-18T20:43:43.611666+0000","last_active":"2023-08-18T20:43:45.618011+0000","last_peered":"2023-08-18T20:43:45.618011+0000","last_clean":"2023-08-18T20:43:45.618011+0000","last_became_active":"2023-08-18T20:43:43.611286+0000","last_became_peered":"2023-08-18T20:43:43.611286+0000","last_unstale":"2023-08-18T20:43:45.618011+0000","last_undegraded":"2023-08-18T20:43:45.618011+0000","last_fullsized":"2023-08-18T20:43:45.618011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.619092+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.618797+0000","last_became_peered":"2023-08-18T20:43:44.618797+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:45.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713975+0000","last_change":"2023-08-18T20:43:43.616812+0000","last_active":"2023-08-18T20:43:45.713975+0000","last_peered":"2023-08-18T20:43:45.713975+0000","last_clean":"2023-08-18T20:43:45.713975+0000","last_became_active":"2023-08-18T20:43:43.616539+0000","last_became_peered":"2023-08-18T20:43:43.616539+0000","last_unstale":"2023-08-18T20:43:45.713975+0000","last_undegraded":"2023-08-18T20:43:45.713975+0000","last_fullsized":"2023-08-18T20:43:45.713975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:51.228568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714401+0000","last_change":"2023-08-18T20:43:44.618501+0000","last_active":"2023-08-18T20:43:45.714401+0000","last_peered":"2023-08-18T20:43:45.714401+0000","last_clean":"2023-08-18T20:43:45.714401+0000","last_became_active":"2023-08-18T20:43:44.615330+0000","last_became_peered":"2023-08-18T20:43:44.615330+0000","last_unstale":"2023-08-18T20:43:45.714401+0000","last_undegraded":"2023-08-18T20:43:45.714401+0000","last_fullsized":"2023-08-18T20:43:45.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:45:22.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617352+0000","last_change":"2023-08-18T20:43:43.602148+0000","last_active":"2023-08-18T20:43:45.617352+0000","last_peered":"2023-08-18T20:43:45.617352+0000","last_clean":"2023-08-18T20:43:45.617352+0000","last_became_active":"2023-08-18T20:43:43.601869+0000","last_became_peered":"2023-08-18T20:43:43.601869+0000","last_unstale":"2023-08-18T20:43:45.617352+0000","last_undegraded":"2023-08-18T20:43:45.617352+0000","last_fullsized":"2023-08-18T20:43:45.617352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:37.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613324+0000","last_change":"2023-08-18T20:43:44.626768+0000","last_active":"2023-08-18T20:43:45.613324+0000","last_peered":"2023-08-18T20:43:45.613324+0000","last_clean":"2023-08-18T20:43:45.613324+0000","last_became_active":"2023-08-18T20:43:44.626427+0000","last_became_peered":"2023-08-18T20:43:44.626427+0000","last_unstale":"2023-08-18T20:43:45.613324+0000","last_undegraded":"2023-08-18T20:43:45.613324+0000","last_fullsized":"2023-08-18T20:43:45.613324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:54.206575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618198+0000","last_change":"2023-08-18T20:43:43.611362+0000","last_active":"2023-08-18T20:43:45.618198+0000","last_peered":"2023-08-18T20:43:45.618198+0000","last_clean":"2023-08-18T20:43:45.618198+0000","last_became_active":"2023-08-18T20:43:43.611092+0000","last_became_peered":"2023-08-18T20:43:43.611092+0000","last_unstale":"2023-08-18T20:43:45.618198+0000","last_undegraded":"2023-08-18T20:43:45.618198+0000","last_fullsized":"2023-08-18T20:43:45.618198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714288+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:43:45.714288+0000","last_peered":"2023-08-18T20:43:45.714288+0000","last_clean":"2023-08-18T20:43:45.714288+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:43:45.714288+0000","last_undegraded":"2023-08-18T20:43:45.714288+0000","last_fullsized":"2023-08-18T20:43:45.714288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:49.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617274+0000","last_change":"2023-08-18T20:43:44.613070+0000","last_active":"2023-08-18T20:43:45.617274+0000","last_peered":"2023-08-18T20:43:45.617274+0000","last_clean":"2023-08-18T20:43:45.617274+0000","last_became_active":"2023-08-18T20:43:44.612463+0000","last_became_peered":"2023-08-18T20:43:44.612463+0000","last_unstale":"2023-08-18T20:43:45.617274+0000","last_undegraded":"2023-08-18T20:43:45.617274+0000","last_fullsized":"2023-08-18T20:43:45.617274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:20.211699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617706+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:43:45.617706+0000","last_peered":"2023-08-18T20:43:45.617706+0000","last_clean":"2023-08-18T20:43:45.617706+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:43:45.617706+0000","last_undegraded":"2023-08-18T20:43:45.617706+0000","last_fullsized":"2023-08-18T20:43:45.617706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.609050+0000","last_change":"2023-08-18T20:43:43.613950+0000","last_active":"2023-08-18T20:43:44.609050+0000","last_peered":"2023-08-18T20:43:44.609050+0000","last_clean":"2023-08-18T20:43:44.609050+0000","last_became_active":"2023-08-18T20:43:43.613664+0000","last_became_peered":"2023-08-18T20:43:43.613664+0000","last_unstale":"2023-08-18T20:43:44.609050+0000","last_undegraded":"2023-08-18T20:43:44.609050+0000","last_fullsized":"2023-08-18T20:43:44.609050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713790+0000","last_change":"2023-08-18T20:43:44.618793+0000","last_active":"2023-08-18T20:43:45.713790+0000","last_peered":"2023-08-18T20:43:45.713790+0000","last_clean":"2023-08-18T20:43:45.713790+0000","last_became_active":"2023-08-18T20:43:44.618505+0000","last_became_peered":"2023-08-18T20:43:44.618505+0000","last_unstale":"2023-08-18T20:43:45.713790+0000","last_undegraded":"2023-08-18T20:43:45.713790+0000","last_fullsized":"2023-08-18T20:43:45.713790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612813+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:43:45.612813+0000","last_peered":"2023-08-18T20:43:45.612813+0000","last_clean":"2023-08-18T20:43:45.612813+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:43:45.612813+0000","last_undegraded":"2023-08-18T20:43:45.612813+0000","last_fullsized":"2023-08-18T20:43:45.612813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:04.764493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.621101+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:43:44.621101+0000","last_peered":"2023-08-18T20:43:44.621101+0000","last_clean":"2023-08-18T20:43:44.621101+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:43:44.621101+0000","last_undegraded":"2023-08-18T20:43:44.621101+0000","last_fullsized":"2023-08-18T20:43:44.621101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:14.161903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.604549+0000","last_change":"2023-08-18T20:43:43.613219+0000","last_active":"2023-08-18T20:43:44.604549+0000","last_peered":"2023-08-18T20:43:44.604549+0000","last_clean":"2023-08-18T20:43:44.604549+0000","last_became_active":"2023-08-18T20:43:43.612915+0000","last_became_peered":"2023-08-18T20:43:43.612915+0000","last_unstale":"2023-08-18T20:43:44.604549+0000","last_undegraded":"2023-08-18T20:43:44.604549+0000","last_fullsized":"2023-08-18T20:43:44.604549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:50.143697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620392+0000","last_change":"2023-08-18T20:43:44.617320+0000","last_active":"2023-08-18T20:43:44.620392+0000","last_peered":"2023-08-18T20:43:44.620392+0000","last_clean":"2023-08-18T20:43:44.620392+0000","last_became_active":"2023-08-18T20:43:44.617066+0000","last_became_peered":"2023-08-18T20:43:44.617066+0000","last_unstale":"2023-08-18T20:43:44.620392+0000","last_undegraded":"2023-08-18T20:43:44.620392+0000","last_fullsized":"2023-08-18T20:43:44.620392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:31:15.186595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.613603+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:43:44.613603+0000","last_peered":"2023-08-18T20:43:44.613603+0000","last_clean":"2023-08-18T20:43:44.613603+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:43:44.613603+0000","last_undegraded":"2023-08-18T20:43:44.613603+0000","last_fullsized":"2023-08-18T20:43:44.613603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:56:06.351754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612853+0000","last_change":"2023-08-18T20:43:43.613422+0000","last_active":"2023-08-18T20:43:45.612853+0000","last_peered":"2023-08-18T20:43:45.612853+0000","last_clean":"2023-08-18T20:43:45.612853+0000","last_became_active":"2023-08-18T20:43:43.613191+0000","last_became_peered":"2023-08-18T20:43:43.613191+0000","last_unstale":"2023-08-18T20:43:45.612853+0000","last_undegraded":"2023-08-18T20:43:45.612853+0000","last_fullsized":"2023-08-18T20:43:45.612853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613301+0000","last_change":"2023-08-18T20:43:44.623058+0000","last_active":"2023-08-18T20:43:45.613301+0000","last_peered":"2023-08-18T20:43:45.613301+0000","last_clean":"2023-08-18T20:43:45.613301+0000","last_became_active":"2023-08-18T20:43:44.622774+0000","last_became_peered":"2023-08-18T20:43:44.622774+0000","last_unstale":"2023-08-18T20:43:45.613301+0000","last_undegraded":"2023-08-18T20:43:45.613301+0000","last_fullsized":"2023-08-18T20:43:45.613301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.613550+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:43:44.613550+0000","last_peered":"2023-08-18T20:43:44.613550+0000","last_clean":"2023-08-18T20:43:44.613550+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:43:44.613550+0000","last_undegraded":"2023-08-18T20:43:44.613550+0000","last_fullsized":"2023-08-18T20:43:44.613550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:31:03.570018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617483+0000","last_change":"2023-08-18T20:43:43.610119+0000","last_active":"2023-08-18T20:43:45.617483+0000","last_peered":"2023-08-18T20:43:45.617483+0000","last_clean":"2023-08-18T20:43:45.617483+0000","last_became_active":"2023-08-18T20:43:43.609659+0000","last_became_peered":"2023-08-18T20:43:43.609659+0000","last_unstale":"2023-08-18T20:43:45.617483+0000","last_undegraded":"2023-08-18T20:43:45.617483+0000","last_fullsized":"2023-08-18T20:43:45.617483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:06:20.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618138+0000","last_change":"2023-08-18T20:43:44.617516+0000","last_active":"2023-08-18T20:43:45.618138+0000","last_peered":"2023-08-18T20:43:45.618138+0000","last_clean":"2023-08-18T20:43:45.618138+0000","last_became_active":"2023-08-18T20:43:44.617219+0000","last_became_peered":"2023-08-18T20:43:44.617219+0000","last_unstale":"2023-08-18T20:43:45.618138+0000","last_undegraded":"2023-08-18T20:43:45.618138+0000","last_fullsized":"2023-08-18T20:43:45.618138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.603532+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:43:44.603532+0000","last_peered":"2023-08-18T20:43:44.603532+0000","last_clean":"2023-08-18T20:43:44.603532+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:43:44.603532+0000","last_undegraded":"2023-08-18T20:43:44.603532+0000","last_fullsized":"2023-08-18T20:43:44.603532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:11.526418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713952+0000","last_change":"2023-08-18T20:43:43.611453+0000","last_active":"2023-08-18T20:43:45.713952+0000","last_peered":"2023-08-18T20:43:45.713952+0000","last_clean":"2023-08-18T20:43:45.713952+0000","last_became_active":"2023-08-18T20:43:43.611180+0000","last_became_peered":"2023-08-18T20:43:43.611180+0000","last_unstale":"2023-08-18T20:43:45.713952+0000","last_undegraded":"2023-08-18T20:43:45.713952+0000","last_fullsized":"2023-08-18T20:43:45.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613427+0000","last_change":"2023-08-18T20:43:44.615672+0000","last_active":"2023-08-18T20:43:45.613427+0000","last_peered":"2023-08-18T20:43:45.613427+0000","last_clean":"2023-08-18T20:43:45.613427+0000","last_became_active":"2023-08-18T20:43:44.615430+0000","last_became_peered":"2023-08-18T20:43:44.615430+0000","last_unstale":"2023-08-18T20:43:45.613427+0000","last_undegraded":"2023-08-18T20:43:45.613427+0000","last_fullsized":"2023-08-18T20:43:45.613427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618058+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:43:45.618058+0000","last_peered":"2023-08-18T20:43:45.618058+0000","last_clean":"2023-08-18T20:43:45.618058+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:43:45.618058+0000","last_undegraded":"2023-08-18T20:43:45.618058+0000","last_fullsized":"2023-08-18T20:43:45.618058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:36.724764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613478+0000","last_change":"2023-08-18T20:43:43.617151+0000","last_active":"2023-08-18T20:43:45.613478+0000","last_peered":"2023-08-18T20:43:45.613478+0000","last_clean":"2023-08-18T20:43:45.613478+0000","last_became_active":"2023-08-18T20:43:43.616926+0000","last_became_peered":"2023-08-18T20:43:43.616926+0000","last_unstale":"2023-08-18T20:43:45.613478+0000","last_undegraded":"2023-08-18T20:43:45.613478+0000","last_fullsized":"2023-08-18T20:43:45.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624002+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:44.624002+0000","last_peered":"2023-08-18T20:43:44.624002+0000","last_clean":"2023-08-18T20:43:44.624002+0000","last_became_active":"2023-08-18T20:43:44.620156+0000","last_became_peered":"2023-08-18T20:43:44.620156+0000","last_unstale":"2023-08-18T20:43:44.624002+0000","last_undegraded":"2023-08-18T20:43:44.624002+0000","last_fullsized":"2023-08-18T20:43:44.624002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:20.563841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618184+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:43:45.618184+0000","last_peered":"2023-08-18T20:43:45.618184+0000","last_clean":"2023-08-18T20:43:45.618184+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:43:45.618184+0000","last_undegraded":"2023-08-18T20:43:45.618184+0000","last_fullsized":"2023-08-18T20:43:45.618184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:54.431916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.605289+0000","last_change":"2023-08-18T20:43:43.608982+0000","last_active":"2023-08-18T20:43:44.605289+0000","last_peered":"2023-08-18T20:43:44.605289+0000","last_clean":"2023-08-18T20:43:44.605289+0000","last_became_active":"2023-08-18T20:43:43.608436+0000","last_became_peered":"2023-08-18T20:43:43.608436+0000","last_unstale":"2023-08-18T20:43:44.605289+0000","last_undegraded":"2023-08-18T20:43:44.605289+0000","last_fullsized":"2023-08-18T20:43:44.605289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613067+0000","last_change":"2023-08-18T20:43:44.622842+0000","last_active":"2023-08-18T20:43:45.613067+0000","last_peered":"2023-08-18T20:43:45.613067+0000","last_clean":"2023-08-18T20:43:45.613067+0000","last_became_active":"2023-08-18T20:43:44.622577+0000","last_became_peered":"2023-08-18T20:43:44.622577+0000","last_unstale":"2023-08-18T20:43:45.613067+0000","last_undegraded":"2023-08-18T20:43:45.613067+0000","last_fullsized":"2023-08-18T20:43:45.613067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623724+0000","last_change":"2023-08-18T20:43:43.613207+0000","last_active":"2023-08-18T20:43:44.623724+0000","last_peered":"2023-08-18T20:43:44.623724+0000","last_clean":"2023-08-18T20:43:44.623724+0000","last_became_active":"2023-08-18T20:43:43.612885+0000","last_became_peered":"2023-08-18T20:43:43.612885+0000","last_unstale":"2023-08-18T20:43:44.623724+0000","last_undegraded":"2023-08-18T20:43:44.623724+0000","last_fullsized":"2023-08-18T20:43:44.623724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:18:13.570590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.619092+0000","last_change":"2023-08-18T20:43:44.617706+0000","last_active":"2023-08-18T20:43:44.619092+0000","last_peered":"2023-08-18T20:43:44.619092+0000","last_clean":"2023-08-18T20:43:44.619092+0000","last_became_active":"2023-08-18T20:43:44.617472+0000","last_became_peered":"2023-08-18T20:43:44.617472+0000","last_unstale":"2023-08-18T20:43:44.619092+0000","last_undegraded":"2023-08-18T20:43:44.619092+0000","last_fullsized":"2023-08-18T20:43:44.619092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:32:32.539141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618531+0000","last_change":"2023-08-18T20:43:43.610453+0000","last_active":"2023-08-18T20:43:44.618531+0000","last_peered":"2023-08-18T20:43:44.618531+0000","last_clean":"2023-08-18T20:43:44.618531+0000","last_became_active":"2023-08-18T20:43:43.609644+0000","last_became_peered":"2023-08-18T20:43:43.609644+0000","last_unstale":"2023-08-18T20:43:44.618531+0000","last_undegraded":"2023-08-18T20:43:44.618531+0000","last_fullsized":"2023-08-18T20:43:44.618531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714226+0000","last_change":"2023-08-18T20:43:44.621321+0000","last_active":"2023-08-18T20:43:45.714226+0000","last_peered":"2023-08-18T20:43:45.714226+0000","last_clean":"2023-08-18T20:43:45.714226+0000","last_became_active":"2023-08-18T20:43:44.621044+0000","last_became_peered":"2023-08-18T20:43:44.621044+0000","last_unstale":"2023-08-18T20:43:45.714226+0000","last_undegraded":"2023-08-18T20:43:45.714226+0000","last_fullsized":"2023-08-18T20:43:45.714226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:35.764016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618660+0000","last_change":"2023-08-18T20:43:43.614525+0000","last_active":"2023-08-18T20:43:44.618660+0000","last_peered":"2023-08-18T20:43:44.618660+0000","last_clean":"2023-08-18T20:43:44.618660+0000","last_became_active":"2023-08-18T20:43:43.614214+0000","last_became_peered":"2023-08-18T20:43:43.614214+0000","last_unstale":"2023-08-18T20:43:44.618660+0000","last_undegraded":"2023-08-18T20:43:44.618660+0000","last_fullsized":"2023-08-18T20:43:44.618660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:41.765361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713962+0000","last_change":"2023-08-18T20:43:44.620995+0000","last_active":"2023-08-18T20:43:45.713962+0000","last_peered":"2023-08-18T20:43:45.713962+0000","last_clean":"2023-08-18T20:43:45.713962+0000","last_became_active":"2023-08-18T20:43:44.620698+0000","last_became_peered":"2023-08-18T20:43:44.620698+0000","last_unstale":"2023-08-18T20:43:45.713962+0000","last_undegraded":"2023-08-18T20:43:45.713962+0000","last_fullsized":"2023-08-18T20:43:45.713962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:19.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617903+0000","last_change":"2023-08-18T20:43:43.599844+0000","last_active":"2023-08-18T20:43:45.617903+0000","last_peered":"2023-08-18T20:43:45.617903+0000","last_clean":"2023-08-18T20:43:45.617903+0000","last_became_active":"2023-08-18T20:43:43.599644+0000","last_became_peered":"2023-08-18T20:43:43.599644+0000","last_unstale":"2023-08-18T20:43:45.617903+0000","last_undegraded":"2023-08-18T20:43:45.617903+0000","last_fullsized":"2023-08-18T20:43:45.617903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:53.036037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617578+0000","last_change":"2023-08-18T20:43:44.613247+0000","last_active":"2023-08-18T20:43:45.617578+0000","last_peered":"2023-08-18T20:43:45.617578+0000","last_clean":"2023-08-18T20:43:45.617578+0000","last_became_active":"2023-08-18T20:43:44.611831+0000","last_became_peered":"2023-08-18T20:43:44.611831+0000","last_unstale":"2023-08-18T20:43:45.617578+0000","last_undegraded":"2023-08-18T20:43:45.617578+0000","last_fullsized":"2023-08-18T20:43:45.617578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.619632+0000","last_change":"2023-08-18T20:43:43.611094+0000","last_active":"2023-08-18T20:43:44.619632+0000","last_peered":"2023-08-18T20:43:44.619632+0000","last_clean":"2023-08-18T20:43:44.619632+0000","last_became_active":"2023-08-18T20:43:43.610833+0000","last_became_peered":"2023-08-18T20:43:43.610833+0000","last_unstale":"2023-08-18T20:43:44.619632+0000","last_undegraded":"2023-08-18T20:43:44.619632+0000","last_fullsized":"2023-08-18T20:43:44.619632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:49.126137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713650+0000","last_change":"2023-08-18T20:43:44.613774+0000","last_active":"2023-08-18T20:43:45.713650+0000","last_peered":"2023-08-18T20:43:45.713650+0000","last_clean":"2023-08-18T20:43:45.713650+0000","last_became_active":"2023-08-18T20:43:44.613493+0000","last_became_peered":"2023-08-18T20:43:44.613493+0000","last_unstale":"2023-08-18T20:43:45.713650+0000","last_undegraded":"2023-08-18T20:43:45.713650+0000","last_fullsized":"2023-08-18T20:43:45.713650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617919+0000","last_change":"2023-08-18T20:43:44.612368+0000","last_active":"2023-08-18T20:43:45.617919+0000","last_peered":"2023-08-18T20:43:45.617919+0000","last_clean":"2023-08-18T20:43:45.617919+0000","last_became_active":"2023-08-18T20:43:44.611952+0000","last_became_peered":"2023-08-18T20:43:44.611952+0000","last_unstale":"2023-08-18T20:43:45.617919+0000","last_undegraded":"2023-08-18T20:43:45.617919+0000","last_fullsized":"2023-08-18T20:43:45.617919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:48.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617451+0000","last_change":"2023-08-18T20:43:44.603180+0000","last_active":"2023-08-18T20:43:45.617451+0000","last_peered":"2023-08-18T20:43:45.617451+0000","last_clean":"2023-08-18T20:43:45.617451+0000","last_became_active":"2023-08-18T20:43:44.602914+0000","last_became_peered":"2023-08-18T20:43:44.602914+0000","last_unstale":"2023-08-18T20:43:45.617451+0000","last_undegraded":"2023-08-18T20:43:45.617451+0000","last_fullsized":"2023-08-18T20:43:45.617451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:26:32.716597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713791+0000","last_change":"2023-08-18T20:43:44.617909+0000","last_active":"2023-08-18T20:43:45.713791+0000","last_peered":"2023-08-18T20:43:45.713791+0000","last_clean":"2023-08-18T20:43:45.713791+0000","last_became_active":"2023-08-18T20:43:44.617629+0000","last_became_peered":"2023-08-18T20:43:44.617629+0000","last_unstale":"2023-08-18T20:43:45.713791+0000","last_undegraded":"2023-08-18T20:43:45.713791+0000","last_fullsized":"2023-08-18T20:43:45.713791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.825723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618144+0000","last_change":"2023-08-18T20:43:44.625243+0000","last_active":"2023-08-18T20:43:45.618144+0000","last_peered":"2023-08-18T20:43:45.618144+0000","last_clean":"2023-08-18T20:43:45.618144+0000","last_became_active":"2023-08-18T20:43:44.624028+0000","last_became_peered":"2023-08-18T20:43:44.624028+0000","last_unstale":"2023-08-18T20:43:45.618144+0000","last_undegraded":"2023-08-18T20:43:45.618144+0000","last_fullsized":"2023-08-18T20:43:45.618144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613366+0000","last_change":"2023-08-18T20:43:44.613989+0000","last_active":"2023-08-18T20:43:45.613366+0000","last_peered":"2023-08-18T20:43:45.613366+0000","last_clean":"2023-08-18T20:43:45.613366+0000","last_became_active":"2023-08-18T20:43:44.613732+0000","last_became_peered":"2023-08-18T20:43:44.613732+0000","last_unstale":"2023-08-18T20:43:45.613366+0000","last_undegraded":"2023-08-18T20:43:45.613366+0000","last_fullsized":"2023-08-18T20:43:45.613366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":667789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":665961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":76175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:43:48.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:43:48.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.877+0000 7fe1bee53700 1 Processor -- start 2023-08-18T20:43:48.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.877+0000 7fe1bee53700 1 -- start start 2023-08-18T20:43:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bee53700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe1b8152450 0x7fe1b814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bee53700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b81529a0 con 0x7fe1b80c7440 2023-08-18T20:43:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bee53700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b8152c80 con 0x7fe1b806fd30 2023-08-18T20:43:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bee53700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b8152f60 con 0x7fe1b8152450 2023-08-18T20:43:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bd3f0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe1b8152450 0x7fe1b814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1b7fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe1b80c7440 0x7fe1b814f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46644/0 (socket says 172.21.15.121:46644) 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1b7fff700 1 -- 172.21.15.121:0/2833271410 learned_addr learned my addr 172.21.15.121:0/2833271410 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2833271410 >> v1:172.21.15.122:6789/0 conn(0x7fe1b806fd30 legacy=0x7fe1b80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2833271410 >> v1:172.21.15.121:6789/0 conn(0x7fe1b80c7440 legacy=0x7fe1b814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1b77fe700 1 -- 172.21.15.121:0/2833271410 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038150267 0 0) 0x7fe1b81529a0 con 0x7fe1b80c7440 2023-08-18T20:43:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2833271410 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8153240 con 0x7fe1b8152450 2023-08-18T20:43:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1bd3f0700 1 --2- 172.21.15.121:0/2833271410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b814fac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009d90 tx=0x7fe1b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f39620bc3d5852 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.878+0000 7fe1b77fe700 1 -- 172.21.15.121:0/2833271410 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000e070 con 0x7fe1b8152450 2023-08-18T20:43:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1b77fe700 1 -- 172.21.15.121:0/2833271410 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000bbd0 con 0x7fe1b8152450 2023-08-18T20:43:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1b77fe700 1 -- 172.21.15.121:0/2833271410 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0012430 con 0x7fe1b8152450 2023-08-18T20:43:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 -- 172.21.15.121:0/2833271410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 msgr2=0x7fe1b814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2833271410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b814fac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009d90 tx=0x7fe1b000b330 comp rx=0 tx=0).stop 2023-08-18T20:43:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 -- 172.21.15.121:0/2833271410 shutdown_connections 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2833271410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b814fac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 -- 172.21.15.121:0/2833271410 >> 172.21.15.121:0/2833271410 conn(0x7fe1b80c7bf0 msgr2=0x7fe1b80c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 -- 172.21.15.121:0/2833271410 shutdown_connections 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.879+0000 7fe1bee53700 1 -- 172.21.15.121:0/2833271410 wait complete. 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.880+0000 7fe1bee53700 1 Processor -- start 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.880+0000 7fe1bee53700 1 -- start start 2023-08-18T20:43:48.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 0x7fe1b80c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1b80c7440 0x7fe1b81eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81eb960 con 0x7fe1b8152450 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80bd920 con 0x7fe1b806fd30 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bee53700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80be8e0 con 0x7fe1b80c7440 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bd3f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bd3f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40070/0 (socket says 172.21.15.121:40070) 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2759401083 learned_addr learned my addr 172.21.15.121:0/2759401083 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1bcbef700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 0x7fe1b80c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.881+0000 7fe1b7fff700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1b80c7440 0x7fe1b81eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1b80c7440 msgr2=0x7fe1b81eaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1b80c7440 0x7fe1b81eaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 msgr2=0x7fe1b80c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:48.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 0x7fe1b80c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 -- 172.21.15.121:0/2759401083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009a70 con 0x7fe1b8152450 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bcbef700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 0x7fe1b80c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bd3f0700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0014040 tx=0x7fe1b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0012430 con 0x7fe1b8152450 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0020070 con 0x7fe1b8152450 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b80bf6a0 con 0x7fe1b8152450 2023-08-18T20:43:48.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0004280 con 0x7fe1b8152450 2023-08-18T20:43:48.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.882+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b80a7020 con 0x7fe1b8152450 2023-08-18T20:43:48.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.883+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b8074730 con 0x7fe1b8152450 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.883+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1b00043e0 con 0x7fe1b8152450 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.884+0000 7fe1b57fa700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 0x7fe19c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.884+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1b0022070 con 0x7fe1b8152450 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.884+0000 7fe1bcbef700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 0x7fe19c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.884+0000 7fe1bcbef700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 0x7fe19c06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1b81eced0 tx=0x7fe1ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:48.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:48.888+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe1b0055fe0 con 0x7fe1b8152450 2023-08-18T20:43:48.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:43:48.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:43:49.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.081+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1b80c3580 con 0x7fe19c06a0e0 2023-08-18T20:43:49.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.089+0000 7fe1b57fa700 1 -- 172.21.15.121:0/2759401083 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286941 (secure 0 0 0) 0x7fe1ac001c40 con 0x7fe19c06a0e0 2023-08-18T20:43:49.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 msgr2=0x7fe19c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 0x7fe19c06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1b81eced0 tx=0x7fe1ac009040 comp rx=0 tx=0).stop 2023-08-18T20:43:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 msgr2=0x7fe1b81eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0014040 tx=0x7fe1b0004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 shutdown_connections 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe19c06a0e0 0x7fe19c06c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b8152450 0x7fe1b81eb420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1b806fd30 0x7fe1b80c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 --2- 172.21.15.121:0/2759401083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1b80c7440 0x7fe1b81eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 >> 172.21.15.121:0/2759401083 conn(0x7fe1b80c7bf0 msgr2=0x7fe1b80a75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.092+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 shutdown_connections 2023-08-18T20:43:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.093+0000 7fe1bee53700 1 -- 172.21.15.121:0/2759401083 wait complete. 2023-08-18T20:43:49.096 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:43:49.105 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-18T20:43:48.906284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219088,"kb_used_data":2900,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755632,"statfs":{"total":773094113280,"available":772869767168,"internally_reserved":0,"allocated":2969600,"data_stored":1796953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001407"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618129+0000","last_change":"2023-08-18T20:43:44.613436+0000","last_active":"2023-08-18T20:43:44.618129+0000","last_peered":"2023-08-18T20:43:44.618129+0000","last_clean":"2023-08-18T20:43:44.618129+0000","last_became_active":"2023-08-18T20:43:44.613171+0000","last_became_peered":"2023-08-18T20:43:44.613171+0000","last_unstale":"2023-08-18T20:43:44.618129+0000","last_undegraded":"2023-08-18T20:43:44.618129+0000","last_fullsized":"2023-08-18T20:43:44.618129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:57:06.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624412+0000","last_change":"2023-08-18T20:43:44.619506+0000","last_active":"2023-08-18T20:43:44.624412+0000","last_peered":"2023-08-18T20:43:44.624412+0000","last_clean":"2023-08-18T20:43:44.624412+0000","last_became_active":"2023-08-18T20:43:44.619216+0000","last_became_peered":"2023-08-18T20:43:44.619216+0000","last_unstale":"2023-08-18T20:43:44.624412+0000","last_undegraded":"2023-08-18T20:43:44.624412+0000","last_fullsized":"2023-08-18T20:43:44.624412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:19.797040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714146+0000","last_change":"2023-08-18T20:43:44.615835+0000","last_active":"2023-08-18T20:43:45.714146+0000","last_peered":"2023-08-18T20:43:45.714146+0000","last_clean":"2023-08-18T20:43:45.714146+0000","last_became_active":"2023-08-18T20:43:44.615439+0000","last_became_peered":"2023-08-18T20:43:44.615439+0000","last_unstale":"2023-08-18T20:43:45.714146+0000","last_undegraded":"2023-08-18T20:43:45.714146+0000","last_fullsized":"2023-08-18T20:43:45.714146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:18.373624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618189+0000","last_change":"2023-08-18T20:43:44.611672+0000","last_active":"2023-08-18T20:43:45.618189+0000","last_peered":"2023-08-18T20:43:45.618189+0000","last_clean":"2023-08-18T20:43:45.618189+0000","last_became_active":"2023-08-18T20:43:44.611355+0000","last_became_peered":"2023-08-18T20:43:44.611355+0000","last_unstale":"2023-08-18T20:43:45.618189+0000","last_undegraded":"2023-08-18T20:43:45.618189+0000","last_fullsized":"2023-08-18T20:43:45.618189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625799+0000","last_change":"2023-08-18T20:43:44.624219+0000","last_active":"2023-08-18T20:43:44.625799+0000","last_peered":"2023-08-18T20:43:44.625799+0000","last_clean":"2023-08-18T20:43:44.625799+0000","last_became_active":"2023-08-18T20:43:44.623964+0000","last_became_peered":"2023-08-18T20:43:44.623964+0000","last_unstale":"2023-08-18T20:43:44.625799+0000","last_undegraded":"2023-08-18T20:43:44.625799+0000","last_fullsized":"2023-08-18T20:43:44.625799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:17.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713758+0000","last_change":"2023-08-18T20:43:44.619846+0000","last_active":"2023-08-18T20:43:45.713758+0000","last_peered":"2023-08-18T20:43:45.713758+0000","last_clean":"2023-08-18T20:43:45.713758+0000","last_became_active":"2023-08-18T20:43:44.619591+0000","last_became_peered":"2023-08-18T20:43:44.619591+0000","last_unstale":"2023-08-18T20:43:45.713758+0000","last_undegraded":"2023-08-18T20:43:45.713758+0000","last_fullsized":"2023-08-18T20:43:45.713758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629583+0000","last_change":"2023-08-18T20:43:44.628859+0000","last_active":"2023-08-18T20:43:44.629583+0000","last_peered":"2023-08-18T20:43:44.629583+0000","last_clean":"2023-08-18T20:43:44.629583+0000","last_became_active":"2023-08-18T20:43:44.628585+0000","last_became_peered":"2023-08-18T20:43:44.628585+0000","last_unstale":"2023-08-18T20:43:44.629583+0000","last_undegraded":"2023-08-18T20:43:44.629583+0000","last_fullsized":"2023-08-18T20:43:44.629583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:24:32.949416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623937+0000","last_change":"2023-08-18T20:43:44.618307+0000","last_active":"2023-08-18T20:43:44.623937+0000","last_peered":"2023-08-18T20:43:44.623937+0000","last_clean":"2023-08-18T20:43:44.623937+0000","last_became_active":"2023-08-18T20:43:44.617977+0000","last_became_peered":"2023-08-18T20:43:44.617977+0000","last_unstale":"2023-08-18T20:43:44.623937+0000","last_undegraded":"2023-08-18T20:43:44.623937+0000","last_fullsized":"2023-08-18T20:43:44.623937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:50.135337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620511+0000","last_change":"2023-08-18T20:43:44.616362+0000","last_active":"2023-08-18T20:43:44.620511+0000","last_peered":"2023-08-18T20:43:44.620511+0000","last_clean":"2023-08-18T20:43:44.620511+0000","last_became_active":"2023-08-18T20:43:44.615973+0000","last_became_peered":"2023-08-18T20:43:44.615973+0000","last_unstale":"2023-08-18T20:43:44.620511+0000","last_undegraded":"2023-08-18T20:43:44.620511+0000","last_fullsized":"2023-08-18T20:43:44.620511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:10:37.114300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624380+0000","last_change":"2023-08-18T20:43:44.618993+0000","last_active":"2023-08-18T20:43:44.624380+0000","last_peered":"2023-08-18T20:43:44.624380+0000","last_clean":"2023-08-18T20:43:44.624380+0000","last_became_active":"2023-08-18T20:43:44.618718+0000","last_became_peered":"2023-08-18T20:43:44.618718+0000","last_unstale":"2023-08-18T20:43:44.624380+0000","last_undegraded":"2023-08-18T20:43:44.624380+0000","last_fullsized":"2023-08-18T20:43:44.624380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:48.562511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714250+0000","last_change":"2023-08-18T20:43:44.624641+0000","last_active":"2023-08-18T20:43:45.714250+0000","last_peered":"2023-08-18T20:43:45.714250+0000","last_clean":"2023-08-18T20:43:45.714250+0000","last_became_active":"2023-08-18T20:43:44.624090+0000","last_became_peered":"2023-08-18T20:43:44.624090+0000","last_unstale":"2023-08-18T20:43:45.714250+0000","last_undegraded":"2023-08-18T20:43:45.714250+0000","last_fullsized":"2023-08-18T20:43:45.714250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:21.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625951+0000","last_change":"2023-08-18T20:43:44.622302+0000","last_active":"2023-08-18T20:43:44.625951+0000","last_peered":"2023-08-18T20:43:44.625951+0000","last_clean":"2023-08-18T20:43:44.625951+0000","last_became_active":"2023-08-18T20:43:44.622083+0000","last_became_peered":"2023-08-18T20:43:44.622083+0000","last_unstale":"2023-08-18T20:43:44.625951+0000","last_undegraded":"2023-08-18T20:43:44.625951+0000","last_fullsized":"2023-08-18T20:43:44.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:56.332458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625940+0000","last_change":"2023-08-18T20:43:44.621350+0000","last_active":"2023-08-18T20:43:44.625940+0000","last_peered":"2023-08-18T20:43:44.625940+0000","last_clean":"2023-08-18T20:43:44.625940+0000","last_became_active":"2023-08-18T20:43:44.620947+0000","last_became_peered":"2023-08-18T20:43:44.620947+0000","last_unstale":"2023-08-18T20:43:44.625940+0000","last_undegraded":"2023-08-18T20:43:44.625940+0000","last_fullsized":"2023-08-18T20:43:44.625940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:27:57.704931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620536+0000","last_change":"2023-08-18T20:43:44.615387+0000","last_active":"2023-08-18T20:43:44.620536+0000","last_peered":"2023-08-18T20:43:44.620536+0000","last_clean":"2023-08-18T20:43:44.620536+0000","last_became_active":"2023-08-18T20:43:44.615141+0000","last_became_peered":"2023-08-18T20:43:44.615141+0000","last_unstale":"2023-08-18T20:43:44.620536+0000","last_undegraded":"2023-08-18T20:43:44.620536+0000","last_fullsized":"2023-08-18T20:43:44.620536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:25.637569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629770+0000","last_change":"2023-08-18T20:43:44.629068+0000","last_active":"2023-08-18T20:43:44.629770+0000","last_peered":"2023-08-18T20:43:44.629770+0000","last_clean":"2023-08-18T20:43:44.629770+0000","last_became_active":"2023-08-18T20:43:44.628499+0000","last_became_peered":"2023-08-18T20:43:44.628499+0000","last_unstale":"2023-08-18T20:43:44.629770+0000","last_undegraded":"2023-08-18T20:43:44.629770+0000","last_fullsized":"2023-08-18T20:43:44.629770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713784+0000","last_change":"2023-08-18T20:43:44.614503+0000","last_active":"2023-08-18T20:43:45.713784+0000","last_peered":"2023-08-18T20:43:45.713784+0000","last_clean":"2023-08-18T20:43:45.713784+0000","last_became_active":"2023-08-18T20:43:44.614201+0000","last_became_peered":"2023-08-18T20:43:44.614201+0000","last_unstale":"2023-08-18T20:43:45.713784+0000","last_undegraded":"2023-08-18T20:43:45.713784+0000","last_fullsized":"2023-08-18T20:43:45.713784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624155+0000","last_change":"2023-08-18T20:43:44.620433+0000","last_active":"2023-08-18T20:43:44.624155+0000","last_peered":"2023-08-18T20:43:44.624155+0000","last_clean":"2023-08-18T20:43:44.624155+0000","last_became_active":"2023-08-18T20:43:44.620183+0000","last_became_peered":"2023-08-18T20:43:44.620183+0000","last_unstale":"2023-08-18T20:43:44.624155+0000","last_undegraded":"2023-08-18T20:43:44.624155+0000","last_fullsized":"2023-08-18T20:43:44.624155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:25.637569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714292+0000","last_change":"2023-08-18T20:43:44.619040+0000","last_active":"2023-08-18T20:43:45.714292+0000","last_peered":"2023-08-18T20:43:45.714292+0000","last_clean":"2023-08-18T20:43:45.714292+0000","last_became_active":"2023-08-18T20:43:44.618758+0000","last_became_peered":"2023-08-18T20:43:44.618758+0000","last_unstale":"2023-08-18T20:43:45.714292+0000","last_undegraded":"2023-08-18T20:43:45.714292+0000","last_fullsized":"2023-08-18T20:43:45.714292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:40.432183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.615565+0000","last_change":"2023-08-18T20:43:44.610425+0000","last_active":"2023-08-18T20:43:44.615565+0000","last_peered":"2023-08-18T20:43:44.615565+0000","last_clean":"2023-08-18T20:43:44.615565+0000","last_became_active":"2023-08-18T20:43:44.610083+0000","last_became_peered":"2023-08-18T20:43:44.610083+0000","last_unstale":"2023-08-18T20:43:44.615565+0000","last_undegraded":"2023-08-18T20:43:44.615565+0000","last_fullsized":"2023-08-18T20:43:44.615565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:12.180440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714045+0000","last_change":"2023-08-18T20:43:44.617819+0000","last_active":"2023-08-18T20:43:45.714045+0000","last_peered":"2023-08-18T20:43:45.714045+0000","last_clean":"2023-08-18T20:43:45.714045+0000","last_became_active":"2023-08-18T20:43:44.617544+0000","last_became_peered":"2023-08-18T20:43:44.617544+0000","last_unstale":"2023-08-18T20:43:45.714045+0000","last_undegraded":"2023-08-18T20:43:45.714045+0000","last_fullsized":"2023-08-18T20:43:45.714045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:13.397598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629599+0000","last_change":"2023-08-18T20:43:44.628884+0000","last_active":"2023-08-18T20:43:44.629599+0000","last_peered":"2023-08-18T20:43:44.629599+0000","last_clean":"2023-08-18T20:43:44.629599+0000","last_became_active":"2023-08-18T20:43:44.628405+0000","last_became_peered":"2023-08-18T20:43:44.628405+0000","last_unstale":"2023-08-18T20:43:44.629599+0000","last_undegraded":"2023-08-18T20:43:44.629599+0000","last_fullsized":"2023-08-18T20:43:44.629599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:32.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.622743+0000","last_change":"2023-08-18T20:43:44.618393+0000","last_active":"2023-08-18T20:43:44.622743+0000","last_peered":"2023-08-18T20:43:44.622743+0000","last_clean":"2023-08-18T20:43:44.622743+0000","last_became_active":"2023-08-18T20:43:44.618136+0000","last_became_peered":"2023-08-18T20:43:44.618136+0000","last_unstale":"2023-08-18T20:43:44.622743+0000","last_undegraded":"2023-08-18T20:43:44.622743+0000","last_fullsized":"2023-08-18T20:43:44.622743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:38:55.345976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617524+0000","last_change":"2023-08-18T20:43:44.614686+0000","last_active":"2023-08-18T20:43:45.617524+0000","last_peered":"2023-08-18T20:43:45.617524+0000","last_clean":"2023-08-18T20:43:45.617524+0000","last_became_active":"2023-08-18T20:43:44.612205+0000","last_became_peered":"2023-08-18T20:43:44.612205+0000","last_unstale":"2023-08-18T20:43:45.617524+0000","last_undegraded":"2023-08-18T20:43:45.617524+0000","last_fullsized":"2023-08-18T20:43:45.617524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629601+0000","last_change":"2023-08-18T20:43:44.629057+0000","last_active":"2023-08-18T20:43:44.629601+0000","last_peered":"2023-08-18T20:43:44.629601+0000","last_clean":"2023-08-18T20:43:44.629601+0000","last_became_active":"2023-08-18T20:43:44.628753+0000","last_became_peered":"2023-08-18T20:43:44.628753+0000","last_unstale":"2023-08-18T20:43:44.629601+0000","last_undegraded":"2023-08-18T20:43:44.629601+0000","last_fullsized":"2023-08-18T20:43:44.629601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:36.173422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613163+0000","last_change":"2023-08-18T20:43:44.622856+0000","last_active":"2023-08-18T20:43:45.613163+0000","last_peered":"2023-08-18T20:43:45.613163+0000","last_clean":"2023-08-18T20:43:45.613163+0000","last_became_active":"2023-08-18T20:43:44.622446+0000","last_became_peered":"2023-08-18T20:43:44.622446+0000","last_unstale":"2023-08-18T20:43:45.613163+0000","last_undegraded":"2023-08-18T20:43:45.613163+0000","last_fullsized":"2023-08-18T20:43:45.613163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613287+0000","last_change":"2023-08-18T20:43:44.614336+0000","last_active":"2023-08-18T20:43:45.613287+0000","last_peered":"2023-08-18T20:43:45.613287+0000","last_clean":"2023-08-18T20:43:45.613287+0000","last_became_active":"2023-08-18T20:43:44.613311+0000","last_became_peered":"2023-08-18T20:43:44.613311+0000","last_unstale":"2023-08-18T20:43:45.613287+0000","last_undegraded":"2023-08-18T20:43:45.613287+0000","last_fullsized":"2023-08-18T20:43:45.613287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624532+0000","last_change":"2023-08-18T20:43:44.619472+0000","last_active":"2023-08-18T20:43:44.624532+0000","last_peered":"2023-08-18T20:43:44.624532+0000","last_clean":"2023-08-18T20:43:44.624532+0000","last_became_active":"2023-08-18T20:43:44.619129+0000","last_became_peered":"2023-08-18T20:43:44.619129+0000","last_unstale":"2023-08-18T20:43:44.624532+0000","last_undegraded":"2023-08-18T20:43:44.624532+0000","last_fullsized":"2023-08-18T20:43:44.624532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:48:48.254653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713985+0000","last_change":"2023-08-18T20:43:43.609894+0000","last_active":"2023-08-18T20:43:45.713985+0000","last_peered":"2023-08-18T20:43:45.713985+0000","last_clean":"2023-08-18T20:43:45.713985+0000","last_became_active":"2023-08-18T20:43:43.609607+0000","last_became_peered":"2023-08-18T20:43:43.609607+0000","last_unstale":"2023-08-18T20:43:45.713985+0000","last_undegraded":"2023-08-18T20:43:45.713985+0000","last_fullsized":"2023-08-18T20:43:45.713985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:01.890051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617654+0000","last_change":"2023-08-18T20:43:44.609769+0000","last_active":"2023-08-18T20:43:45.617654+0000","last_peered":"2023-08-18T20:43:45.617654+0000","last_clean":"2023-08-18T20:43:45.617654+0000","last_became_active":"2023-08-18T20:43:44.609493+0000","last_became_peered":"2023-08-18T20:43:44.609493+0000","last_unstale":"2023-08-18T20:43:45.617654+0000","last_undegraded":"2023-08-18T20:43:45.617654+0000","last_fullsized":"2023-08-18T20:43:45.617654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:16.085957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613008+0000","last_change":"2023-08-18T20:43:43.599440+0000","last_active":"2023-08-18T20:43:45.613008+0000","last_peered":"2023-08-18T20:43:45.613008+0000","last_clean":"2023-08-18T20:43:45.613008+0000","last_became_active":"2023-08-18T20:43:43.599128+0000","last_became_peered":"2023-08-18T20:43:43.599128+0000","last_unstale":"2023-08-18T20:43:45.613008+0000","last_undegraded":"2023-08-18T20:43:45.613008+0000","last_fullsized":"2023-08-18T20:43:45.613008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624751+0000","last_change":"2023-08-18T20:43:44.623290+0000","last_active":"2023-08-18T20:43:44.624751+0000","last_peered":"2023-08-18T20:43:44.624751+0000","last_clean":"2023-08-18T20:43:44.624751+0000","last_became_active":"2023-08-18T20:43:44.623038+0000","last_became_peered":"2023-08-18T20:43:44.623038+0000","last_unstale":"2023-08-18T20:43:44.624751+0000","last_undegraded":"2023-08-18T20:43:44.624751+0000","last_fullsized":"2023-08-18T20:43:44.624751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:09:15.360713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617757+0000","last_change":"2023-08-18T20:43:43.610873+0000","last_active":"2023-08-18T20:43:45.617757+0000","last_peered":"2023-08-18T20:43:45.617757+0000","last_clean":"2023-08-18T20:43:45.617757+0000","last_became_active":"2023-08-18T20:43:43.610621+0000","last_became_peered":"2023-08-18T20:43:43.610621+0000","last_unstale":"2023-08-18T20:43:45.617757+0000","last_undegraded":"2023-08-18T20:43:45.617757+0000","last_fullsized":"2023-08-18T20:43:45.617757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:10.811810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618237+0000","last_change":"2023-08-18T20:43:44.620235+0000","last_active":"2023-08-18T20:43:45.618237+0000","last_peered":"2023-08-18T20:43:45.618237+0000","last_clean":"2023-08-18T20:43:45.618237+0000","last_became_active":"2023-08-18T20:43:44.619362+0000","last_became_peered":"2023-08-18T20:43:44.619362+0000","last_unstale":"2023-08-18T20:43:45.618237+0000","last_undegraded":"2023-08-18T20:43:45.618237+0000","last_fullsized":"2023-08-18T20:43:45.618237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.606408+0000","last_change":"2023-08-18T20:43:43.610434+0000","last_active":"2023-08-18T20:43:44.606408+0000","last_peered":"2023-08-18T20:43:44.606408+0000","last_clean":"2023-08-18T20:43:44.606408+0000","last_became_active":"2023-08-18T20:43:43.610177+0000","last_became_peered":"2023-08-18T20:43:43.610177+0000","last_unstale":"2023-08-18T20:43:44.606408+0000","last_undegraded":"2023-08-18T20:43:44.606408+0000","last_fullsized":"2023-08-18T20:43:44.606408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:47.553311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618022+0000","last_change":"2023-08-18T20:43:44.600116+0000","last_active":"2023-08-18T20:43:45.618022+0000","last_peered":"2023-08-18T20:43:45.618022+0000","last_clean":"2023-08-18T20:43:45.618022+0000","last_became_active":"2023-08-18T20:43:44.599850+0000","last_became_peered":"2023-08-18T20:43:44.599850+0000","last_unstale":"2023-08-18T20:43:45.618022+0000","last_undegraded":"2023-08-18T20:43:45.618022+0000","last_fullsized":"2023-08-18T20:43:45.618022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:06.146312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.605207+0000","last_change":"2023-08-18T20:43:43.610800+0000","last_active":"2023-08-18T20:43:44.605207+0000","last_peered":"2023-08-18T20:43:44.605207+0000","last_clean":"2023-08-18T20:43:44.605207+0000","last_became_active":"2023-08-18T20:43:43.610488+0000","last_became_peered":"2023-08-18T20:43:43.610488+0000","last_unstale":"2023-08-18T20:43:44.605207+0000","last_undegraded":"2023-08-18T20:43:44.605207+0000","last_fullsized":"2023-08-18T20:43:44.605207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617668+0000","last_change":"2023-08-18T20:43:44.616549+0000","last_active":"2023-08-18T20:43:45.617668+0000","last_peered":"2023-08-18T20:43:45.617668+0000","last_clean":"2023-08-18T20:43:45.617668+0000","last_became_active":"2023-08-18T20:43:44.613672+0000","last_became_peered":"2023-08-18T20:43:44.613672+0000","last_unstale":"2023-08-18T20:43:45.617668+0000","last_undegraded":"2023-08-18T20:43:45.617668+0000","last_fullsized":"2023-08-18T20:43:45.617668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:31.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.629187+0000","last_change":"2023-08-18T20:43:43.614627+0000","last_active":"2023-08-18T20:43:44.629187+0000","last_peered":"2023-08-18T20:43:44.629187+0000","last_clean":"2023-08-18T20:43:44.629187+0000","last_became_active":"2023-08-18T20:43:43.614337+0000","last_became_peered":"2023-08-18T20:43:43.614337+0000","last_unstale":"2023-08-18T20:43:44.629187+0000","last_undegraded":"2023-08-18T20:43:44.629187+0000","last_fullsized":"2023-08-18T20:43:44.629187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:55:16.358688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613191+0000","last_change":"2023-08-18T20:43:44.617560+0000","last_active":"2023-08-18T20:43:45.613191+0000","last_peered":"2023-08-18T20:43:45.613191+0000","last_clean":"2023-08-18T20:43:45.613191+0000","last_became_active":"2023-08-18T20:43:44.617204+0000","last_became_peered":"2023-08-18T20:43:44.617204+0000","last_unstale":"2023-08-18T20:43:45.613191+0000","last_undegraded":"2023-08-18T20:43:45.613191+0000","last_fullsized":"2023-08-18T20:43:45.613191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714256+0000","last_change":"2023-08-18T20:43:43.612457+0000","last_active":"2023-08-18T20:43:45.714256+0000","last_peered":"2023-08-18T20:43:45.714256+0000","last_clean":"2023-08-18T20:43:45.714256+0000","last_became_active":"2023-08-18T20:43:43.611975+0000","last_became_peered":"2023-08-18T20:43:43.611975+0000","last_unstale":"2023-08-18T20:43:45.714256+0000","last_undegraded":"2023-08-18T20:43:45.714256+0000","last_fullsized":"2023-08-18T20:43:45.714256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:48.357748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.616260+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.615966+0000","last_became_peered":"2023-08-18T20:43:44.615966+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:29.215124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.626029+0000","last_change":"2023-08-18T20:43:43.613070+0000","last_active":"2023-08-18T20:43:44.626029+0000","last_peered":"2023-08-18T20:43:44.626029+0000","last_clean":"2023-08-18T20:43:44.626029+0000","last_became_active":"2023-08-18T20:43:43.612736+0000","last_became_peered":"2023-08-18T20:43:43.612736+0000","last_unstale":"2023-08-18T20:43:44.626029+0000","last_undegraded":"2023-08-18T20:43:44.626029+0000","last_fullsized":"2023-08-18T20:43:44.626029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:05:16.415247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617756+0000","last_change":"2023-08-18T20:43:44.609790+0000","last_active":"2023-08-18T20:43:45.617756+0000","last_peered":"2023-08-18T20:43:45.617756+0000","last_clean":"2023-08-18T20:43:45.617756+0000","last_became_active":"2023-08-18T20:43:44.609536+0000","last_became_peered":"2023-08-18T20:43:44.609536+0000","last_unstale":"2023-08-18T20:43:45.617756+0000","last_undegraded":"2023-08-18T20:43:45.617756+0000","last_fullsized":"2023-08-18T20:43:45.617756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:40.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.608376+0000","last_change":"2023-08-18T20:43:43.611373+0000","last_active":"2023-08-18T20:43:44.608376+0000","last_peered":"2023-08-18T20:43:44.608376+0000","last_clean":"2023-08-18T20:43:44.608376+0000","last_became_active":"2023-08-18T20:43:43.611071+0000","last_became_peered":"2023-08-18T20:43:43.611071+0000","last_unstale":"2023-08-18T20:43:44.608376+0000","last_undegraded":"2023-08-18T20:43:44.608376+0000","last_fullsized":"2023-08-18T20:43:44.608376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:48:47.245453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624499+0000","last_change":"2023-08-18T20:43:44.618343+0000","last_active":"2023-08-18T20:43:44.624499+0000","last_peered":"2023-08-18T20:43:44.624499+0000","last_clean":"2023-08-18T20:43:44.624499+0000","last_became_active":"2023-08-18T20:43:44.618015+0000","last_became_peered":"2023-08-18T20:43:44.618015+0000","last_unstale":"2023-08-18T20:43:44.624499+0000","last_undegraded":"2023-08-18T20:43:44.624499+0000","last_fullsized":"2023-08-18T20:43:44.624499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:18:14.579789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.615853+0000","last_change":"2023-08-18T20:43:43.613459+0000","last_active":"2023-08-18T20:43:44.615853+0000","last_peered":"2023-08-18T20:43:44.615853+0000","last_clean":"2023-08-18T20:43:44.615853+0000","last_became_active":"2023-08-18T20:43:43.613116+0000","last_became_peered":"2023-08-18T20:43:43.613116+0000","last_unstale":"2023-08-18T20:43:44.615853+0000","last_undegraded":"2023-08-18T20:43:44.615853+0000","last_fullsized":"2023-08-18T20:43:44.615853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:34:15.469922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620372+0000","last_change":"2023-08-18T20:43:44.613785+0000","last_active":"2023-08-18T20:43:44.620372+0000","last_peered":"2023-08-18T20:43:44.620372+0000","last_clean":"2023-08-18T20:43:44.620372+0000","last_became_active":"2023-08-18T20:43:44.612998+0000","last_became_peered":"2023-08-18T20:43:44.612998+0000","last_unstale":"2023-08-18T20:43:44.620372+0000","last_undegraded":"2023-08-18T20:43:44.620372+0000","last_fullsized":"2023-08-18T20:43:44.620372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:42:03.998531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617840+0000","last_change":"2023-08-18T20:43:43.611887+0000","last_active":"2023-08-18T20:43:45.617840+0000","last_peered":"2023-08-18T20:43:45.617840+0000","last_clean":"2023-08-18T20:43:45.617840+0000","last_became_active":"2023-08-18T20:43:43.611272+0000","last_became_peered":"2023-08-18T20:43:43.611272+0000","last_unstale":"2023-08-18T20:43:45.617840+0000","last_undegraded":"2023-08-18T20:43:45.617840+0000","last_fullsized":"2023-08-18T20:43:45.617840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618290+0000","last_change":"2023-08-18T20:43:44.625002+0000","last_active":"2023-08-18T20:43:45.618290+0000","last_peered":"2023-08-18T20:43:45.618290+0000","last_clean":"2023-08-18T20:43:45.618290+0000","last_became_active":"2023-08-18T20:43:44.624280+0000","last_became_peered":"2023-08-18T20:43:44.624280+0000","last_unstale":"2023-08-18T20:43:45.618290+0000","last_undegraded":"2023-08-18T20:43:45.618290+0000","last_fullsized":"2023-08-18T20:43:45.618290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625065+0000","last_change":"2023-08-18T20:43:43.613335+0000","last_active":"2023-08-18T20:43:44.625065+0000","last_peered":"2023-08-18T20:43:44.625065+0000","last_clean":"2023-08-18T20:43:44.625065+0000","last_became_active":"2023-08-18T20:43:43.613099+0000","last_became_peered":"2023-08-18T20:43:43.613099+0000","last_unstale":"2023-08-18T20:43:44.625065+0000","last_undegraded":"2023-08-18T20:43:44.625065+0000","last_fullsized":"2023-08-18T20:43:44.625065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:08:47.643571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624427+0000","last_change":"2023-08-18T20:43:44.618882+0000","last_active":"2023-08-18T20:43:44.624427+0000","last_peered":"2023-08-18T20:43:44.624427+0000","last_clean":"2023-08-18T20:43:44.624427+0000","last_became_active":"2023-08-18T20:43:44.618569+0000","last_became_peered":"2023-08-18T20:43:44.618569+0000","last_unstale":"2023-08-18T20:43:44.624427+0000","last_undegraded":"2023-08-18T20:43:44.624427+0000","last_fullsized":"2023-08-18T20:43:44.624427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:20.563841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625923+0000","last_change":"2023-08-18T20:43:43.613693+0000","last_active":"2023-08-18T20:43:44.625923+0000","last_peered":"2023-08-18T20:43:44.625923+0000","last_clean":"2023-08-18T20:43:44.625923+0000","last_became_active":"2023-08-18T20:43:43.613209+0000","last_became_peered":"2023-08-18T20:43:43.613209+0000","last_unstale":"2023-08-18T20:43:44.625923+0000","last_undegraded":"2023-08-18T20:43:44.625923+0000","last_fullsized":"2023-08-18T20:43:44.625923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:14.366210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713787+0000","last_change":"2023-08-18T20:43:44.624612+0000","last_active":"2023-08-18T20:43:45.713787+0000","last_peered":"2023-08-18T20:43:45.713787+0000","last_clean":"2023-08-18T20:43:45.713787+0000","last_became_active":"2023-08-18T20:43:44.624178+0000","last_became_peered":"2023-08-18T20:43:44.624178+0000","last_unstale":"2023-08-18T20:43:45.713787+0000","last_undegraded":"2023-08-18T20:43:45.713787+0000","last_fullsized":"2023-08-18T20:43:45.713787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.625924+0000","last_change":"2023-08-18T20:43:43.610565+0000","last_active":"2023-08-18T20:43:44.625924+0000","last_peered":"2023-08-18T20:43:44.625924+0000","last_clean":"2023-08-18T20:43:44.625924+0000","last_became_active":"2023-08-18T20:43:43.610257+0000","last_became_peered":"2023-08-18T20:43:43.610257+0000","last_unstale":"2023-08-18T20:43:44.625924+0000","last_undegraded":"2023-08-18T20:43:44.625924+0000","last_fullsized":"2023-08-18T20:43:44.625924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:44.297879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618026+0000","last_change":"2023-08-18T20:43:44.624063+0000","last_active":"2023-08-18T20:43:45.618026+0000","last_peered":"2023-08-18T20:43:45.618026+0000","last_clean":"2023-08-18T20:43:45.618026+0000","last_became_active":"2023-08-18T20:43:44.623724+0000","last_became_peered":"2023-08-18T20:43:44.623724+0000","last_unstale":"2023-08-18T20:43:45.618026+0000","last_undegraded":"2023-08-18T20:43:45.618026+0000","last_fullsized":"2023-08-18T20:43:45.618026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:21.323341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.603835+0000","last_change":"2023-08-18T20:43:43.609105+0000","last_active":"2023-08-18T20:43:44.603835+0000","last_peered":"2023-08-18T20:43:44.603835+0000","last_clean":"2023-08-18T20:43:44.603835+0000","last_became_active":"2023-08-18T20:43:43.608685+0000","last_became_peered":"2023-08-18T20:43:43.608685+0000","last_unstale":"2023-08-18T20:43:44.603835+0000","last_undegraded":"2023-08-18T20:43:44.603835+0000","last_fullsized":"2023-08-18T20:43:44.603835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623979+0000","last_change":"2023-08-18T20:43:44.618819+0000","last_active":"2023-08-18T20:43:44.623979+0000","last_peered":"2023-08-18T20:43:44.623979+0000","last_clean":"2023-08-18T20:43:44.623979+0000","last_became_active":"2023-08-18T20:43:44.618612+0000","last_became_peered":"2023-08-18T20:43:44.618612+0000","last_unstale":"2023-08-18T20:43:44.623979+0000","last_undegraded":"2023-08-18T20:43:44.623979+0000","last_fullsized":"2023-08-18T20:43:44.623979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:19.797040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618091+0000","last_change":"2023-08-18T20:43:43.612421+0000","last_active":"2023-08-18T20:43:45.618091+0000","last_peered":"2023-08-18T20:43:45.618091+0000","last_clean":"2023-08-18T20:43:45.618091+0000","last_became_active":"2023-08-18T20:43:43.612128+0000","last_became_peered":"2023-08-18T20:43:43.612128+0000","last_unstale":"2023-08-18T20:43:45.618091+0000","last_undegraded":"2023-08-18T20:43:45.618091+0000","last_fullsized":"2023-08-18T20:43:45.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714114+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:45.714114+0000","last_peered":"2023-08-18T20:43:45.714114+0000","last_clean":"2023-08-18T20:43:45.714114+0000","last_became_active":"2023-08-18T20:43:44.620147+0000","last_became_peered":"2023-08-18T20:43:44.620147+0000","last_unstale":"2023-08-18T20:43:45.714114+0000","last_undegraded":"2023-08-18T20:43:45.714114+0000","last_fullsized":"2023-08-18T20:43:45.714114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:44.950335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618011+0000","last_change":"2023-08-18T20:43:43.611666+0000","last_active":"2023-08-18T20:43:45.618011+0000","last_peered":"2023-08-18T20:43:45.618011+0000","last_clean":"2023-08-18T20:43:45.618011+0000","last_became_active":"2023-08-18T20:43:43.611286+0000","last_became_peered":"2023-08-18T20:43:43.611286+0000","last_unstale":"2023-08-18T20:43:45.618011+0000","last_undegraded":"2023-08-18T20:43:45.618011+0000","last_fullsized":"2023-08-18T20:43:45.618011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.619092+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.618797+0000","last_became_peered":"2023-08-18T20:43:44.618797+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:45.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713975+0000","last_change":"2023-08-18T20:43:43.616812+0000","last_active":"2023-08-18T20:43:45.713975+0000","last_peered":"2023-08-18T20:43:45.713975+0000","last_clean":"2023-08-18T20:43:45.713975+0000","last_became_active":"2023-08-18T20:43:43.616539+0000","last_became_peered":"2023-08-18T20:43:43.616539+0000","last_unstale":"2023-08-18T20:43:45.713975+0000","last_undegraded":"2023-08-18T20:43:45.713975+0000","last_fullsized":"2023-08-18T20:43:45.713975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:51.228568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714401+0000","last_change":"2023-08-18T20:43:44.618501+0000","last_active":"2023-08-18T20:43:45.714401+0000","last_peered":"2023-08-18T20:43:45.714401+0000","last_clean":"2023-08-18T20:43:45.714401+0000","last_became_active":"2023-08-18T20:43:44.615330+0000","last_became_peered":"2023-08-18T20:43:44.615330+0000","last_unstale":"2023-08-18T20:43:45.714401+0000","last_undegraded":"2023-08-18T20:43:45.714401+0000","last_fullsized":"2023-08-18T20:43:45.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:45:22.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617352+0000","last_change":"2023-08-18T20:43:43.602148+0000","last_active":"2023-08-18T20:43:45.617352+0000","last_peered":"2023-08-18T20:43:45.617352+0000","last_clean":"2023-08-18T20:43:45.617352+0000","last_became_active":"2023-08-18T20:43:43.601869+0000","last_became_peered":"2023-08-18T20:43:43.601869+0000","last_unstale":"2023-08-18T20:43:45.617352+0000","last_undegraded":"2023-08-18T20:43:45.617352+0000","last_fullsized":"2023-08-18T20:43:45.617352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:37.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613324+0000","last_change":"2023-08-18T20:43:44.626768+0000","last_active":"2023-08-18T20:43:45.613324+0000","last_peered":"2023-08-18T20:43:45.613324+0000","last_clean":"2023-08-18T20:43:45.613324+0000","last_became_active":"2023-08-18T20:43:44.626427+0000","last_became_peered":"2023-08-18T20:43:44.626427+0000","last_unstale":"2023-08-18T20:43:45.613324+0000","last_undegraded":"2023-08-18T20:43:45.613324+0000","last_fullsized":"2023-08-18T20:43:45.613324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:54.206575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618198+0000","last_change":"2023-08-18T20:43:43.611362+0000","last_active":"2023-08-18T20:43:45.618198+0000","last_peered":"2023-08-18T20:43:45.618198+0000","last_clean":"2023-08-18T20:43:45.618198+0000","last_became_active":"2023-08-18T20:43:43.611092+0000","last_became_peered":"2023-08-18T20:43:43.611092+0000","last_unstale":"2023-08-18T20:43:45.618198+0000","last_undegraded":"2023-08-18T20:43:45.618198+0000","last_fullsized":"2023-08-18T20:43:45.618198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714288+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:43:45.714288+0000","last_peered":"2023-08-18T20:43:45.714288+0000","last_clean":"2023-08-18T20:43:45.714288+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:43:45.714288+0000","last_undegraded":"2023-08-18T20:43:45.714288+0000","last_fullsized":"2023-08-18T20:43:45.714288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:49.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617274+0000","last_change":"2023-08-18T20:43:44.613070+0000","last_active":"2023-08-18T20:43:45.617274+0000","last_peered":"2023-08-18T20:43:45.617274+0000","last_clean":"2023-08-18T20:43:45.617274+0000","last_became_active":"2023-08-18T20:43:44.612463+0000","last_became_peered":"2023-08-18T20:43:44.612463+0000","last_unstale":"2023-08-18T20:43:45.617274+0000","last_undegraded":"2023-08-18T20:43:45.617274+0000","last_fullsized":"2023-08-18T20:43:45.617274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:20.211699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617706+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:43:45.617706+0000","last_peered":"2023-08-18T20:43:45.617706+0000","last_clean":"2023-08-18T20:43:45.617706+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:43:45.617706+0000","last_undegraded":"2023-08-18T20:43:45.617706+0000","last_fullsized":"2023-08-18T20:43:45.617706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.609050+0000","last_change":"2023-08-18T20:43:43.613950+0000","last_active":"2023-08-18T20:43:44.609050+0000","last_peered":"2023-08-18T20:43:44.609050+0000","last_clean":"2023-08-18T20:43:44.609050+0000","last_became_active":"2023-08-18T20:43:43.613664+0000","last_became_peered":"2023-08-18T20:43:43.613664+0000","last_unstale":"2023-08-18T20:43:44.609050+0000","last_undegraded":"2023-08-18T20:43:44.609050+0000","last_fullsized":"2023-08-18T20:43:44.609050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713790+0000","last_change":"2023-08-18T20:43:44.618793+0000","last_active":"2023-08-18T20:43:45.713790+0000","last_peered":"2023-08-18T20:43:45.713790+0000","last_clean":"2023-08-18T20:43:45.713790+0000","last_became_active":"2023-08-18T20:43:44.618505+0000","last_became_peered":"2023-08-18T20:43:44.618505+0000","last_unstale":"2023-08-18T20:43:45.713790+0000","last_undegraded":"2023-08-18T20:43:45.713790+0000","last_fullsized":"2023-08-18T20:43:45.713790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612813+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:43:45.612813+0000","last_peered":"2023-08-18T20:43:45.612813+0000","last_clean":"2023-08-18T20:43:45.612813+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:43:45.612813+0000","last_undegraded":"2023-08-18T20:43:45.612813+0000","last_fullsized":"2023-08-18T20:43:45.612813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:04.764493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":167,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.621101+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:43:44.621101+0000","last_peered":"2023-08-18T20:43:44.621101+0000","last_clean":"2023-08-18T20:43:44.621101+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:43:44.621101+0000","last_undegraded":"2023-08-18T20:43:44.621101+0000","last_fullsized":"2023-08-18T20:43:44.621101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:14.161903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.604549+0000","last_change":"2023-08-18T20:43:43.613219+0000","last_active":"2023-08-18T20:43:44.604549+0000","last_peered":"2023-08-18T20:43:44.604549+0000","last_clean":"2023-08-18T20:43:44.604549+0000","last_became_active":"2023-08-18T20:43:43.612915+0000","last_became_peered":"2023-08-18T20:43:43.612915+0000","last_unstale":"2023-08-18T20:43:44.604549+0000","last_undegraded":"2023-08-18T20:43:44.604549+0000","last_fullsized":"2023-08-18T20:43:44.604549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:50.143697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.620392+0000","last_change":"2023-08-18T20:43:44.617320+0000","last_active":"2023-08-18T20:43:44.620392+0000","last_peered":"2023-08-18T20:43:44.620392+0000","last_clean":"2023-08-18T20:43:44.620392+0000","last_became_active":"2023-08-18T20:43:44.617066+0000","last_became_peered":"2023-08-18T20:43:44.617066+0000","last_unstale":"2023-08-18T20:43:44.620392+0000","last_undegraded":"2023-08-18T20:43:44.620392+0000","last_fullsized":"2023-08-18T20:43:44.620392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:31:15.186595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.613603+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:43:44.613603+0000","last_peered":"2023-08-18T20:43:44.613603+0000","last_clean":"2023-08-18T20:43:44.613603+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:43:44.613603+0000","last_undegraded":"2023-08-18T20:43:44.613603+0000","last_fullsized":"2023-08-18T20:43:44.613603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:56:06.351754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612853+0000","last_change":"2023-08-18T20:43:43.613422+0000","last_active":"2023-08-18T20:43:45.612853+0000","last_peered":"2023-08-18T20:43:45.612853+0000","last_clean":"2023-08-18T20:43:45.612853+0000","last_became_active":"2023-08-18T20:43:43.613191+0000","last_became_peered":"2023-08-18T20:43:43.613191+0000","last_unstale":"2023-08-18T20:43:45.612853+0000","last_undegraded":"2023-08-18T20:43:45.612853+0000","last_fullsized":"2023-08-18T20:43:45.612853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613301+0000","last_change":"2023-08-18T20:43:44.623058+0000","last_active":"2023-08-18T20:43:45.613301+0000","last_peered":"2023-08-18T20:43:45.613301+0000","last_clean":"2023-08-18T20:43:45.613301+0000","last_became_active":"2023-08-18T20:43:44.622774+0000","last_became_peered":"2023-08-18T20:43:44.622774+0000","last_unstale":"2023-08-18T20:43:45.613301+0000","last_undegraded":"2023-08-18T20:43:45.613301+0000","last_fullsized":"2023-08-18T20:43:45.613301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.613550+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:43:44.613550+0000","last_peered":"2023-08-18T20:43:44.613550+0000","last_clean":"2023-08-18T20:43:44.613550+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:43:44.613550+0000","last_undegraded":"2023-08-18T20:43:44.613550+0000","last_fullsized":"2023-08-18T20:43:44.613550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:31:03.570018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617483+0000","last_change":"2023-08-18T20:43:43.610119+0000","last_active":"2023-08-18T20:43:45.617483+0000","last_peered":"2023-08-18T20:43:45.617483+0000","last_clean":"2023-08-18T20:43:45.617483+0000","last_became_active":"2023-08-18T20:43:43.609659+0000","last_became_peered":"2023-08-18T20:43:43.609659+0000","last_unstale":"2023-08-18T20:43:45.617483+0000","last_undegraded":"2023-08-18T20:43:45.617483+0000","last_fullsized":"2023-08-18T20:43:45.617483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:06:20.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618138+0000","last_change":"2023-08-18T20:43:44.617516+0000","last_active":"2023-08-18T20:43:45.618138+0000","last_peered":"2023-08-18T20:43:45.618138+0000","last_clean":"2023-08-18T20:43:45.618138+0000","last_became_active":"2023-08-18T20:43:44.617219+0000","last_became_peered":"2023-08-18T20:43:44.617219+0000","last_unstale":"2023-08-18T20:43:45.618138+0000","last_undegraded":"2023-08-18T20:43:45.618138+0000","last_fullsized":"2023-08-18T20:43:45.618138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.603532+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:43:44.603532+0000","last_peered":"2023-08-18T20:43:44.603532+0000","last_clean":"2023-08-18T20:43:44.603532+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:43:44.603532+0000","last_undegraded":"2023-08-18T20:43:44.603532+0000","last_fullsized":"2023-08-18T20:43:44.603532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:11.526418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713952+0000","last_change":"2023-08-18T20:43:43.611453+0000","last_active":"2023-08-18T20:43:45.713952+0000","last_peered":"2023-08-18T20:43:45.713952+0000","last_clean":"2023-08-18T20:43:45.713952+0000","last_became_active":"2023-08-18T20:43:43.611180+0000","last_became_peered":"2023-08-18T20:43:43.611180+0000","last_unstale":"2023-08-18T20:43:45.713952+0000","last_undegraded":"2023-08-18T20:43:45.713952+0000","last_fullsized":"2023-08-18T20:43:45.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613427+0000","last_change":"2023-08-18T20:43:44.615672+0000","last_active":"2023-08-18T20:43:45.613427+0000","last_peered":"2023-08-18T20:43:45.613427+0000","last_clean":"2023-08-18T20:43:45.613427+0000","last_became_active":"2023-08-18T20:43:44.615430+0000","last_became_peered":"2023-08-18T20:43:44.615430+0000","last_unstale":"2023-08-18T20:43:45.613427+0000","last_undegraded":"2023-08-18T20:43:45.613427+0000","last_fullsized":"2023-08-18T20:43:45.613427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618058+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:43:45.618058+0000","last_peered":"2023-08-18T20:43:45.618058+0000","last_clean":"2023-08-18T20:43:45.618058+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:43:45.618058+0000","last_undegraded":"2023-08-18T20:43:45.618058+0000","last_fullsized":"2023-08-18T20:43:45.618058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:36.724764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613478+0000","last_change":"2023-08-18T20:43:43.617151+0000","last_active":"2023-08-18T20:43:45.613478+0000","last_peered":"2023-08-18T20:43:45.613478+0000","last_clean":"2023-08-18T20:43:45.613478+0000","last_became_active":"2023-08-18T20:43:43.616926+0000","last_became_peered":"2023-08-18T20:43:43.616926+0000","last_unstale":"2023-08-18T20:43:45.613478+0000","last_undegraded":"2023-08-18T20:43:45.613478+0000","last_fullsized":"2023-08-18T20:43:45.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.624002+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:44.624002+0000","last_peered":"2023-08-18T20:43:44.624002+0000","last_clean":"2023-08-18T20:43:44.624002+0000","last_became_active":"2023-08-18T20:43:44.620156+0000","last_became_peered":"2023-08-18T20:43:44.620156+0000","last_unstale":"2023-08-18T20:43:44.624002+0000","last_undegraded":"2023-08-18T20:43:44.624002+0000","last_fullsized":"2023-08-18T20:43:44.624002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:20.563841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618184+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:43:45.618184+0000","last_peered":"2023-08-18T20:43:45.618184+0000","last_clean":"2023-08-18T20:43:45.618184+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:43:45.618184+0000","last_undegraded":"2023-08-18T20:43:45.618184+0000","last_fullsized":"2023-08-18T20:43:45.618184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:54.431916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.605289+0000","last_change":"2023-08-18T20:43:43.608982+0000","last_active":"2023-08-18T20:43:44.605289+0000","last_peered":"2023-08-18T20:43:44.605289+0000","last_clean":"2023-08-18T20:43:44.605289+0000","last_became_active":"2023-08-18T20:43:43.608436+0000","last_became_peered":"2023-08-18T20:43:43.608436+0000","last_unstale":"2023-08-18T20:43:44.605289+0000","last_undegraded":"2023-08-18T20:43:44.605289+0000","last_fullsized":"2023-08-18T20:43:44.605289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613067+0000","last_change":"2023-08-18T20:43:44.622842+0000","last_active":"2023-08-18T20:43:45.613067+0000","last_peered":"2023-08-18T20:43:45.613067+0000","last_clean":"2023-08-18T20:43:45.613067+0000","last_became_active":"2023-08-18T20:43:44.622577+0000","last_became_peered":"2023-08-18T20:43:44.622577+0000","last_unstale":"2023-08-18T20:43:45.613067+0000","last_undegraded":"2023-08-18T20:43:45.613067+0000","last_fullsized":"2023-08-18T20:43:45.613067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.623724+0000","last_change":"2023-08-18T20:43:43.613207+0000","last_active":"2023-08-18T20:43:44.623724+0000","last_peered":"2023-08-18T20:43:44.623724+0000","last_clean":"2023-08-18T20:43:44.623724+0000","last_became_active":"2023-08-18T20:43:43.612885+0000","last_became_peered":"2023-08-18T20:43:43.612885+0000","last_unstale":"2023-08-18T20:43:44.623724+0000","last_undegraded":"2023-08-18T20:43:44.623724+0000","last_fullsized":"2023-08-18T20:43:44.623724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:18:13.570590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.619092+0000","last_change":"2023-08-18T20:43:44.617706+0000","last_active":"2023-08-18T20:43:44.619092+0000","last_peered":"2023-08-18T20:43:44.619092+0000","last_clean":"2023-08-18T20:43:44.619092+0000","last_became_active":"2023-08-18T20:43:44.617472+0000","last_became_peered":"2023-08-18T20:43:44.617472+0000","last_unstale":"2023-08-18T20:43:44.619092+0000","last_undegraded":"2023-08-18T20:43:44.619092+0000","last_fullsized":"2023-08-18T20:43:44.619092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:32:32.539141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618531+0000","last_change":"2023-08-18T20:43:43.610453+0000","last_active":"2023-08-18T20:43:44.618531+0000","last_peered":"2023-08-18T20:43:44.618531+0000","last_clean":"2023-08-18T20:43:44.618531+0000","last_became_active":"2023-08-18T20:43:43.609644+0000","last_became_peered":"2023-08-18T20:43:43.609644+0000","last_unstale":"2023-08-18T20:43:44.618531+0000","last_undegraded":"2023-08-18T20:43:44.618531+0000","last_fullsized":"2023-08-18T20:43:44.618531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714226+0000","last_change":"2023-08-18T20:43:44.621321+0000","last_active":"2023-08-18T20:43:45.714226+0000","last_peered":"2023-08-18T20:43:45.714226+0000","last_clean":"2023-08-18T20:43:45.714226+0000","last_became_active":"2023-08-18T20:43:44.621044+0000","last_became_peered":"2023-08-18T20:43:44.621044+0000","last_unstale":"2023-08-18T20:43:45.714226+0000","last_undegraded":"2023-08-18T20:43:45.714226+0000","last_fullsized":"2023-08-18T20:43:45.714226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:35.764016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.618660+0000","last_change":"2023-08-18T20:43:43.614525+0000","last_active":"2023-08-18T20:43:44.618660+0000","last_peered":"2023-08-18T20:43:44.618660+0000","last_clean":"2023-08-18T20:43:44.618660+0000","last_became_active":"2023-08-18T20:43:43.614214+0000","last_became_peered":"2023-08-18T20:43:43.614214+0000","last_unstale":"2023-08-18T20:43:44.618660+0000","last_undegraded":"2023-08-18T20:43:44.618660+0000","last_fullsized":"2023-08-18T20:43:44.618660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:41.765361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713962+0000","last_change":"2023-08-18T20:43:44.620995+0000","last_active":"2023-08-18T20:43:45.713962+0000","last_peered":"2023-08-18T20:43:45.713962+0000","last_clean":"2023-08-18T20:43:45.713962+0000","last_became_active":"2023-08-18T20:43:44.620698+0000","last_became_peered":"2023-08-18T20:43:44.620698+0000","last_unstale":"2023-08-18T20:43:45.713962+0000","last_undegraded":"2023-08-18T20:43:45.713962+0000","last_fullsized":"2023-08-18T20:43:45.713962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:19.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617903+0000","last_change":"2023-08-18T20:43:43.599844+0000","last_active":"2023-08-18T20:43:45.617903+0000","last_peered":"2023-08-18T20:43:45.617903+0000","last_clean":"2023-08-18T20:43:45.617903+0000","last_became_active":"2023-08-18T20:43:43.599644+0000","last_became_peered":"2023-08-18T20:43:43.599644+0000","last_unstale":"2023-08-18T20:43:45.617903+0000","last_undegraded":"2023-08-18T20:43:45.617903+0000","last_fullsized":"2023-08-18T20:43:45.617903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:53.036037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617578+0000","last_change":"2023-08-18T20:43:44.613247+0000","last_active":"2023-08-18T20:43:45.617578+0000","last_peered":"2023-08-18T20:43:45.617578+0000","last_clean":"2023-08-18T20:43:45.617578+0000","last_became_active":"2023-08-18T20:43:44.611831+0000","last_became_peered":"2023-08-18T20:43:44.611831+0000","last_unstale":"2023-08-18T20:43:45.617578+0000","last_undegraded":"2023-08-18T20:43:45.617578+0000","last_fullsized":"2023-08-18T20:43:45.617578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-18T20:43:44.619632+0000","last_change":"2023-08-18T20:43:43.611094+0000","last_active":"2023-08-18T20:43:44.619632+0000","last_peered":"2023-08-18T20:43:44.619632+0000","last_clean":"2023-08-18T20:43:44.619632+0000","last_became_active":"2023-08-18T20:43:43.610833+0000","last_became_peered":"2023-08-18T20:43:43.610833+0000","last_unstale":"2023-08-18T20:43:44.619632+0000","last_undegraded":"2023-08-18T20:43:44.619632+0000","last_fullsized":"2023-08-18T20:43:44.619632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:49.126137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713650+0000","last_change":"2023-08-18T20:43:44.613774+0000","last_active":"2023-08-18T20:43:45.713650+0000","last_peered":"2023-08-18T20:43:45.713650+0000","last_clean":"2023-08-18T20:43:45.713650+0000","last_became_active":"2023-08-18T20:43:44.613493+0000","last_became_peered":"2023-08-18T20:43:44.613493+0000","last_unstale":"2023-08-18T20:43:45.713650+0000","last_undegraded":"2023-08-18T20:43:45.713650+0000","last_fullsized":"2023-08-18T20:43:45.713650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617919+0000","last_change":"2023-08-18T20:43:44.612368+0000","last_active":"2023-08-18T20:43:45.617919+0000","last_peered":"2023-08-18T20:43:45.617919+0000","last_clean":"2023-08-18T20:43:45.617919+0000","last_became_active":"2023-08-18T20:43:44.611952+0000","last_became_peered":"2023-08-18T20:43:44.611952+0000","last_unstale":"2023-08-18T20:43:45.617919+0000","last_undegraded":"2023-08-18T20:43:45.617919+0000","last_fullsized":"2023-08-18T20:43:45.617919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:48.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617451+0000","last_change":"2023-08-18T20:43:44.603180+0000","last_active":"2023-08-18T20:43:45.617451+0000","last_peered":"2023-08-18T20:43:45.617451+0000","last_clean":"2023-08-18T20:43:45.617451+0000","last_became_active":"2023-08-18T20:43:44.602914+0000","last_became_peered":"2023-08-18T20:43:44.602914+0000","last_unstale":"2023-08-18T20:43:45.617451+0000","last_undegraded":"2023-08-18T20:43:45.617451+0000","last_fullsized":"2023-08-18T20:43:45.617451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:26:32.716597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713791+0000","last_change":"2023-08-18T20:43:44.617909+0000","last_active":"2023-08-18T20:43:45.713791+0000","last_peered":"2023-08-18T20:43:45.713791+0000","last_clean":"2023-08-18T20:43:45.713791+0000","last_became_active":"2023-08-18T20:43:44.617629+0000","last_became_peered":"2023-08-18T20:43:44.617629+0000","last_unstale":"2023-08-18T20:43:45.713791+0000","last_undegraded":"2023-08-18T20:43:45.713791+0000","last_fullsized":"2023-08-18T20:43:45.713791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.825723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618144+0000","last_change":"2023-08-18T20:43:44.625243+0000","last_active":"2023-08-18T20:43:45.618144+0000","last_peered":"2023-08-18T20:43:45.618144+0000","last_clean":"2023-08-18T20:43:45.618144+0000","last_became_active":"2023-08-18T20:43:44.624028+0000","last_became_peered":"2023-08-18T20:43:44.624028+0000","last_unstale":"2023-08-18T20:43:45.618144+0000","last_undegraded":"2023-08-18T20:43:45.618144+0000","last_fullsized":"2023-08-18T20:43:45.618144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613366+0000","last_change":"2023-08-18T20:43:44.613989+0000","last_active":"2023-08-18T20:43:45.613366+0000","last_peered":"2023-08-18T20:43:45.613366+0000","last_clean":"2023-08-18T20:43:45.613366+0000","last_became_active":"2023-08-18T20:43:44.613732+0000","last_became_peered":"2023-08-18T20:43:44.613732+0000","last_unstale":"2023-08-18T20:43:45.613366+0000","last_undegraded":"2023-08-18T20:43:45.613366+0000","last_fullsized":"2023-08-18T20:43:45.613366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":667789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":665961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":76175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:43:49.112 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-18T20:43:49.113 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-18T20:43:49.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-18T20:43:49.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-18T20:43:49.114 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-18T20:43:49.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.267+0000 7f2f693fa700 1 Processor -- start 2023-08-18T20:43:49.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.267+0000 7f2f693fa700 1 -- start start 2023-08-18T20:43:49.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f693fa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f64152fa0 0x7f2f640c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f693fa700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f693fa700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f64152200 con 0x7f2f640c4170 2023-08-18T20:43:49.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f693fa700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640aa740 con 0x7f2f64152fa0 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f693fa700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f641565c0 con 0x7f2f640a71f0 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f64152fa0 0x7f2f640c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f64152fa0 0x7f2f640c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40076/0 (socket says 172.21.15.121:40076) 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 -- 172.21.15.121:0/164131755 learned_addr learned my addr 172.21.15.121:0/164131755 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f637fe700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 -- 172.21.15.121:0/164131755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 msgr2=0x7f2f640c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 -- 172.21.15.121:0/164131755 >> v1:172.21.15.122:6789/0 conn(0x7f2f640c4170 legacy=0x7f2f640c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 -- 172.21.15.121:0/164131755 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f641524c0 con 0x7f2f64152fa0 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f627fc700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f64152fa0 0x7f2f640c4550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f580098f0 tx=0x7f2f58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479e983cdbc0470c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f61ffb700 1 -- 172.21.15.121:0/164131755 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800b8a0 con 0x7f2f64152fa0 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f61ffb700 1 -- 172.21.15.121:0/164131755 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800ba00 con 0x7f2f64152fa0 2023-08-18T20:43:49.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.268+0000 7f2f61ffb700 1 -- 172.21.15.121:0/164131755 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800bd90 con 0x7f2f64152fa0 2023-08-18T20:43:49.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 -- 172.21.15.121:0/164131755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f64152fa0 msgr2=0x7f2f640c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f64152fa0 0x7f2f640c4550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f580098f0 tx=0x7f2f58009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:49.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 -- 172.21.15.121:0/164131755 shutdown_connections 2023-08-18T20:43:49.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 --2- 172.21.15.121:0/164131755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f64152fa0 0x7f2f640c4550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 -- 172.21.15.121:0/164131755 >> 172.21.15.121:0/164131755 conn(0x7f2f640a9a90 msgr2=0x7f2f640a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 -- 172.21.15.121:0/164131755 shutdown_connections 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.269+0000 7f2f693fa700 1 -- 172.21.15.121:0/164131755 wait complete. 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.271+0000 7f2f693fa700 1 Processor -- start 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.271+0000 7f2f693fa700 1 -- start start 2023-08-18T20:43:49.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f64152fa0 0x7f2f641e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f641ebc20 con 0x7f2f640c4170 2023-08-18T20:43:49.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64155690 con 0x7f2f64152fa0 2023-08-18T20:43:49.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640bebe0 con 0x7f2f640a71f0 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40082/0 (socket says 172.21.15.121:40082) 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 -- 172.21.15.121:0/2379413208 learned_addr learned my addr 172.21.15.121:0/2379413208 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f637fe700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f64152fa0 0x7f2f641e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f62ffd700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 -- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 msgr2=0x7f2f640be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 -- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f64152fa0 msgr2=0x7f2f641e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f64152fa0 0x7f2f641e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 -- 172.21.15.121:0/2379413208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009550 con 0x7f2f640c4170 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f62ffd700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f627fc700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f58014040 tx=0x7f2f58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58004590 con 0x7f2f640c4170 2023-08-18T20:43:49.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5801e070 con 0x7f2f640c4170 2023-08-18T20:43:49.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f641eafa0 con 0x7f2f640c4170 2023-08-18T20:43:49.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580038e0 con 0x7f2f640c4170 2023-08-18T20:43:49.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.272+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f641eb560 con 0x7f2f640c4170 2023-08-18T20:43:49.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.273+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f641561e0 con 0x7f2f640c4170 2023-08-18T20:43:49.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.274+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f58003a40 con 0x7f2f640c4170 2023-08-18T20:43:49.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.274+0000 7f2f4b7fe700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 0x7f2f5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.274+0000 7f2f62ffd700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 0x7f2f5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.274+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f58020070 con 0x7f2f640c4170 2023-08-18T20:43:49.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.275+0000 7f2f62ffd700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 0x7f2f5006c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f54000f60 tx=0x7f2f54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.279+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2f641561e0 con 0x7f2f640c4170 2023-08-18T20:43:49.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.531+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2f641ebd60 con 0x7f2f640c4170 2023-08-18T20:43:49.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.534+0000 7f2f4b7fe700 1 -- 172.21.15.121:0/2379413208 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169498 (secure 0 0 0) 0x7f2f641ebd60 con 0x7f2f640c4170 2023-08-18T20:43:49.536 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:49.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 msgr2=0x7f2f5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 0x7f2f5006c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f54000f60 tx=0x7f2f54009040 comp rx=0 tx=0).stop 2023-08-18T20:43:49.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 msgr2=0x7f2f640a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f58014040 tx=0x7f2f58004750 comp rx=0 tx=0).stop 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 shutdown_connections 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f64152fa0 0x7f2f641e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f640a71f0 0x7f2f640be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f5006a0e0 0x7f2f5006c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 --2- 172.21.15.121:0/2379413208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f640c4170 0x7f2f640a9060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 >> 172.21.15.121:0/2379413208 conn(0x7f2f640a9a90 msgr2=0x7f2f640c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 shutdown_connections 2023-08-18T20:43:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.536+0000 7f2f693fa700 1 -- 172.21.15.121:0/2379413208 wait complete. 2023-08-18T20:43:49.549 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2511824978},{"type":"v1","addr":"172.21.15.121:6833","nonce":2511824978}]},"active_addr":"172.21.15.121:6833/2511824978","active_change":"2023-08-18T20:43:30.894378+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":203417899}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2826141819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2751022916}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1822653978}]}]} 2023-08-18T20:43:49.553 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-18T20:43:49.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-18T20:43:49.554 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:49.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.674+0000 7f8cbc8d9700 1 Processor -- start 2023-08-18T20:43:49.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.674+0000 7f8cbc8d9700 1 -- start start 2023-08-18T20:43:49.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cbc8d9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8cb80c4170 0x7f8cb80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cbc8d9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8cb8152fa0 0x7f8cb80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cbc8d9700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb8152200 con 0x7f8cb80a71f0 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cbc8d9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80aa740 con 0x7f8cb80c4170 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cbc8d9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb81565c0 con 0x7f8cb8152fa0 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.675+0000 7f8cb659c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8cb80c4170 0x7f8cb80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8cb80c4170 0x7f8cb80c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40088/0 (socket says 172.21.15.121:40088) 2023-08-18T20:43:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 -- 172.21.15.121:0/3528575269 learned_addr learned my addr 172.21.15.121:0/3528575269 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb5d9b700 1 --2- 172.21.15.121:0/3528575269 >> v2:172.21.15.122:3300/0 conn(0x7f8cb8152fa0 0x7f8cb80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 -- 172.21.15.121:0/3528575269 >> v2:172.21.15.122:3300/0 conn(0x7f8cb8152fa0 msgr2=0x7f8cb80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 --2- 172.21.15.121:0/3528575269 >> v2:172.21.15.122:3300/0 conn(0x7f8cb8152fa0 0x7f8cb80c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 -- 172.21.15.121:0/3528575269 >> v1:172.21.15.122:6789/0 conn(0x7f8cb80a71f0 legacy=0x7f8cb80c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 -- 172.21.15.121:0/3528575269 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb81524c0 con 0x7f8cb80c4170 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb659c700 1 --2- 172.21.15.121:0/3528575269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80c4170 0x7f8cb80c5d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80a79d0 tx=0x7f8ca8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d939caa15d7ef5f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb559a700 1 -- 172.21.15.121:0/3528575269 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8011830 con 0x7f8cb80c4170 2023-08-18T20:43:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb559a700 1 -- 172.21.15.121:0/3528575269 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8011990 con 0x7f8cb80c4170 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.676+0000 7f8cb559a700 1 -- 172.21.15.121:0/3528575269 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8011d20 con 0x7f8cb80c4170 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3528575269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80c4170 msgr2=0x7f8cb80c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3528575269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80c4170 0x7f8cb80c5d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80a79d0 tx=0x7f8ca8009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3528575269 shutdown_connections 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3528575269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80c4170 0x7f8cb80c5d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3528575269 >> v2:172.21.15.122:3300/0 conn(0x7f8cb8152fa0 0x7f8cb80c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3528575269 >> 172.21.15.121:0/3528575269 conn(0x7f8cb80a9a90 msgr2=0x7f8cb80a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3528575269 shutdown_connections 2023-08-18T20:43:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.677+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3528575269 wait complete. 2023-08-18T20:43:49.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.678+0000 7f8cbc8d9700 1 Processor -- start 2023-08-18T20:43:49.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.678+0000 7f8cbc8d9700 1 -- start start 2023-08-18T20:43:49.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cb80c4170 0x7f8cb8151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cb8152fa0 0x7f8cb81ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80c0fe0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80beca0 con 0x7f8cb80c4170 2023-08-18T20:43:49.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cbc8d9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80c1580 con 0x7f8cb8152fa0 2023-08-18T20:43:49.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40094/0 (socket says 172.21.15.121:40094) 2023-08-18T20:43:49.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 -- 172.21.15.121:0/3769596327 learned_addr learned my addr 172.21.15.121:0/3769596327 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:49.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb5d9b700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cb80c4170 0x7f8cb8151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb6d9d700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cb8152fa0 0x7f8cb81ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 -- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cb8152fa0 msgr2=0x7f8cb81ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cb8152fa0 0x7f8cb81ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 -- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cb80c4170 msgr2=0x7f8cb8151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cb80c4170 0x7f8cb8151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 -- 172.21.15.121:0/3769596327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8009550 con 0x7f8cb80a71f0 2023-08-18T20:43:49.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.679+0000 7f8cb659c700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8004590 con 0x7f8cb80a71f0 2023-08-18T20:43:49.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80036a0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80be6e0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb80c1210 con 0x7f8cb80a71f0 2023-08-18T20:43:49.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8003a50 con 0x7f8cb80a71f0 2023-08-18T20:43:49.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.680+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c0052f0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.681+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ca8021070 con 0x7f8cb80a71f0 2023-08-18T20:43:49.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.681+0000 7f8ca6ffd700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:49.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.682+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ca80899a0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.682+0000 7f8cb5d9b700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:49.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.682+0000 7f8cb5d9b700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80a96c0 tx=0x7f8cac009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:49.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.686+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8ca80550a0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.884+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c9c005870 con 0x7f8cb80a71f0 2023-08-18T20:43:49.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.886+0000 7f8ca6ffd700 1 -- 172.21.15.121:0/3769596327 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f8ca80586c0 con 0x7f8cb80a71f0 2023-08-18T20:43:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:49.886 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:49.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 msgr2=0x7f8c9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80a96c0 tx=0x7f8cac009210 comp rx=0 tx=0).stop 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 msgr2=0x7f8cb80c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8004750 comp rx=0 tx=0).stop 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 shutdown_connections 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cb8152fa0 0x7f8cb81ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb80a71f0 0x7f8cb80c1a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 --2- 172.21.15.121:0/3769596327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cb80c4170 0x7f8cb8151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 >> 172.21.15.121:0/3769596327 conn(0x7f8cb80a9a90 msgr2=0x7f8cb81505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 shutdown_connections 2023-08-18T20:43:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:49.888+0000 7f8cbc8d9700 1 -- 172.21.15.121:0/3769596327 wait complete. 2023-08-18T20:43:49.901 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-18T20:43:49.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:50.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.025+0000 7ff56f354700 1 Processor -- start 2023-08-18T20:43:50.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.025+0000 7ff56f354700 1 -- start start 2023-08-18T20:43:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56f354700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5680c4c00 0x7ff568155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56f354700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff5680c0450 0x7ff5680c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56f354700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568151140 con 0x7ff56814e8e0 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56f354700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff568152180 con 0x7ff5680c0450 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56f354700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681513c0 con 0x7ff5680c4c00 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56c8ef700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5680c4c00 0x7ff568155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff5680c0450 0x7ff5680c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d0f0700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff56814e8e0 0x7ff56806c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55806/0 (socket says 172.21.15.121:55806) 2023-08-18T20:43:50.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d0f0700 1 -- 172.21.15.121:0/394177731 learned_addr learned my addr 172.21.15.121:0/394177731 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 -- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5680c4c00 msgr2=0x7ff568155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 --2- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5680c4c00 0x7ff568155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 -- 172.21.15.121:0/394177731 >> v1:172.21.15.122:6789/0 conn(0x7ff56814e8e0 legacy=0x7ff56806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 -- 172.21.15.121:0/394177731 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5681516a0 con 0x7ff5680c0450 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff55ffff700 1 -- 172.21.15.121:0/394177731 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852441571 0 0) 0x7ff568151140 con 0x7ff56814e8e0 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.026+0000 7ff56d8f1700 1 --2- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c0450 0x7ff5680c08c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff560009d90 tx=0x7ff56000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a044266b33c291 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff55ffff700 1 -- 172.21.15.121:0/394177731 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000e070 con 0x7ff5680c0450 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff55ffff700 1 -- 172.21.15.121:0/394177731 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000bb20 con 0x7ff5680c0450 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff55ffff700 1 -- 172.21.15.121:0/394177731 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560012430 con 0x7ff5680c0450 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 -- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c0450 msgr2=0x7ff5680c08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 --2- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c0450 0x7ff5680c08c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff560009d90 tx=0x7ff56000b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 -- 172.21.15.121:0/394177731 shutdown_connections 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 --2- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c0450 0x7ff5680c08c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 --2- 172.21.15.121:0/394177731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5680c4c00 0x7ff568155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 -- 172.21.15.121:0/394177731 >> 172.21.15.121:0/394177731 conn(0x7ff56806a930 msgr2=0x7ff5680a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 -- 172.21.15.121:0/394177731 shutdown_connections 2023-08-18T20:43:50.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.027+0000 7ff56f354700 1 -- 172.21.15.121:0/394177731 wait complete. 2023-08-18T20:43:50.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.028+0000 7ff56f354700 1 Processor -- start 2023-08-18T20:43:50.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.028+0000 7ff56f354700 1 -- start start 2023-08-18T20:43:50.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 0x7ff568152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff56814e8e0 0x7ff5680c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681e7780 con 0x7ff5680c0450 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff568152e50 con 0x7ff5680c4c00 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56f354700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681e53a0 con 0x7ff56814e8e0 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40108/0 (socket says 172.21.15.121:40108) 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 -- 172.21.15.121:0/4081787046 learned_addr learned my addr 172.21.15.121:0/4081787046 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d8f1700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff56814e8e0 0x7ff5680c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56c8ef700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 0x7ff568152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 -- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff56814e8e0 msgr2=0x7ff5680c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff56814e8e0 0x7ff5680c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 -- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 msgr2=0x7ff568152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.029+0000 7ff56d0f0700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 0x7ff568152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff56d0f0700 1 -- 172.21.15.121:0/4081787046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009a70 con 0x7ff5680c0450 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff56c8ef700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 0x7ff568152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff56d0f0700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c520 tx=0x7ff56400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564004c80 con 0x7ff5680c0450 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564004e00 con 0x7ff5680c0450 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5681e7990 con 0x7ff5680c0450 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564007310 con 0x7ff5680c0450 2023-08-18T20:43:50.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.030+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5681e7f50 con 0x7ff5680c0450 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.031+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568074730 con 0x7ff5680c0450 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.031+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff564007470 con 0x7ff5680c0450 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.032+0000 7ff55dffb700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 0x7ff54c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.032+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5640880b0 con 0x7ff5680c0450 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.032+0000 7ff56c8ef700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 0x7ff54c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.032+0000 7ff56c8ef700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 0x7ff54c06c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5680a4d10 tx=0x7ff558009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.036+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff564053830 con 0x7ff5680c0450 2023-08-18T20:43:50.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.232+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff568155110 con 0x7ff5680c0450 2023-08-18T20:43:50.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.234+0000 7ff55dffb700 1 -- 172.21.15.121:0/4081787046 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7ff564056e50 con 0x7ff5680c0450 2023-08-18T20:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 msgr2=0x7ff54c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 0x7ff54c06c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5680a4d10 tx=0x7ff558009210 comp rx=0 tx=0).stop 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 msgr2=0x7ff568148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c520 tx=0x7ff56400c830 comp rx=0 tx=0).stop 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 shutdown_connections 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff56814e8e0 0x7ff5680c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff54c06a0e0 0x7ff54c06c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5680c0450 0x7ff568148070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 --2- 172.21.15.121:0/4081787046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5680c4c00 0x7ff568152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 >> 172.21.15.121:0/4081787046 conn(0x7ff56806a930 msgr2=0x7ff5680c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 shutdown_connections 2023-08-18T20:43:50.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.236+0000 7ff56f354700 1 -- 172.21.15.121:0/4081787046 wait complete. 2023-08-18T20:43:50.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-18T20:43:50.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-18T20:43:50.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-18T20:43:50.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-18T20:43:50.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-18T20:43:50.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-18T20:43:50.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-18T20:43:50.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-18T20:43:50.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.473+0000 7f387ab73700 1 Processor -- start 2023-08-18T20:43:50.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.473+0000 7f387ab73700 1 -- start start 2023-08-18T20:43:50.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f387ab73700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f38740aaed0 0x7f38740c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f387ab73700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3874154a20 con 0x7f38740aaaf0 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f387ab73700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3874154470 con 0x7f38740c3d30 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f387ab73700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740c12c0 con 0x7f38740aaed0 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f3879110700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f38740aaed0 0x7f38740c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f3879110700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f38740aaed0 0x7f38740c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40118/0 (socket says 172.21.15.121:40118) 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.474+0000 7f3879110700 1 -- 172.21.15.121:0/4196995868 learned_addr learned my addr 172.21.15.121:0/4196995868 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.475+0000 7f38737fe700 1 -- 172.21.15.121:0/4196995868 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123778284 0 0) 0x7f3874154a20 con 0x7f38740aaaf0 2023-08-18T20:43:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.475+0000 7f38737fe700 1 -- 172.21.15.121:0/4196995868 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f385c0035b0 con 0x7f38740aaaf0 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.475+0000 7f3879110700 1 -- 172.21.15.121:0/4196995868 >> v1:172.21.15.122:6789/0 conn(0x7f38740c3d30 legacy=0x7f38740c4820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.475+0000 7f3879110700 1 -- 172.21.15.121:0/4196995868 >> v1:172.21.15.121:6789/0 conn(0x7f38740aaaf0 legacy=0x7f38740c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.475+0000 7f3879110700 1 -- 172.21.15.121:0/4196995868 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874154740 con 0x7f38740aaed0 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.476+0000 7f3879110700 1 --2- 172.21.15.121:0/4196995868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740aaed0 0x7f38740c4f30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f386c00d370 tx=0x7f386c00d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d451756112163d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.476+0000 7f38737fe700 1 -- 172.21.15.121:0/4196995868 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c010070 con 0x7f38740aaed0 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.476+0000 7f38737fe700 1 -- 172.21.15.121:0/4196995868 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c00dc20 con 0x7f38740aaed0 2023-08-18T20:43:50.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.476+0000 7f38737fe700 1 -- 172.21.15.121:0/4196995868 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c007b30 con 0x7f38740aaed0 2023-08-18T20:43:50.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.477+0000 7f387ab73700 1 -- 172.21.15.121:0/4196995868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740aaed0 msgr2=0x7f38740c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.477+0000 7f387ab73700 1 --2- 172.21.15.121:0/4196995868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740aaed0 0x7f38740c4f30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f386c00d370 tx=0x7f386c00d680 comp rx=0 tx=0).stop 2023-08-18T20:43:50.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.477+0000 7f387ab73700 1 -- 172.21.15.121:0/4196995868 shutdown_connections 2023-08-18T20:43:50.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.477+0000 7f387ab73700 1 --2- 172.21.15.121:0/4196995868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740aaed0 0x7f38740c4f30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.477+0000 7f387ab73700 1 -- 172.21.15.121:0/4196995868 >> 172.21.15.121:0/4196995868 conn(0x7f387406a4b0 msgr2=0x7f387406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.478+0000 7fad11e7e700 1 Processor -- start 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.479+0000 7fad11e7e700 1 -- start start 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad11e7e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fad0c0c5ad0 0x7fad0c0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad11e7e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c154a20 con 0x7fad0c0aaaf0 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad11e7e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c154470 con 0x7fad0c0c3d30 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad11e7e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0c12c0 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad0b7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fad0c0aaaf0 0x7fad0c0c23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46702/0 (socket says 172.21.15.121:46702) 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad0b7fe700 1 -- 172.21.15.121:0/3346213424 learned_addr learned my addr 172.21.15.121:0/3346213424 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad0affd700 1 --2- 172.21.15.121:0/3346213424 >> v2:172.21.15.122:3300/0 conn(0x7fad0c0c5ad0 0x7fad0c0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad0a7fc700 1 -- 172.21.15.121:0/3346213424 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496138695 0 0) 0x7fad0c154a20 con 0x7fad0c0aaaf0 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.480+0000 7fad0a7fc700 1 -- 172.21.15.121:0/3346213424 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf40035b0 con 0x7fad0c0aaaf0 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0affd700 1 -- 172.21.15.121:0/3346213424 >> v1:172.21.15.122:6789/0 conn(0x7fad0c0c3d30 legacy=0x7fad0c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0affd700 1 -- 172.21.15.121:0/3346213424 >> v1:172.21.15.121:6789/0 conn(0x7fad0c0aaaf0 legacy=0x7fad0c0c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0affd700 1 -- 172.21.15.121:0/3346213424 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c154740 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0affd700 1 --2- 172.21.15.121:0/3346213424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0c4820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facfc009840 tx=0x7facfc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e30e04d0ce87d0ce server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7f387ab73700 1 -- 172.21.15.121:0/4196995868 shutdown_connections 2023-08-18T20:43:50.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fd764ebf700 1 Processor -- start 2023-08-18T20:43:50.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0a7fc700 1 -- 172.21.15.121:0/3346213424 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011830 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0a7fc700 1 -- 172.21.15.121:0/3346213424 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc011990 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fad0a7fc700 1 -- 172.21.15.121:0/3346213424 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011d00 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.481+0000 7fd764ebf700 1 -- start start 2023-08-18T20:43:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 -- 172.21.15.121:0/3346213424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 msgr2=0x7fad0c0c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 --2- 172.21.15.121:0/3346213424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0c4820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facfc009840 tx=0x7facfc009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 -- 172.21.15.121:0/3346213424 shutdown_connections 2023-08-18T20:43:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 --2- 172.21.15.121:0/3346213424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0c4820 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 -- 172.21.15.121:0/3346213424 >> 172.21.15.121:0/3346213424 conn(0x7fad0c06a4b0 msgr2=0x7fad0c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 -- 172.21.15.121:0/3346213424 shutdown_connections 2023-08-18T20:43:50.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fad11e7e700 1 -- 172.21.15.121:0/3346213424 wait complete. 2023-08-18T20:43:50.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fd764ebf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd7600aaa60 0x7fd7600aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fd764ebf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600c3d30 0x7fd7600c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fd764ebf700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd760154a20 con 0x7fd7600c5ad0 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.482+0000 7fd764ebf700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600c12c0 con 0x7fd7600aaa60 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd764ebf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd760154470 con 0x7fd7600c3d30 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd7600aaa60 0x7fd7600aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd7600aaa60 0x7fd7600aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40126/0 (socket says 172.21.15.121:40126) 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 -- 172.21.15.121:0/1343475998 learned_addr learned my addr 172.21.15.121:0/1343475998 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 -- 172.21.15.121:0/1343475998 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600c3d30 msgr2=0x7fd7600c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 --2- 172.21.15.121:0/1343475998 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600c3d30 0x7fd7600c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 -- 172.21.15.121:0/1343475998 >> v1:172.21.15.122:6789/0 conn(0x7fd7600c5ad0 legacy=0x7fd7600c23b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:50.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 -- 172.21.15.121:0/1343475998 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760154740 con 0x7fd7600aaa60 2023-08-18T20:43:50.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.483+0000 7fd75e59c700 1 --2- 172.21.15.121:0/1343475998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600aaa60 0x7fd7600aae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd758009e50 tx=0x7fd75800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23197c24301de3b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.484+0000 7fad11e7e700 1 Processor -- start 2023-08-18T20:43:50.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.484+0000 7fad11e7e700 1 -- start start 2023-08-18T20:43:50.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7f387ab73700 1 -- 172.21.15.121:0/4196995868 wait complete. 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad0c0aaaf0 0x7fad0c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c0c3d30 0x7fad0c145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0bde90 con 0x7fad0c0c3d30 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c072580 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.485+0000 7fad11e7e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1458c0 con 0x7fad0c0aaaf0 2023-08-18T20:43:50.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c0c3d30 0x7fad0c145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c0c3d30 0x7fad0c145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40136/0 (socket says 172.21.15.121:40136) 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0affd700 1 -- 172.21.15.121:0/1854684318 learned_addr learned my addr 172.21.15.121:0/1854684318 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0b7fe700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad0c0aaaf0 0x7fad0c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 -- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad0c0aaaf0 msgr2=0x7fad0c1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad0c0aaaf0 0x7fad0c1471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 -- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c0c3d30 msgr2=0x7fad0c145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c0c3d30 0x7fad0c145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0094a0 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7f387ab73700 1 Processor -- start 2023-08-18T20:43:50.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fd75d59a700 1 -- 172.21.15.121:0/1343475998 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800e070 con 0x7fd7600aaa60 2023-08-18T20:43:50.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7fd75d59a700 1 -- 172.21.15.121:0/1343475998 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758003a20 con 0x7fd7600aaa60 2023-08-18T20:43:50.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7fd75d59a700 1 -- 172.21.15.121:0/1343475998 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758003dd0 con 0x7fd7600aaa60 2023-08-18T20:43:50.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fb07de02700 1 Processor -- start 2023-08-18T20:43:50.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 -- 172.21.15.121:0/1343475998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600aaa60 msgr2=0x7fd7600aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 --2- 172.21.15.121:0/1343475998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600aaa60 0x7fd7600aae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd758009e50 tx=0x7fd75800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7f387ab73700 1 -- start start 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38740aaaf0 0x7f387414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38740aaed0 0x7f38740a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 0x7f387414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741eec60 con 0x7f38740c3d30 2023-08-18T20:43:50.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741eef40 con 0x7f38740aaed0 2023-08-18T20:43:50.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f387ab73700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740a23f0 con 0x7f38740aaaf0 2023-08-18T20:43:50.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 0x7f387414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 0x7f387414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40140/0 (socket says 172.21.15.121:40140) 2023-08-18T20:43:50.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 -- 172.21.15.121:0/634105901 learned_addr learned my addr 172.21.15.121:0/634105901 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 -- 172.21.15.121:0/1343475998 shutdown_connections 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 --2- 172.21.15.121:0/1343475998 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600c3d30 0x7fd7600c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 --2- 172.21.15.121:0/1343475998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600aaa60 0x7fd7600aae40 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd758009e50 tx=0x7fd75800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fd764ebf700 1 -- 172.21.15.121:0/1343475998 >> 172.21.15.121:0/1343475998 conn(0x7fd76006a4b0 msgr2=0x7fd76006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.486+0000 7fad0bfff700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0be4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c390 tx=0x7fad0000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000052d0 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00005430 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.487+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00006aa0 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c071c50 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c072210 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 -- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38740aaaf0 msgr2=0x7f387414fce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38740aaaf0 0x7f387414fce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 -- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38740aaed0 msgr2=0x7f38740a2bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:50.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38740aaed0 0x7f38740a2bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.488+0000 7f3879110700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c00d050 con 0x7f38740c3d30 2023-08-18T20:43:50.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7fb07de02700 1 -- start start 2023-08-18T20:43:50.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7f3879110700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 0x7f387414dab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f386c018040 tx=0x7f386c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad0c0c5470 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c004550 con 0x7f38740c3d30 2023-08-18T20:43:50.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb07de02700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb07815b830 0x7fb0780c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb07de02700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0780c65e0 0x7fb07806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb07de02700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07815bc10 con 0x7fb07806a7e0 2023-08-18T20:43:50.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb07de02700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07815cd60 con 0x7fb07815b830 2023-08-18T20:43:50.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb07de02700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07815c1e0 con 0x7fb0780c65e0 2023-08-18T20:43:50.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fad00035b30 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c0046d0 con 0x7f38740c3d30 2023-08-18T20:43:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.489+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c008030 con 0x7f38740c3d30 2023-08-18T20:43:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb0777fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb07815b830 0x7fb0780c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb077fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb07806a7e0 0x7fb078158bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46726/0 (socket says 172.21.15.121:46726) 2023-08-18T20:43:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7fb077fff700 1 -- 172.21.15.121:0/2254037521 learned_addr learned my addr 172.21.15.121:0/2254037521 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38740a26d0 con 0x7f38740c3d30 2023-08-18T20:43:50.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3874150220 con 0x7f38740c3d30 2023-08-18T20:43:50.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7facf3fff700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7facf806a130 0x7facf806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad00087770 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7facf3fff700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] conn(0x7facf80729f0 0x7facf8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facf80754c0 con 0x7facf80729f0 2023-08-18T20:43:50.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad00087c10 con 0x7fad0c0c5ad0 2023-08-18T20:43:50.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7fad0b7fe700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7facf806a130 0x7facf806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.490+0000 7f752cd81700 1 Processor -- start 2023-08-18T20:43:50.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7fad0affd700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] conn(0x7facf80729f0 0x7facf8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7fb0767fc700 1 -- 172.21.15.121:0/2254037521 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783116925 0 0) 0x7fb070001490 con 0x7fb07806a7e0 2023-08-18T20:43:50.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7fb0767fc700 1 -- 172.21.15.121:0/2254037521 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0600035b0 con 0x7fb07806a7e0 2023-08-18T20:43:50.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.491+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38740a2270 con 0x7f38740c3d30 2023-08-18T20:43:50.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fb076ffd700 1 --2- 172.21.15.121:0/2254037521 >> v2:172.21.15.122:3300/0 conn(0x7fb0780c65e0 0x7fb07806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fad0b7fe700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7facf806a130 0x7facf806c5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad04001560 tx=0x7fad040019f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7f752cd81700 1 -- start start 2023-08-18T20:43:50.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fb0777fe700 1 -- 172.21.15.121:0/2254037521 >> v2:172.21.15.122:3300/0 conn(0x7fb0780c65e0 msgr2=0x7fb07806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fb0777fe700 1 --2- 172.21.15.121:0/2254037521 >> v2:172.21.15.122:3300/0 conn(0x7fb0780c65e0 0x7fb07806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fb0777fe700 1 -- 172.21.15.121:0/2254037521 >> v1:172.21.15.121:6789/0 conn(0x7fb07806a7e0 legacy=0x7fb078158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fb0777fe700 1 -- 172.21.15.121:0/2254037521 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07815c4c0 con 0x7fb07815b830 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7fb0777fe700 1 --2- 172.21.15.121:0/2254037521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07815b830 0x7fb0780c5d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb07806eb20 tx=0x7fb06c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafe8c28cf515272 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7fb0767fc700 1 -- 172.21.15.121:0/2254037521 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011830 con 0x7fb07815b830 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7fb0767fc700 1 -- 172.21.15.121:0/2254037521 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c011990 con 0x7fb07815b830 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7fb0767fc700 1 -- 172.21.15.121:0/2254037521 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011d00 con 0x7fb07815b830 2023-08-18T20:43:50.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7f752cd81700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f75280aaa60 0x7f75280aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7f752cd81700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f75280c5ad0 0x7f75280c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7f752cd81700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7528154a20 con 0x7f75280c3d30 2023-08-18T20:43:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7f752cd81700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75280c12c0 con 0x7f75280aaa60 2023-08-18T20:43:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.493+0000 7f752cd81700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7528154470 con 0x7f75280c5ad0 2023-08-18T20:43:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.492+0000 7fad0affd700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] conn(0x7facf80729f0 0x7facf8074e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fd764ebf700 1 -- 172.21.15.121:0/1343475998 shutdown_connections 2023-08-18T20:43:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f75280c5ad0 0x7f75280c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f75280c5ad0 0x7f75280c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:49994/0 (socket says 172.21.15.121:49994) 2023-08-18T20:43:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 -- 172.21.15.121:0/2926188210 learned_addr learned my addr 172.21.15.121:0/2926188210 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 -- 172.21.15.121:0/2926188210 >> v2:172.21.15.121:3300/0 conn(0x7f75280aaa60 msgr2=0x7f75280aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 --2- 172.21.15.121:0/2926188210 >> v2:172.21.15.121:3300/0 conn(0x7f75280aaa60 0x7f75280aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 -- 172.21.15.121:0/2926188210 >> v1:172.21.15.121:6789/0 conn(0x7f75280c3d30 legacy=0x7f75280c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 -- 172.21.15.121:0/2926188210 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528154740 con 0x7f75280c5ad0 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f7525d9b700 1 --2- 172.21.15.121:0/2926188210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f75280c23b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f752806da60 tx=0x7f7518009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b86e273e2def1df0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 -- 172.21.15.121:0/2254037521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07815b830 msgr2=0x7fb0780c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 --2- 172.21.15.121:0/2254037521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07815b830 0x7fb0780c5d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb07806eb20 tx=0x7fb06c009b20 comp rx=0 tx=0).stop 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 -- 172.21.15.121:0/2254037521 shutdown_connections 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 --2- 172.21.15.121:0/2254037521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07815b830 0x7fb0780c5d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 --2- 172.21.15.121:0/2254037521 >> v2:172.21.15.122:3300/0 conn(0x7fb0780c65e0 0x7fb07806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 -- 172.21.15.121:0/2254037521 >> 172.21.15.121:0/2254037521 conn(0x7fb0780c6b10 msgr2=0x7fb0780c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fb07de02700 1 -- 172.21.15.121:0/2254037521 shutdown_connections 2023-08-18T20:43:50.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f386c008190 con 0x7f38740c3d30 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f386006a0e0 0x7f386006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f386c08ae90 con 0x7f38740c3d30 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] conn(0x7f38600729a0 0x7f3860074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3860075470 con 0x7f38600729a0 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f386c08b240 con 0x7f38740c3d30 2023-08-18T20:43:50.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7f387890f700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f386006a0e0 0x7f386006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7fb07de02700 1 -- 172.21.15.121:0/2254037521 wait complete. 2023-08-18T20:43:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7f752559a700 1 -- 172.21.15.121:0/2926188210 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518004230 con 0x7f75280c5ad0 2023-08-18T20:43:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7f752559a700 1 -- 172.21.15.121:0/2926188210 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7518004390 con 0x7f75280c5ad0 2023-08-18T20:43:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7f752559a700 1 -- 172.21.15.121:0/2926188210 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180036a0 con 0x7f75280c5ad0 2023-08-18T20:43:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7f387890f700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f386006a0e0 0x7f386006c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3864001550 tx=0x7f3864007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.495+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== osd.0 v2:172.21.15.121:6800/2890813306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7facf80754c0 con 0x7facf80729f0 2023-08-18T20:43:50.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.494+0000 7fd764ebf700 1 -- 172.21.15.121:0/1343475998 wait complete. 2023-08-18T20:43:50.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 Processor -- start 2023-08-18T20:43:50.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 -- start start 2023-08-18T20:43:50.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 -- 172.21.15.121:0/2926188210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 msgr2=0x7f75280c23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 --2- 172.21.15.121:0/2926188210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f75280c23b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f752806da60 tx=0x7f7518009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 -- 172.21.15.121:0/2926188210 shutdown_connections 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 --2- 172.21.15.121:0/2926188210 >> v2:172.21.15.121:3300/0 conn(0x7f75280aaa60 0x7f75280aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 --2- 172.21.15.121:0/2926188210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f75280c23b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 -- 172.21.15.121:0/2926188210 >> 172.21.15.121:0/2926188210 conn(0x7f752806a4b0 msgr2=0x7f752806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 -- 172.21.15.121:0/2926188210 shutdown_connections 2023-08-18T20:43:50.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7f752cd81700 1 -- 172.21.15.121:0/2926188210 wait complete. 2023-08-18T20:43:50.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 0x7fd76013a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600c5ad0 0x7fd760071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600720b0 0x7fd7600a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760072560 con 0x7fd7600c5ad0 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013b260 con 0x7fd7600c3d30 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fd764ebf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600a57d0 con 0x7fd7600720b0 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 0x7fd76013a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 0x7fd76013a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50002/0 (socket says 172.21.15.121:50002) 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 -- 172.21.15.121:0/3284868118 learned_addr learned my addr 172.21.15.121:0/3284868118 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75dd9b700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600c5ad0 0x7fd760071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75ed9d700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600720b0 0x7fd7600a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 -- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600720b0 msgr2=0x7fd7600a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7600720b0 0x7fd7600a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 -- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600c5ad0 msgr2=0x7fd760071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7600c5ad0 0x7fd760071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009b30 con 0x7fd7600c3d30 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd75e59c700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 0x7fd76013a550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd758000f80 tx=0x7fd758004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.496+0000 7fb07de02700 1 Processor -- start 2023-08-18T20:43:50.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758004440 con 0x7fd7600c3d30 2023-08-18T20:43:50.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580045a0 con 0x7fd7600c3d30 2023-08-18T20:43:50.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758004930 con 0x7fd7600c3d30 2023-08-18T20:43:50.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76013d000 con 0x7fd7600c3d30 2023-08-18T20:43:50.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76013c520 con 0x7fd7600c3d30 2023-08-18T20:43:50.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7f752cd81700 1 Processor -- start 2023-08-18T20:43:50.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7f3873fff700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] conn(0x7f38600729a0 0x7f3860074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7f3873fff700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] conn(0x7f38600729a0 0x7f3860074dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd744000fc0 con 0x7fd7600c3d30 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd758012430 con 0x7fd7600c3d30 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7fd74effd700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd74006a0e0 0x7fd74006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7580899b0 con 0x7fd7600c3d30 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd74effd700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] conn(0x7fd7400729a0 0x7fd740074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd740075470 con 0x7fd7400729a0 2023-08-18T20:43:50.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd75808e2a0 con 0x7fd7600c3d30 2023-08-18T20:43:50.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd75dd9b700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd74006a0e0 0x7fd74006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7f752cd81700 1 -- start start 2023-08-18T20:43:50.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75280aaa60 0x7f7528140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75280c3d30 0x7f75281449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f7528144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280be0a0 con 0x7f75280c3d30 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280bb750 con 0x7f75280c5ad0 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752cd81700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280bf070 con 0x7f75280aaa60 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f7526d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f7528144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f7526d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f7528144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50014/0 (socket says 172.21.15.121:50014) 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f7526d9d700 1 -- 172.21.15.121:0/2476249839 learned_addr learned my addr 172.21.15.121:0/2476249839 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7f752659c700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75280aaa60 0x7f7528140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7525d9b700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75280c3d30 0x7f75281449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 -- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75280aaa60 msgr2=0x7f7528140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75280aaa60 0x7f7528140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 -- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75280c3d30 msgr2=0x7f75281449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75280c3d30 0x7f75281449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009550 con 0x7f75280c5ad0 2023-08-18T20:43:50.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7526d9d700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f7528144ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f752000c7b0 tx=0x7f752000cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520003e10 con 0x7f75280c5ad0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520005070 con 0x7f75280c5ad0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520005420 con 0x7f75280c5ad0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75280bf5c0 con 0x7f75280c5ad0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280bfb40 con 0x7f75280c5ad0 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.497+0000 7fb07de02700 1 -- start start 2023-08-18T20:43:50.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 0x7fb0780c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0780c65e0 0x7fb0781f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb07815b830 0x7fb0781f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780ac150 con 0x7fb07806a7e0 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780c2df0 con 0x7fb0780c65e0 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.498+0000 7fb07de02700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb078157dd0 con 0x7fb07815b830 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 0x7fb0780c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 0x7fb0780c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40172/0 (socket says 172.21.15.121:40172) 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 -- 172.21.15.121:0/2207791452 learned_addr learned my addr 172.21.15.121:0/2207791452 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0780c65e0 0x7fb0781f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb077fff700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb07815b830 0x7fb0781f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 -- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb07815b830 msgr2=0x7fb0781f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb07815b830 0x7fb0781f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 -- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0780c65e0 msgr2=0x7fb0781f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0780c65e0 0x7fb0781f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0094a0 con 0x7fb07806a7e0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb0777fe700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 0x7fb0780c3840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.499+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c004510 con 0x7fb07806a7e0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c041070 con 0x7fb07806a7e0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0038a0 con 0x7fb07806a7e0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.500+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0781580b0 con 0x7fb07806a7e0 2023-08-18T20:43:50.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.501+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0780c3320 con 0x7fb07806a7e0 2023-08-18T20:43:50.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== osd.7 v2:172.21.15.122:6824/629546232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3860075470 con 0x7f38600729a0 2023-08-18T20:43:50.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd75dd9b700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd74006a0e0 0x7fd74006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7600a55e0 tx=0x7fd7540090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.502+0000 7fd75ed9d700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] conn(0x7fd7400729a0 0x7fd740074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.503+0000 7fd75ed9d700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] conn(0x7fd7400729a0 0x7fd740074dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.504+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== osd.3 v2:172.21.15.121:6816/2510933558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd740075470 con 0x7fd7400729a0 2023-08-18T20:43:50.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.504+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7520005580 con 0x7f75280c5ad0 2023-08-18T20:43:50.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f7516ffd700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f751006a280 0x7f751006c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f750c000fc0 con 0x7f75280c5ad0 2023-08-18T20:43:50.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7520087840 con 0x7f75280c5ad0 2023-08-18T20:43:50.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f7516ffd700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] conn(0x7f7510072ac0 0x7f7510074ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7510075590 con 0x7f7510072ac0 2023-08-18T20:43:50.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb07815ca80 con 0x7fb07806a7e0 2023-08-18T20:43:50.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.505+0000 7f752659c700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f751006a280 0x7f751006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7f7525d9b700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] conn(0x7f7510072ac0 0x7f7510074ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7f752659c700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f751006a280 0x7f751006c740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f751c006fd0 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb06c003a00 con 0x7fb07806a7e0 2023-08-18T20:43:50.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7f7525d9b700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] conn(0x7f7510072ac0 0x7f7510074ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7520052f20 con 0x7f75280c5ad0 2023-08-18T20:43:50.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.506+0000 7fb05ffff700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb06406a1b0 0x7fb06406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb06c043070 con 0x7fb07806a7e0 2023-08-18T20:43:50.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb076ffd700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb06406a1b0 0x7fb06406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb05ffff700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] conn(0x7fb064072a70 0x7fb064074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb064075540 con 0x7fb064072a70 2023-08-18T20:43:50.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb06c0b02a0 con 0x7fb07806a7e0 2023-08-18T20:43:50.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== osd.5 v2:172.21.15.122:6800/1102381785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7510075590 con 0x7f7510072ac0 2023-08-18T20:43:50.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.507+0000 7fb076ffd700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb06406a1b0 0x7fb06406c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0780c4060 tx=0x7fb068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.508+0000 7fbc31db3700 1 Processor -- start 2023-08-18T20:43:50.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.508+0000 7fbc31db3700 1 -- start start 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc31db3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc2c0c4380 0x7fbc2c159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc31db3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c0c2640 con 0x7fbc2c14f530 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc31db3700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c06d5f0 con 0x7fbc2c0c39d0 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc31db3700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c0c1390 con 0x7fbc2c0c4380 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc2affd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc2c0c4380 0x7fbc2c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc2affd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc2c0c4380 0x7fbc2c159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40192/0 (socket says 172.21.15.121:40192) 2023-08-18T20:43:50.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7fbc2affd700 1 -- 172.21.15.121:0/157827345 learned_addr learned my addr 172.21.15.121:0/157827345 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2affd700 1 -- 172.21.15.121:0/157827345 >> v1:172.21.15.122:6789/0 conn(0x7fbc2c0c39d0 legacy=0x7fbc2c0c2ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2affd700 1 -- 172.21.15.121:0/157827345 >> v1:172.21.15.121:6789/0 conn(0x7fbc2c14f530 legacy=0x7fbc2c0c5da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2affd700 1 -- 172.21.15.121:0/157827345 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0c0640 con 0x7fbc2c0c4380 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2affd700 1 --2- 172.21.15.121:0/157827345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 0x7fbc2c159350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc2001a910 tx=0x7fbc2001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12894f831f615988 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2a7fc700 1 -- 172.21.15.121:0/157827345 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20004230 con 0x7fbc2c0c4380 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2a7fc700 1 -- 172.21.15.121:0/157827345 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20004390 con 0x7fbc2c0c4380 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.511+0000 7fbc2a7fc700 1 -- 172.21.15.121:0/157827345 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2001ae60 con 0x7fbc2c0c4380 2023-08-18T20:43:50.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7fbc31db3700 1 -- 172.21.15.121:0/157827345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 msgr2=0x7fbc2c159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7fbc31db3700 1 --2- 172.21.15.121:0/157827345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 0x7fbc2c159350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc2001a910 tx=0x7fbc2001ac20 comp rx=0 tx=0).stop 2023-08-18T20:43:50.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7fbc31db3700 1 -- 172.21.15.121:0/157827345 shutdown_connections 2023-08-18T20:43:50.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7fbc31db3700 1 --2- 172.21.15.121:0/157827345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 0x7fbc2c159350 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7fbc31db3700 1 -- 172.21.15.121:0/157827345 >> 172.21.15.121:0/157827345 conn(0x7fbc2c06a4b0 msgr2=0x7fbc2c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7fb077fff700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] conn(0x7fb064072a70 0x7fb064074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7fb077fff700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] conn(0x7fb064072a70 0x7fb064074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== osd.6 v2:172.21.15.122:6816/2654167309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb064075540 con 0x7fb064072a70 2023-08-18T20:43:50.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.509+0000 7f9070486700 1 Processor -- start 2023-08-18T20:43:50.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.510+0000 7f9070486700 1 -- start start 2023-08-18T20:43:50.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f9070486700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680c2600 0x7f90680c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f9070486700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680c5350 con 0x7f90680c29e0 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f9070486700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680c3b00 con 0x7f90680ab1b0 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f9070486700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680c3f90 con 0x7f90680c2600 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f906e222700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680c2600 0x7f90680c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f906e222700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680c2600 0x7f90680c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36606/0 (socket says 172.21.15.121:36606) 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.512+0000 7f906e222700 1 -- 172.21.15.121:0/1046056876 learned_addr learned my addr 172.21.15.121:0/1046056876 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588572681 0 0) 0x7f90680c3b00 con 0x7f90680ab1b0 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90540035b0 con 0x7f90680ab1b0 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539317293 0 0) 0x7f90680c5350 con 0x7f90680c29e0 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90680c3b00 con 0x7f90680c29e0 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686737062 0 0) 0x7f90680c3b00 con 0x7f90680c29e0 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680c2600 msgr2=0x7f90680c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680c2600 0x7f90680c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 >> v1:172.21.15.122:6789/0 conn(0x7f90680ab1b0 legacy=0x7f9068153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680c5880 con 0x7f90680c29e0 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.513+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f9058001520 con 0x7f90680c29e0 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 >> v1:172.21.15.121:6789/0 conn(0x7f90680c29e0 legacy=0x7f9068150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9054004ce0 0x7f90540050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90540037f0 0x7f9054003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9054004220 0x7f905402daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680c3f90 con 0x7f90540037f0 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905402e220 con 0x7f9054004220 2023-08-18T20:43:50.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905402e3e0 con 0x7f9054004ce0 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906da21700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90540037f0 0x7f9054003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906da21700 1 -- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9054004ce0 msgr2=0x7f90540050e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906da21700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9054004ce0 0x7f90540050e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906da21700 1 -- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9054004220 msgr2=0x7f905402daa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.514+0000 7f906da21700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9054004220 0x7f905402daa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.516+0000 7fbc31db3700 1 -- 172.21.15.121:0/157827345 shutdown_connections 2023-08-18T20:43:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.516+0000 7f906da21700 1 -- 172.21.15.121:0/1046056876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680c3b00 con 0x7f90540037f0 2023-08-18T20:43:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.516+0000 7f906da21700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90540037f0 0x7f9054003c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90580079d0 tx=0x7f9054005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfc5161be9881f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.516+0000 7fbc31db3700 1 -- 172.21.15.121:0/157827345 wait complete. 2023-08-18T20:43:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7fbc31db3700 1 Processor -- start 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.517+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905800cb30 con 0x7f90540037f0 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.517+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905800cc90 con 0x7f90540037f0 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.517+0000 7f906d220700 1 -- 172.21.15.121:0/1046056876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058019480 con 0x7f90540037f0 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.517+0000 7f9070486700 1 -- 172.21.15.121:0/1046056876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90540037f0 msgr2=0x7f9054003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7f9070486700 1 --2- 172.21.15.121:0/1046056876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90540037f0 0x7f9054003c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90580079d0 tx=0x7f9054005880 comp rx=0 tx=0).stop 2023-08-18T20:43:50.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7f906ea23700 1 -- 172.21.15.121:0/1046056876 reap_dead start 2023-08-18T20:43:50.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7f9070486700 1 -- 172.21.15.121:0/1046056876 shutdown_connections 2023-08-18T20:43:50.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7f9070486700 1 -- 172.21.15.121:0/1046056876 >> 172.21.15.121:0/1046056876 conn(0x7f906806a930 msgr2=0x7f90680a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.518+0000 7fbc31db3700 1 -- start start 2023-08-18T20:43:50.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.519+0000 7f9070486700 1 -- 172.21.15.121:0/1046056876 shutdown_connections 2023-08-18T20:43:50.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.519+0000 7f9070486700 1 -- 172.21.15.121:0/1046056876 wait complete. 2023-08-18T20:43:50.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.521+0000 7f9070486700 1 Processor -- start 2023-08-18T20:43:50.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.521+0000 7f9070486700 1 -- start start 2023-08-18T20:43:50.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680a6ea0 0x7f90681418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 0x7f9068140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906814df60 0x7f90681dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681412f0 con 0x7f90681dd5a0 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681dd110 con 0x7f906814df60 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f9070486700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9068071200 con 0x7f90680a6ea0 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f906da21700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 0x7f9068140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f906da21700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 0x7f9068140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40210/0 (socket says 172.21.15.121:40210) 2023-08-18T20:43:50.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.522+0000 7f906da21700 1 -- 172.21.15.121:0/1312799021 learned_addr learned my addr 172.21.15.121:0/1312799021 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 -- 172.21.15.121:0/1312799021 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680a6ea0 msgr2=0x7f90681418d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90680a6ea0 0x7f90681418d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 -- 172.21.15.121:0/1312799021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906814df60 msgr2=0x7f90681dffc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906814df60 0x7f90681dffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 -- 172.21.15.121:0/1312799021 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680714e0 con 0x7f90681dd5a0 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.523+0000 7f906da21700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 0x7f9068140db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f905800c6a0 tx=0x7f90580017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.524+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905801d070 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.524+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9058001430 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.524+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058005270 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.524+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90681dcda0 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.524+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9068070e90 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.528+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90580053d0 con 0x7f90681dd5a0 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.528+0000 7f905effd700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f904c06a1b0 0x7f904c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.528+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9058014070 con 0x7f90681dd5a0 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc2c0c39d0 0x7fbc2c1e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 0x7fbc2c142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 0x7fbc2c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c14e4a0 con 0x7fbc2c0c4380 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c1e22a0 con 0x7fbc2c0c39d0 2023-08-18T20:43:50.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.531+0000 7fbc31db3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c140b70 con 0x7fbc2c0708e0 2023-08-18T20:43:50.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.532+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 --> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad0c0c0ee0 con 0x7facf80729f0 2023-08-18T20:43:50.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.532+0000 7facf3fff700 1 -- 172.21.15.121:0/1854684318 <== osd.0 v2:172.21.15.121:6800/2890813306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facfc021040 con 0x7facf80729f0 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 0x7fbc2c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc2c0c39d0 0x7fbc2c1e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 0x7fbc2c0700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36626/0 (socket says 172.21.15.121:36626) 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 -- 172.21.15.121:0/2773340180 learned_addr learned my addr 172.21.15.121:0/2773340180 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 -- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc2c0c39d0 msgr2=0x7fbc2c1e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc2c0c39d0 0x7fbc2c1e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 -- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 msgr2=0x7fbc2c142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2c0c4380 0x7fbc2c142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2bfff700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2001a570 con 0x7fbc2c0708e0 2023-08-18T20:43:50.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.534+0000 7fbc2b7fe700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc2c0c39d0 0x7fbc2c1e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:50.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.535+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 --> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38740c5470 con 0x7f38600729a0 2023-08-18T20:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.535+0000 7f9070486700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] conn(0x7f90500015e0 0x7f9050003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.535+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 --> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9050006bd0 con 0x7f90500015e0 2023-08-18T20:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.535+0000 7f906ea23700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] conn(0x7f90500015e0 0x7f9050003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.535+0000 7f38717fa700 1 -- 172.21.15.121:0/634105901 <== osd.7 v2:172.21.15.122:6824/629546232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3868009820 con 0x7f38600729a0 2023-08-18T20:43:50.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f906ea23700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] conn(0x7f90500015e0 0x7f9050003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7fbc2bfff700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 0x7fbc2c0700d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400b7b0 tx=0x7fbc2400bac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] conn(0x7f38600729a0 msgr2=0x7f3860074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.122:6824/629546232,v1:172.21.15.122:6825/629546232] conn(0x7f38600729a0 0x7f3860074dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f386006a0e0 msgr2=0x7f386006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f386006a0e0 0x7f386006c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3864001550 tx=0x7f3864007930 comp rx=0 tx=0).stop 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 msgr2=0x7f387414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 --2- 172.21.15.121:0/634105901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38740c3d30 0x7f387414dab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f386c018040 tx=0x7f386c004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f3879110700 1 -- 172.21.15.121:0/634105901 reap_dead start 2023-08-18T20:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 shutdown_connections 2023-08-18T20:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.536+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 >> 172.21.15.121:0/634105901 conn(0x7f387406a4b0 msgr2=0x7f38740c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 shutdown_connections 2023-08-18T20:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7f387ab73700 1 -- 172.21.15.121:0/634105901 wait complete. 2023-08-18T20:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== osd.2 v2:172.21.15.121:6824/1983537111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9050006bd0 con 0x7f90500015e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24010860 con 0x7fbc2c0708e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc240109c0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24010d70 con 0x7fbc2c0708e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c140dc0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.537+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c1e1f30 con 0x7fbc2c0708e0 2023-08-18T20:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.538+0000 7f906e222700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f904c06a1b0 0x7f904c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.538+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc0c000fc0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.539+0000 7f906e222700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f904c06a1b0 0x7f904c06c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f906806d980 tx=0x7f90640092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.539+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 --> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd744002d40 con 0x7fd7400729a0 2023-08-18T20:43:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.539+0000 7fd74effd700 1 -- 172.21.15.121:0/3284868118 <== osd.3 v2:172.21.15.121:6816/2510933558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd744002d40 con 0x7fd7400729a0 2023-08-18T20:43:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.539+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] conn(0x7facf80729f0 msgr2=0x7facf8074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.539+0000 7fad11e7e700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6800/2890813306,v1:172.21.15.121:6801/2890813306] conn(0x7facf80729f0 0x7facf8074e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] conn(0x7fd7400729a0 msgr2=0x7fd740074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6816/2510933558,v1:172.21.15.121:6817/2510933558] conn(0x7fd7400729a0 0x7fd740074dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd74006a0e0 msgr2=0x7fd74006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd74006a0e0 0x7fd74006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7600a55e0 tx=0x7fd7540090e0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 msgr2=0x7fd76013a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd764ebf700 1 --2- 172.21.15.121:0/3284868118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600c3d30 0x7fd76013a550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd758000f80 tx=0x7fd758004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fd75ed9d700 1 -- 172.21.15.121:0/3284868118 reap_dead start 2023-08-18T20:43:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbc2400f3b0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7facf806a130 msgr2=0x7facf806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7facf806a130 0x7facf806c5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad04001560 tx=0x7fad040019f0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 msgr2=0x7fad0c0be4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 --2- 172.21.15.121:0/1854684318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad0c0c5ad0 0x7fad0c0be4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c390 tx=0x7fad0000c6a0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad0bfff700 1 -- 172.21.15.121:0/1854684318 reap_dead start 2023-08-18T20:43:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 shutdown_connections 2023-08-18T20:43:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 >> 172.21.15.121:0/1854684318 conn(0x7fad0c06a4b0 msgr2=0x7fad0c0c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbc1806a1e0 0x7fbc1806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc240888a0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] conn(0x7fbc18072aa0 0x7fbc18074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc18075570 con 0x7fbc18072aa0 2023-08-18T20:43:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.540+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc2408d2a0 con 0x7fbc2c0708e0 2023-08-18T20:43:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 shutdown_connections 2023-08-18T20:43:50.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 >> 172.21.15.121:0/3284868118 conn(0x7fd76006a4b0 msgr2=0x7fd7600a7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 shutdown_connections 2023-08-18T20:43:50.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fd764ebf700 1 -- 172.21.15.121:0/3284868118 wait complete. 2023-08-18T20:43:50.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fbc2affd700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] conn(0x7fbc18072aa0 0x7fbc18074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.541+0000 7fbc2affd700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] conn(0x7fbc18072aa0 0x7fbc18074ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.542+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 --> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f750c002d40 con 0x7f7510072ac0 2023-08-18T20:43:50.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.542+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 shutdown_connections 2023-08-18T20:43:50.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.542+0000 7fad11e7e700 1 -- 172.21.15.121:0/1854684318 wait complete. 2023-08-18T20:43:50.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.542+0000 7f7516ffd700 1 -- 172.21.15.121:0/2476249839 <== osd.5 v2:172.21.15.122:6800/1102381785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f750c002d40 con 0x7f7510072ac0 2023-08-18T20:43:50.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.542+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== osd.4 v2:172.21.15.122:6808/1370819564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbc18075570 con 0x7fbc18072aa0 2023-08-18T20:43:50.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.545+0000 7f2ca99c1700 1 Processor -- start 2023-08-18T20:43:50.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.545+0000 7f2ca99c1700 1 -- start start 2023-08-18T20:43:50.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f2ca99c1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ca40c44a0 0x7f2ca4159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f2ca99c1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca415be20 con 0x7f2ca40c39d0 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f2ca99c1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca40c1370 con 0x7f2ca4155f50 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f2ca99c1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c0930 con 0x7f2ca40c44a0 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.547+0000 7f2ca2ffd700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2ca4155f50 0x7f2ca40c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55936/0 (socket says 172.21.15.121:55936) 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.547+0000 7f2ca2ffd700 1 -- 172.21.15.121:0/3941430149 learned_addr learned my addr 172.21.15.121:0/3941430149 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.549+0000 7f2ca37fe700 1 --2- 172.21.15.121:0/3941430149 >> v2:172.21.15.121:3300/0 conn(0x7f2ca40c44a0 0x7f2ca4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.549+0000 7f2ca37fe700 1 -- 172.21.15.121:0/3941430149 >> v1:172.21.15.122:6789/0 conn(0x7f2ca4155f50 legacy=0x7f2ca40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.549+0000 7f2ca37fe700 1 -- 172.21.15.121:0/3941430149 >> v1:172.21.15.121:6789/0 conn(0x7f2ca40c39d0 legacy=0x7f2ca4158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.549+0000 7f2ca37fe700 1 -- 172.21.15.121:0/3941430149 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4156330 con 0x7f2ca40c44a0 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.549+0000 7f2ca37fe700 1 --2- 172.21.15.121:0/3941430149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40c44a0 0x7f2ca4159380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009d90 tx=0x7f2c9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bd67a634cb04f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.552+0000 7f2ca1ffb700 1 -- 172.21.15.121:0/3941430149 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00e070 con 0x7f2ca40c44a0 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.552+0000 7f2ca1ffb700 1 -- 172.21.15.121:0/3941430149 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00bad0 con 0x7f2ca40c44a0 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.552+0000 7f2ca1ffb700 1 -- 172.21.15.121:0/3941430149 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00be60 con 0x7f2ca40c44a0 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.553+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3941430149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40c44a0 msgr2=0x7f2ca4159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.553+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3941430149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40c44a0 0x7f2ca4159380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009d90 tx=0x7f2c9c00b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.553+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 --> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb07815c7a0 con 0x7fb064072a70 2023-08-18T20:43:50.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7fbc2b7fe700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbc1806a1e0 0x7fbc1806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.547+0000 7fbc2b7fe700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbc1806a1e0 0x7fbc1806c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c006fd0 tx=0x7fbc1c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] conn(0x7f7510072ac0 msgr2=0x7f7510074ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:6800/1102381785,v1:172.21.15.122:6801/1102381785] conn(0x7f7510072ac0 0x7f7510074ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f751006a280 msgr2=0x7f751006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f751006a280 0x7f751006c740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f751c006fd0 tx=0x7f751c008040 comp rx=0 tx=0).stop 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 msgr2=0x7f7528144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.546+0000 7f752cd81700 1 --2- 172.21.15.121:0/2476249839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75280c5ad0 0x7f7528144ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f752000c7b0 tx=0x7f752000cb70 comp rx=0 tx=0).stop 2023-08-18T20:43:50.576 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2023-08-18T20:43:50.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-18T20:43:50.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.556+0000 7f7526d9d700 1 -- 172.21.15.121:0/2476249839 reap_dead start 2023-08-18T20:43:50.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.556+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 shutdown_connections 2023-08-18T20:43:50.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.556+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 >> 172.21.15.121:0/2476249839 conn(0x7f752806a4b0 msgr2=0x7f752814a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.555+0000 7fb05ffff700 1 -- 172.21.15.121:0/2207791452 <== osd.6 v2:172.21.15.122:6816/2654167309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb070001e30 con 0x7fb064072a70 2023-08-18T20:43:50.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3941430149 shutdown_connections 2023-08-18T20:43:50.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3941430149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40c44a0 0x7f2ca4159380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3941430149 >> 172.21.15.121:0/3941430149 conn(0x7f2ca406a4b0 msgr2=0x7f2ca406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3941430149 shutdown_connections 2023-08-18T20:43:50.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3941430149 wait complete. 2023-08-18T20:43:50.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] conn(0x7fb064072a70 msgr2=0x7fb064074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.557+0000 7fb07de02700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.122:6816/2654167309,v1:172.21.15.122:6817/2654167309] conn(0x7fb064072a70 0x7fb064074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 shutdown_connections 2023-08-18T20:43:50.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7f752cd81700 1 -- 172.21.15.121:0/2476249839 wait complete. 2023-08-18T20:43:50.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb06406a1b0 msgr2=0x7fb06406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb06406a1b0 0x7fb06406c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0780c4060 tx=0x7fb068008040 comp rx=0 tx=0).stop 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 msgr2=0x7fb0780c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 --2- 172.21.15.121:0/2207791452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb07806a7e0 0x7fb0780c3840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c004750 comp rx=0 tx=0).stop 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb077fff700 1 -- 172.21.15.121:0/2207791452 reap_dead start 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 shutdown_connections 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.558+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 >> 172.21.15.121:0/2207791452 conn(0x7fb0780c6b10 msgr2=0x7fb0780a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.559+0000 7f2ca99c1700 1 Processor -- start 2023-08-18T20:43:50.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.559+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 shutdown_connections 2023-08-18T20:43:50.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.559+0000 7fb07de02700 1 -- 172.21.15.121:0/2207791452 wait complete. 2023-08-18T20:43:50.582 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2023-08-18T20:43:50.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-18T20:43:50.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.559+0000 7f2ca99c1700 1 -- start start 2023-08-18T20:43:50.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 0x7f2ca41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ca40c44a0 0x7f2ca41eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca4155f50 0x7f2ca41eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40a8f00 con 0x7f2ca4155f50 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40a91e0 con 0x7f2ca40c44a0 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.560+0000 7f2ca99c1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40a94c0 con 0x7f2ca40c39d0 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 0x7f2ca41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 0x7f2ca41530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36644/0 (socket says 172.21.15.121:36644) 2023-08-18T20:43:50.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 -- 172.21.15.121:0/3734819984 learned_addr learned my addr 172.21.15.121:0/3734819984 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca27fc700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ca40c44a0 0x7f2ca41eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 -- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ca40c44a0 msgr2=0x7f2ca41eeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ca40c44a0 0x7f2ca41eeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 -- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca4155f50 msgr2=0x7f2ca41eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca4155f50 0x7f2ca41eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 -- 172.21.15.121:0/3734819984 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c009a70 con 0x7f2ca40c39d0 2023-08-18T20:43:50.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.561+0000 7f2ca2ffd700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 0x7f2ca41530b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c850 tx=0x7f2c9400cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.562+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94004c80 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.562+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94004de0 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.562+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94007310 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.562+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca41ee580 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.562+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca41535f0 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.563+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c94007470 con 0x7f2ca40c39d0 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.564+0000 7f2c93fff700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c8c06a2f0 0x7f2c8c06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.564+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c940879d0 con 0x7f2ca40c39d0 2023-08-18T20:43:50.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.564+0000 7f2ca27fc700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c8c06a2f0 0x7f2c8c06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.565+0000 7f2ca27fc700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c8c06a2f0 0x7f2c8c06c7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ca41538c0 tx=0x7f2c980090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.569+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 --> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc0c002d40 con 0x7fbc18072aa0 2023-08-18T20:43:50.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.570+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] conn(0x7f2c800015e0 0x7f2c80003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.570+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 --> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c80006bd0 con 0x7f2c800015e0 2023-08-18T20:43:50.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.570+0000 7f2ca37fe700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] conn(0x7f2c800015e0 0x7f2c80003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.570+0000 7f2ca37fe700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] conn(0x7f2c800015e0 0x7f2c80003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.571+0000 7fbc13fff700 1 -- 172.21.15.121:0/2773340180 <== osd.4 v2:172.21.15.122:6808/1370819564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc0c002d40 con 0x7fbc18072aa0 2023-08-18T20:43:50.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.571+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== osd.1 v2:172.21.15.121:6808/2230245635 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2c80006bd0 con 0x7f2c800015e0 2023-08-18T20:43:50.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 --> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9050005c50 con 0x7f90500015e0 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] conn(0x7fbc18072aa0 msgr2=0x7fbc18074ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:6808/1370819564,v1:172.21.15.122:6809/1370819564] conn(0x7fbc18072aa0 0x7fbc18074ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbc1806a1e0 msgr2=0x7fbc1806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbc1806a1e0 0x7fbc1806c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c006fd0 tx=0x7fbc1c009190 comp rx=0 tx=0).stop 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 msgr2=0x7fbc2c0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc31db3700 1 --2- 172.21.15.121:0/2773340180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc2c0708e0 0x7fbc2c0700d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400b7b0 tx=0x7fbc2400bac0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7fbc2bfff700 1 -- 172.21.15.121:0/2773340180 reap_dead start 2023-08-18T20:43:50.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.572+0000 7f905effd700 1 -- 172.21.15.121:0/1312799021 <== osd.2 v2:172.21.15.121:6824/1983537111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9050005c50 con 0x7f90500015e0 2023-08-18T20:43:50.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.573+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 shutdown_connections 2023-08-18T20:43:50.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.573+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 >> 172.21.15.121:0/2773340180 conn(0x7fbc2c06a4b0 msgr2=0x7fbc2c0c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] conn(0x7f90500015e0 msgr2=0x7f9050003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6824/1983537111,v1:172.21.15.121:6825/1983537111] conn(0x7f90500015e0 0x7f9050003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f904c06a1b0 msgr2=0x7f904c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f904c06a1b0 0x7f904c06c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f906806d980 tx=0x7f90640092c0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 msgr2=0x7f9068140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 --2- 172.21.15.121:0/1312799021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681dd5a0 0x7f9068140db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f905800c6a0 tx=0x7f90580017e0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f906ea23700 1 -- 172.21.15.121:0/1312799021 reap_dead start 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 shutdown_connections 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 >> 172.21.15.121:0/1312799021 conn(0x7f906806a930 msgr2=0x7f906814f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 shutdown_connections 2023-08-18T20:43:50.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.574+0000 7f9070486700 1 -- 172.21.15.121:0/1312799021 wait complete. 2023-08-18T20:43:50.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.575+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 shutdown_connections 2023-08-18T20:43:50.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.575+0000 7fbc31db3700 1 -- 172.21.15.121:0/2773340180 wait complete. 2023-08-18T20:43:50.595 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:50.596 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2023-08-18T20:43:50.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-18T20:43:50.597 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-18T20:43:50.598 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2023-08-18T20:43:50.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-18T20:43:50.599 INFO:teuthology.orchestra.run.smithi121.stdout:60129542148 2023-08-18T20:43:50.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-18T20:43:50.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 --> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c80005c50 con 0x7f2c800015e0 2023-08-18T20:43:50.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2c93fff700 1 -- 172.21.15.121:0/3734819984 <== osd.1 v2:172.21.15.121:6808/2230245635 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c80005c50 con 0x7f2c800015e0 2023-08-18T20:43:50.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] conn(0x7f2c800015e0 msgr2=0x7f2c80003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6808/2230245635,v1:172.21.15.121:6809/2230245635] conn(0x7f2c800015e0 0x7f2c80003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c8c06a2f0 msgr2=0x7f2c8c06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c8c06a2f0 0x7f2c8c06c7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ca41538c0 tx=0x7f2c980090e0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 msgr2=0x7f2ca41530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca99c1700 1 --2- 172.21.15.121:0/3734819984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ca40c39d0 0x7f2ca41530b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c850 tx=0x7f2c9400cb60 comp rx=0 tx=0).stop 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.590+0000 7f2ca37fe700 1 -- 172.21.15.121:0/3734819984 reap_dead start 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.591+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 shutdown_connections 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.591+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 >> 172.21.15.121:0/3734819984 conn(0x7f2ca406a4b0 msgr2=0x7f2ca40c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.591+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 shutdown_connections 2023-08-18T20:43:50.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.591+0000 7f2ca99c1700 1 -- 172.21.15.121:0/3734819984 wait complete. 2023-08-18T20:43:50.603 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2023-08-18T20:43:50.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-18T20:43:50.604 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2023-08-18T20:43:50.605 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-18T20:43:50.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.807+0000 7f5539ed7700 1 Processor -- start 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.807+0000 7f5539ed7700 1 -- start start 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5539ed7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 0x7f55340c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5539ed7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55340c3d30 0x7f55340c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5539ed7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5534154a20 con 0x7f55340aaed0 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5539ed7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340c12c0 con 0x7f55340c3d30 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5539ed7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5534154470 con 0x7f55340aaaf0 2023-08-18T20:43:50.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f55337fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 0x7f55340c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f55337fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 0x7f55340c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50088/0 (socket says 172.21.15.121:50088) 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f55337fe700 1 -- 172.21.15.121:0/3817779886 learned_addr learned my addr 172.21.15.121:0/3817779886 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.808+0000 7f5532ffd700 1 --2- 172.21.15.121:0/3817779886 >> v2:172.21.15.121:3300/0 conn(0x7f55340c3d30 0x7f55340c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.809+0000 7f5532ffd700 1 -- 172.21.15.121:0/3817779886 >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 msgr2=0x7f55340c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.809+0000 7f5532ffd700 1 --2- 172.21.15.121:0/3817779886 >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 0x7f55340c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.809+0000 7f5532ffd700 1 -- 172.21.15.121:0/3817779886 >> v1:172.21.15.121:6789/0 conn(0x7f55340aaed0 legacy=0x7f55340c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.809+0000 7f5532ffd700 1 -- 172.21.15.121:0/3817779886 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534154740 con 0x7f55340c3d30 2023-08-18T20:43:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f5532ffd700 1 --2- 172.21.15.121:0/3817779886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340c3d30 0x7f55340c28f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55340c3070 tx=0x7f552c00d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8c0cbb0b0323d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.811+0000 7f55327fc700 1 -- 172.21.15.121:0/3817779886 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c010070 con 0x7f55340c3d30 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.811+0000 7f55327fc700 1 -- 172.21.15.121:0/3817779886 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00db80 con 0x7f55340c3d30 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.811+0000 7f55327fc700 1 -- 172.21.15.121:0/3817779886 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c007aa0 con 0x7f55340c3d30 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 -- 172.21.15.121:0/3817779886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340c3d30 msgr2=0x7f55340c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3817779886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340c3d30 0x7f55340c28f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55340c3070 tx=0x7f552c00d4c0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 -- 172.21.15.121:0/3817779886 shutdown_connections 2023-08-18T20:43:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3817779886 >> v2:172.21.15.122:3300/0 conn(0x7f55340aaaf0 0x7f55340c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3817779886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340c3d30 0x7f55340c28f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 -- 172.21.15.121:0/3817779886 >> 172.21.15.121:0/3817779886 conn(0x7f553406a4b0 msgr2=0x7f553406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 -- 172.21.15.121:0/3817779886 shutdown_connections 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.812+0000 7f5539ed7700 1 -- 172.21.15.121:0/3817779886 wait complete. 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.814+0000 7f5539ed7700 1 Processor -- start 2023-08-18T20:43:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.805+0000 7f351ec54700 1 Processor -- start 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.805+0000 7f351ec54700 1 -- start start 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351ec54700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180aaaf0 0x7f35180c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351ec54700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35180c3d30 0x7f35180c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351ec54700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518154a20 con 0x7f35180aaed0 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351ec54700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35180c12c0 con 0x7f35180c3d30 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351ec54700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3518154470 con 0x7f35180aaaf0 2023-08-18T20:43:50.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.806+0000 7f351d1f1700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f35180aaed0 0x7f35180c4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46828/0 (socket says 172.21.15.121:46828) 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.807+0000 7f351d1f1700 1 -- 172.21.15.121:0/1333923388 learned_addr learned my addr 172.21.15.121:0/1333923388 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.807+0000 7f351c9f0700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180aaaf0 0x7f35180c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f3517fff700 1 --2- 172.21.15.121:0/1333923388 >> v2:172.21.15.121:3300/0 conn(0x7f35180c3d30 0x7f35180c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f3517fff700 1 -- 172.21.15.121:0/1333923388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180aaaf0 msgr2=0x7f35180c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f3517fff700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180aaaf0 0x7f35180c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f3517fff700 1 -- 172.21.15.121:0/1333923388 >> v1:172.21.15.121:6789/0 conn(0x7f35180aaed0 legacy=0x7f35180c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.810+0000 7f3517fff700 1 -- 172.21.15.121:0/1333923388 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518154740 con 0x7f35180c3d30 2023-08-18T20:43:50.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.811+0000 7f3517fff700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180c3d30 0x7f35180c28f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f350c009840 tx=0x7f350c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a73388d3b403531 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.814+0000 7f5539ed7700 1 -- start start 2023-08-18T20:43:50.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 0x7f55340a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340aaed0 0x7f55341ee640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 0x7f55340a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55341ee220 con 0x7f55340aaed0 2023-08-18T20:43:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55341edc30 con 0x7f55340aaaf0 2023-08-18T20:43:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.815+0000 7f5539ed7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55340a4b70 con 0x7f55340c3d30 2023-08-18T20:43:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f55337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 0x7f55340a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f55337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 0x7f55340a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50096/0 (socket says 172.21.15.121:50096) 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f55337fe700 1 -- 172.21.15.121:0/3835201037 learned_addr learned my addr 172.21.15.121:0/3835201037 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 0x7f55340a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5532ffd700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340aaed0 0x7f55341ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 -- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 msgr2=0x7f55340a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 0x7f55340a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 -- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340aaed0 msgr2=0x7f55341ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340aaed0 0x7f55341ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.816+0000 7f5533fff700 1 -- 172.21.15.121:0/3835201037 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c007910 con 0x7f55340c3d30 2023-08-18T20:43:50.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.817+0000 7f5533fff700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 0x7f55340a6410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f552400c3e0 tx=0x7f552400c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.817+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524012620 con 0x7f55340c3d30 2023-08-18T20:43:50.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.817+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524012780 con 0x7f55340c3d30 2023-08-18T20:43:50.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.817+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55340bc660 con 0x7f55340c3d30 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.817+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55341ede40 con 0x7f55340c3d30 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.820+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524012b30 con 0x7f55340c3d30 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.820+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5524012d10 con 0x7f55340c3d30 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.820+0000 7f5523fff700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 0x7f551806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.820+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5524088170 con 0x7f55340c3d30 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.821+0000 7f55337fe700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 0x7f551806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.821+0000 7f55337fe700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 0x7f551806c640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5528009520 tx=0x7f55280092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.822+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55100052f0 con 0x7f55340c3d30 2023-08-18T20:43:50.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.818+0000 7f35177fe700 1 -- 172.21.15.121:0/1333923388 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c004230 con 0x7f35180c3d30 2023-08-18T20:43:50.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.819+0000 7f35177fe700 1 -- 172.21.15.121:0/1333923388 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c004390 con 0x7f35180c3d30 2023-08-18T20:43:50.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.819+0000 7f35177fe700 1 -- 172.21.15.121:0/1333923388 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0036a0 con 0x7f35180c3d30 2023-08-18T20:43:50.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.819+0000 7f351ec54700 1 -- 172.21.15.121:0/1333923388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180c3d30 msgr2=0x7f35180c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.819+0000 7f351ec54700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180c3d30 0x7f35180c28f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f350c009840 tx=0x7f350c009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.822+0000 7f351ec54700 1 -- 172.21.15.121:0/1333923388 shutdown_connections 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.822+0000 7f351ec54700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180aaaf0 0x7f35180c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.822+0000 7f351ec54700 1 --2- 172.21.15.121:0/1333923388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180c3d30 0x7f35180c28f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.822+0000 7f351ec54700 1 -- 172.21.15.121:0/1333923388 >> 172.21.15.121:0/1333923388 conn(0x7f351806a4b0 msgr2=0x7f351806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.824+0000 7f351ec54700 1 -- 172.21.15.121:0/1333923388 shutdown_connections 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.824+0000 7f351ec54700 1 -- 172.21.15.121:0/1333923388 wait complete. 2023-08-18T20:43:50.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.826+0000 7f351ec54700 1 Processor -- start 2023-08-18T20:43:50.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.827+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f55240538d0 con 0x7f55340c3d30 2023-08-18T20:43:50.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.826+0000 7f351ec54700 1 -- start start 2023-08-18T20:43:50.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.827+0000 7f351ec54700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 0x7f35181fa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.827+0000 7f351ec54700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180aaed0 0x7f35180a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351ec54700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 0x7f35181f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351ec54700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180babd0 con 0x7f35180aaed0 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351ec54700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181fa070 con 0x7f35180aaaf0 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351ec54700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180a9f10 con 0x7f35180c3d30 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351c9f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 0x7f35181fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351c9f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 0x7f35181fa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50106/0 (socket says 172.21.15.121:50106) 2023-08-18T20:43:50.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351c9f0700 1 -- 172.21.15.121:0/1278190232 learned_addr learned my addr 172.21.15.121:0/1278190232 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.828+0000 7f351d1f1700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 0x7f35181f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 -- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 msgr2=0x7f35181fa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 0x7f35181fa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 -- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180aaed0 msgr2=0x7f35180a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180aaed0 0x7f35180a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 -- 172.21.15.121:0/1278190232 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0094a0 con 0x7f35180c3d30 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351d1f1700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 0x7f35181f7880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f351000c940 tx=0x7f351000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000aa50 con 0x7f35180c3d30 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35181f6390 con 0x7f35180c3d30 2023-08-18T20:43:50.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.837+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35181f9d00 con 0x7f35180c3d30 2023-08-18T20:43:50.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.839+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351000ce90 con 0x7f35180c3d30 2023-08-18T20:43:50.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.839+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000ae10 con 0x7f35180c3d30 2023-08-18T20:43:50.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.841+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3510011450 con 0x7f35180c3d30 2023-08-18T20:43:50.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.841+0000 7f35157fa700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 0x7f34fc06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.841+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f351000d040 con 0x7f35180c3d30 2023-08-18T20:43:50.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.842+0000 7f351c9f0700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 0x7f34fc06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.842+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f40052f0 con 0x7f35180c3d30 2023-08-18T20:43:50.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.843+0000 7f351c9f0700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 0x7f34fc06c570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3508004610 tx=0x7f3508009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.853+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3510015080 con 0x7f35180c3d30 2023-08-18T20:43:50.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.880+0000 7f0032a58700 1 Processor -- start 2023-08-18T20:43:50.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.881+0000 7f0032a58700 1 -- start start 2023-08-18T20:43:50.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0032a58700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f002404b3b0 0x7f002403e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0032a58700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240df660 con 0x7f002403eda0 2023-08-18T20:43:50.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0032a58700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240dea50 con 0x7f002400b880 2023-08-18T20:43:50.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0032a58700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240ded30 con 0x7f002404b3b0 2023-08-18T20:43:50.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0030ff5700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f002400b880 0x7f00240e90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55980/0 (socket says 172.21.15.121:55980) 2023-08-18T20:43:50.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.882+0000 7f0030ff5700 1 -- 172.21.15.121:0/611750010 learned_addr learned my addr 172.21.15.121:0/611750010 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.885+0000 7f3e75bed700 1 Processor -- start 2023-08-18T20:43:50.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.885+0000 7f3e75bed700 1 -- start start 2023-08-18T20:43:50.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e75bed700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3e700c4410 0x7f3e700c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e75bed700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3e7015c5e0 0x7f3e7015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e75bed700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700c2790 con 0x7f3e700c05a0 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e75bed700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7015beb0 con 0x7f3e700c4410 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e75bed700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700c2a70 con 0x7f3e7015c5e0 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3e7015c5e0 0x7f3e7015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3e7015c5e0 0x7f3e7015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50120/0 (socket says 172.21.15.121:50120) 2023-08-18T20:43:50.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 -- 172.21.15.121:0/3753755236 learned_addr learned my addr 172.21.15.121:0/3753755236 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 -- 172.21.15.121:0/3753755236 >> v2:172.21.15.121:3300/0 conn(0x7f3e700c4410 msgr2=0x7f3e700c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 --2- 172.21.15.121:0/3753755236 >> v2:172.21.15.121:3300/0 conn(0x7f3e700c4410 0x7f3e700c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 -- 172.21.15.121:0/3753755236 >> v1:172.21.15.121:6789/0 conn(0x7f3e700c05a0 legacy=0x7f3e70159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.887+0000 7f3e6ffff700 1 -- 172.21.15.121:0/3753755236 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700c2d50 con 0x7f3e7015c5e0 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.888+0000 7f3e6ffff700 1 --2- 172.21.15.121:0/3753755236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e7015ca70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e700a8420 tx=0x7f3e6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e4b648f1677a0b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.888+0000 7f3e6e7fc700 1 -- 172.21.15.121:0/3753755236 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800e070 con 0x7f3e7015c5e0 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.888+0000 7f3e6e7fc700 1 -- 172.21.15.121:0/3753755236 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68003a20 con 0x7f3e7015c5e0 2023-08-18T20:43:50.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.888+0000 7f3e6e7fc700 1 -- 172.21.15.121:0/3753755236 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68003dd0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f002bfff700 1 --2- 172.21.15.121:0/611750010 >> v2:172.21.15.121:3300/0 conn(0x7f002404b3b0 0x7f002403e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f3e75bed700 1 -- 172.21.15.121:0/3753755236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 msgr2=0x7f3e7015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f3e75bed700 1 --2- 172.21.15.121:0/3753755236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e7015ca70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e700a8420 tx=0x7f3e6800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f002bfff700 1 -- 172.21.15.121:0/611750010 >> v1:172.21.15.122:6789/0 conn(0x7f002400b880 legacy=0x7f00240e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f002bfff700 1 -- 172.21.15.121:0/611750010 >> v1:172.21.15.121:6789/0 conn(0x7f002403eda0 legacy=0x7f00240e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.889+0000 7f002bfff700 1 -- 172.21.15.121:0/611750010 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240df010 con 0x7f002404b3b0 2023-08-18T20:43:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.891+0000 7f91b1a82700 1 Processor -- start 2023-08-18T20:43:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.891+0000 7f91b1a82700 1 -- start start 2023-08-18T20:43:50.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91b1a82700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f91ac0c3d30 0x7f91ac0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91b1a82700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac154a20 con 0x7f91ac0aaaf0 2023-08-18T20:43:50.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91b1a82700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac154470 con 0x7f91ac0aaed0 2023-08-18T20:43:50.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91b1a82700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0c12c0 con 0x7f91ac0c3d30 2023-08-18T20:43:50.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91abfff700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f91ac0aaed0 0x7f91ac0c4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:55992/0 (socket says 172.21.15.121:55992) 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.892+0000 7f91abfff700 1 -- 172.21.15.121:0/3354379527 learned_addr learned my addr 172.21.15.121:0/3354379527 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053007524 0 0) 0x7f91ac154470 con 0x7f91ac0aaed0 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91940035b0 con 0x7f91ac0aaed0 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 614072810 0 0) 0x7f91940035b0 con 0x7f91ac0aaed0 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 >> v2:172.21.15.121:3300/0 conn(0x7f91ac0c3d30 msgr2=0x7f91ac0c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 --2- 172.21.15.121:0/3354379527 >> v2:172.21.15.121:3300/0 conn(0x7f91ac0c3d30 0x7f91ac0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 >> v1:172.21.15.121:6789/0 conn(0x7f91ac0aaaf0 legacy=0x7f91ac0c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac154740 con 0x7f91ac0aaed0 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f91a40019f0 con 0x7f91ac0aaed0 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 >> v1:172.21.15.122:6789/0 conn(0x7f91ac0aaed0 legacy=0x7f91ac0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194004e70 0x7f9194007260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9194007a60 0x7f9194009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 0x7f919400cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0c12c0 con 0x7f9194007a60 2023-08-18T20:43:50.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919400d530 con 0x7f9194004e70 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919400d6f0 con 0x7f919400a790 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.893+0000 7f91abfff700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 0x7f919400cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 -- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194004e70 msgr2=0x7f9194007260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194004e70 0x7f9194007260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 -- 172.21.15.121:0/3354379527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9194007a60 msgr2=0x7f9194009ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9194007a60 0x7f9194009ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 -- 172.21.15.121:0/3354379527 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940035b0 con 0x7f919400a790 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 -- 172.21.15.121:0/3354379527 reap_dead start 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91abfff700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 0x7f919400cc50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a400a770 tx=0x7f9194003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2429560c1afbabdc server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4012600 con 0x7f919400a790 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4012760 con 0x7f919400a790 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.894+0000 7f91aa7fc700 1 -- 172.21.15.121:0/3354379527 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4012ad0 con 0x7f919400a790 2023-08-18T20:43:50.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f91b1a82700 1 -- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 msgr2=0x7f919400cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f91b1a82700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 0x7f919400cc50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a400a770 tx=0x7f9194003860 comp rx=0 tx=0).stop 2023-08-18T20:43:50.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 -- 172.21.15.121:0/3753755236 shutdown_connections 2023-08-18T20:43:50.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 --2- 172.21.15.121:0/3753755236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e7015ca70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 --2- 172.21.15.121:0/3753755236 >> v2:172.21.15.121:3300/0 conn(0x7f3e700c4410 0x7f3e700c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 -- 172.21.15.121:0/3753755236 >> 172.21.15.121:0/3753755236 conn(0x7f3e7006a930 msgr2=0x7f3e700a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f91b1a82700 1 -- 172.21.15.121:0/3354379527 shutdown_connections 2023-08-18T20:43:50.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f91b1a82700 1 --2- 172.21.15.121:0/3354379527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f919400a790 0x7f919400cc50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f91b1a82700 1 -- 172.21.15.121:0/3354379527 >> 172.21.15.121:0/3354379527 conn(0x7f91ac06a4b0 msgr2=0x7f91ac06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 -- 172.21.15.121:0/3753755236 shutdown_connections 2023-08-18T20:43:50.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f002bfff700 1 --2- 172.21.15.121:0/611750010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f002404b3b0 0x7f002403e860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00200097c0 tx=0x7f0020009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b16fde7d894e391 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.896+0000 7f002affd700 1 -- 172.21.15.121:0/611750010 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020004230 con 0x7f002404b3b0 2023-08-18T20:43:50.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.896+0000 7f002affd700 1 -- 172.21.15.121:0/611750010 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020004390 con 0x7f002404b3b0 2023-08-18T20:43:50.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.896+0000 7f91b1a82700 1 -- 172.21.15.121:0/3354379527 shutdown_connections 2023-08-18T20:43:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.896+0000 7f002affd700 1 -- 172.21.15.121:0/611750010 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200036a0 con 0x7f002404b3b0 2023-08-18T20:43:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f0032a58700 1 -- 172.21.15.121:0/611750010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f002404b3b0 msgr2=0x7f002403e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f0032a58700 1 --2- 172.21.15.121:0/611750010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f002404b3b0 0x7f002403e860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00200097c0 tx=0x7f0020009ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.895+0000 7f3e75bed700 1 -- 172.21.15.121:0/3753755236 wait complete. 2023-08-18T20:43:50.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f0032a58700 1 -- 172.21.15.121:0/611750010 shutdown_connections 2023-08-18T20:43:50.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f0032a58700 1 --2- 172.21.15.121:0/611750010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f002404b3b0 0x7f002403e860 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00200097c0 tx=0x7f0020009ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f0032a58700 1 -- 172.21.15.121:0/611750010 >> 172.21.15.121:0/611750010 conn(0x7f0024048310 msgr2=0x7f0024048720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f3e75bed700 1 Processor -- start 2023-08-18T20:43:50.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f0032a58700 1 -- 172.21.15.121:0/611750010 shutdown_connections 2023-08-18T20:43:50.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.897+0000 7f3e75bed700 1 -- start start 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e700c05a0 0x7f3e700a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e700c4410 0x7f3e701fa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7013be60 con 0x7f3e700c05a0 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700a8fa0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f3e75bed700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7006fe90 con 0x7f3e700c4410 2023-08-18T20:43:50.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50134/0 (socket says 172.21.15.121:50134) 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 -- 172.21.15.121:0/1032745305 learned_addr learned my addr 172.21.15.121:0/1032745305 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6effd700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e700c4410 0x7f3e701fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 -- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e700c4410 msgr2=0x7f3e701fa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e700c4410 0x7f3e701fa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 -- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e700c05a0 msgr2=0x7f3e700a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e700c05a0 0x7f3e700a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 -- 172.21.15.121:0/1032745305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009b30 con 0x7f3e7015c5e0 2023-08-18T20:43:50.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f3e6ffff700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e68015040 tx=0x7f3e68004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f0032a58700 1 -- 172.21.15.121:0/611750010 wait complete. 2023-08-18T20:43:50.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.896+0000 7f91b1a82700 1 -- 172.21.15.121:0/3354379527 wait complete. 2023-08-18T20:43:50.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f91b1a82700 1 Processor -- start 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.898+0000 7f91b1a82700 1 -- start start 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 0x7f91ac0a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91ac0a6c70 0x7f91ac1ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0a75b0 con 0x7f919400a790 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac14a6a0 con 0x7f91ac14b390 2023-08-18T20:43:50.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.899+0000 7f91b1a82700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac14af00 con 0x7f91ac0a6c70 2023-08-18T20:43:50.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f0150cc9700 1 Processor -- start 2023-08-18T20:43:50.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50144/0 (socket says 172.21.15.121:50144) 2023-08-18T20:43:50.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 -- 172.21.15.121:0/2664676901 learned_addr learned my addr 172.21.15.121:0/2664676901 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91abfff700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91ac0a6c70 0x7f91ac1ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91ab7fe700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 0x7f91ac0a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68004240 con 0x7f3e7015c5e0 2023-08-18T20:43:50.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e70070170 con 0x7f3e7015c5e0 2023-08-18T20:43:50.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e70071dc0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f0032a58700 1 Processor -- start 2023-08-18T20:43:50.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 -- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91ac0a6c70 msgr2=0x7f91ac1ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91ac0a6c70 0x7f91ac1ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 -- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 msgr2=0x7f91ac0a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 0x7f91ac0a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91aaffd700 1 -- 172.21.15.121:0/2664676901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0bfaa0 con 0x7f91ac14b390 2023-08-18T20:43:50.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f91ab7fe700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 0x7f91ac0a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:50.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.900+0000 7f0150cc9700 1 -- start start 2023-08-18T20:43:50.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e680043a0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68004730 con 0x7f3e7015c5e0 2023-08-18T20:43:50.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f91aaffd700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f919c00b780 tx=0x7f919c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f0150cc9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f014c070950 0x7f014c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f0150cc9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f0150cc9700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0c2260 con 0x7f014c14e950 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0150cc9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0a6630 con 0x7f014c070950 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0150cc9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c151d90 con 0x7f014c0c4b10 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c011830 con 0x7f91ac14b390 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c0119b0 con 0x7f91ac14b390 2023-08-18T20:43:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c011d60 con 0x7f91ac14b390 2023-08-18T20:43:50.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36720/0 (socket says 172.21.15.121:36720) 2023-08-18T20:43:50.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 -- 172.21.15.121:0/2439716023 learned_addr learned my addr 172.21.15.121:0/2439716023 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014a59c700 1 --2- 172.21.15.121:0/2439716023 >> v2:172.21.15.122:3300/0 conn(0x7f014c070950 0x7f014c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.901+0000 7f0032a58700 1 -- start start 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002403eda0 0x7f0024030960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00240d7020 0x7f0024030ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240d4fb0 con 0x7f00240d7020 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240313e0 con 0x7f002400b880 2023-08-18T20:43:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f0032a58700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002402d120 con 0x7f002403eda0 2023-08-18T20:43:50.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 -- 172.21.15.121:0/2439716023 >> v2:172.21.15.122:3300/0 conn(0x7f014c070950 msgr2=0x7f014c0c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 --2- 172.21.15.121:0/2439716023 >> v2:172.21.15.122:3300/0 conn(0x7f014c070950 0x7f014c0c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 -- 172.21.15.121:0/2439716023 >> v1:172.21.15.122:6789/0 conn(0x7f014c14e950 legacy=0x7f014c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f014ad9d700 1 -- 172.21.15.121:0/2439716023 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c152070 con 0x7f014c0c4b10 2023-08-18T20:43:50.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac14a8b0 con 0x7f91ac14b390 2023-08-18T20:43:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac0bf750 con 0x7f91ac14b390 2023-08-18T20:43:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.902+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e68019070 con 0x7f3e7015c5e0 2023-08-18T20:43:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.903+0000 7f3e5ffff700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 0x7f3e5406c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.903+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e68089660 con 0x7f3e7015c5e0 2023-08-18T20:43:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.903+0000 7f3e6f7fe700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 0x7f3e5406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.905+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918c0052f0 con 0x7f91ac14b390 2023-08-18T20:43:50.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.905+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f919c01a400 con 0x7f91ac14b390 2023-08-18T20:43:50.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.906+0000 7f9193fff700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 0x7f919806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.906+0000 7f3e6f7fe700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 0x7f3e5406c570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3e60001600 tx=0x7f3e60007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.906+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f919c0883e0 con 0x7f91ac14b390 2023-08-18T20:43:50.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.906+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0052f0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f91ab7fe700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 0x7f919806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f014ad9d700 1 --2- 172.21.15.121:0/2439716023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e50 tx=0x7f014400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a625bcb5d67c2494 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.903+0000 7f002b7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002403eda0 0x7f0024030960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.904+0000 7f002bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.904+0000 7f002bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50156/0 (socket says 172.21.15.121:50156) 2023-08-18T20:43:50.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.904+0000 7f002bfff700 1 -- 172.21.15.121:0/2404381843 learned_addr learned my addr 172.21.15.121:0/2404381843 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 -- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002403eda0 msgr2=0x7f0024030960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002403eda0 0x7f0024030960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 -- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00240d7020 msgr2=0x7f0024030ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00240d7020 0x7f0024030ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 -- 172.21.15.121:0/2404381843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200094a0 con 0x7f002400b880 2023-08-18T20:43:50.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f91ab7fe700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 0x7f919806c5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0a71f0 tx=0x7f91a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f014959a700 1 -- 172.21.15.121:0/2439716023 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400e070 con 0x7f014c0c4b10 2023-08-18T20:43:50.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f014959a700 1 -- 172.21.15.121:0/2439716023 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144003a20 con 0x7f014c0c4b10 2023-08-18T20:43:50.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.907+0000 7f002bfff700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0020004000 tx=0x7f0020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f014959a700 1 -- 172.21.15.121:0/2439716023 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144003db0 con 0x7f014c0c4b10 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 -- 172.21.15.121:0/2439716023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 msgr2=0x7f014c0c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 --2- 172.21.15.121:0/2439716023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e50 tx=0x7f014400b330 comp rx=0 tx=0).stop 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 -- 172.21.15.121:0/2439716023 shutdown_connections 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 --2- 172.21.15.121:0/2439716023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c4f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 --2- 172.21.15.121:0/2439716023 >> v2:172.21.15.122:3300/0 conn(0x7f014c070950 0x7f014c0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 -- 172.21.15.121:0/2439716023 >> 172.21.15.121:0/2439716023 conn(0x7f014c0c6b10 msgr2=0x7f014c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 -- 172.21.15.121:0/2439716023 shutdown_connections 2023-08-18T20:43:50.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.908+0000 7f0150cc9700 1 -- 172.21.15.121:0/2439716023 wait complete. 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 Processor -- start 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 -- start start 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f014c14e950 0x7f014c0c0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c142370 con 0x7f014c070950 2023-08-18T20:43:50.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0be8b0 con 0x7f014c14e950 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f0150cc9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c1428a0 con 0x7f014c0c4b10 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f014a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.910+0000 7f014a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40324/0 (socket says 172.21.15.121:40324) 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 -- 172.21.15.121:0/621095798 learned_addr learned my addr 172.21.15.121:0/621095798 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014ad9d700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f014c14e950 0x7f014c0c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 -- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 msgr2=0x7f014c0c0150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c0150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 -- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f014c14e950 msgr2=0x7f014c0c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f014c14e950 0x7f014c0c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 -- 172.21.15.121:0/621095798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144009b30 con 0x7f014c070950 2023-08-18T20:43:50.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.911+0000 7f014a59c700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e870 tx=0x7f013c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.912+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f919c053c40 con 0x7f91ac14b390 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.912+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c013610 con 0x7f014c070950 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.912+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c013770 con 0x7f014c070950 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.912+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c013b20 con 0x7f014c070950 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.913+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c1431f0 con 0x7f014c070950 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.913+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c1425c0 con 0x7f014c070950 2023-08-18T20:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.914+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c143710 con 0x7f014c070950 2023-08-18T20:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011630 con 0x7f002400b880 2023-08-18T20:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002001e070 con 0x7f002400b880 2023-08-18T20:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200119d0 con 0x7f002400b880 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.915+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f013c013c80 con 0x7f014c070950 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f013affd700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 0x7f012c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f013c088540 con 0x7f014c070950 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.916+0000 7f0149d9b700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 0x7f012c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.917+0000 7f0149d9b700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 0x7f012c06c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0140006fd0 tx=0x7f0140006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.918+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3e68054cc0 con 0x7f3e7015c5e0 2023-08-18T20:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.918+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00240d4cd0 con 0x7f002400b880 2023-08-18T20:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.918+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024178550 con 0x7f002400b880 2023-08-18T20:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00241780d0 con 0x7f002400b880 2023-08-18T20:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.921+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f013c053cc0 con 0x7f014c070950 2023-08-18T20:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.917+0000 7f53ca281700 1 Processor -- start 2023-08-18T20:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.917+0000 7f53ca281700 1 -- start start 2023-08-18T20:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53ca281700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f53c40c2570 0x7f53c40c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53ca281700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53ca281700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40c5350 con 0x7f53c406dc30 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53ca281700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c40c3f90 con 0x7f53c40c2570 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53ca281700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40c3b00 con 0x7f53c40ab1b0 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36744/0 (socket says 172.21.15.121:36744) 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 -- 172.21.15.121:0/3463906636 learned_addr learned my addr 172.21.15.121:0/3463906636 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 -- 172.21.15.121:0/3463906636 >> v2:172.21.15.121:3300/0 conn(0x7f53c40c2570 msgr2=0x7f53c40c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 --2- 172.21.15.121:0/3463906636 >> v2:172.21.15.121:3300/0 conn(0x7f53c40c2570 0x7f53c40c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 -- 172.21.15.121:0/3463906636 >> v1:172.21.15.121:6789/0 conn(0x7f53c406dc30 legacy=0x7f53c4150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.919+0000 7f53c881e700 1 -- 172.21.15.121:0/3463906636 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40c5880 con 0x7f53c40ab1b0 2023-08-18T20:43:50.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.920+0000 7f53c881e700 1 --2- 172.21.15.121:0/3463906636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53b40098f0 tx=0x7f53b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f3a1d4123faa1a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.923+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0020011b30 con 0x7f002400b880 2023-08-18T20:43:50.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.923+0000 7f0028ff9700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 0x7f001006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.924+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0020089670 con 0x7f002400b880 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.924+0000 7f002b7fe700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 0x7f001006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.925+0000 7f002b7fe700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 0x7f001006c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00240d5130 tx=0x7f0018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f00241780d0 con 0x7f002400b880 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.923+0000 7f53c2ffd700 1 -- 172.21.15.121:0/3463906636 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4004230 con 0x7f53c40ab1b0 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.923+0000 7f53c2ffd700 1 -- 172.21.15.121:0/3463906636 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4004390 con 0x7f53c40ab1b0 2023-08-18T20:43:50.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.923+0000 7f53c2ffd700 1 -- 172.21.15.121:0/3463906636 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40036a0 con 0x7f53c40ab1b0 2023-08-18T20:43:50.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.925+0000 7f53ca281700 1 -- 172.21.15.121:0/3463906636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 msgr2=0x7f53c4153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.925+0000 7f53ca281700 1 --2- 172.21.15.121:0/3463906636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53b40098f0 tx=0x7f53b4009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:50.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.924+0000 7fab78075700 1 Processor -- start 2023-08-18T20:43:50.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.925+0000 7fab78075700 1 -- start start 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab78075700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fab700c39d0 0x7fab70158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab78075700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7015be20 con 0x7fab700c44a0 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab78075700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab700c1370 con 0x7fab70155f50 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab78075700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab700c0930 con 0x7fab700c39d0 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab75e11700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fab70155f50 0x7fab700c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:56044/0 (socket says 172.21.15.121:56044) 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.927+0000 7fab75e11700 1 -- 172.21.15.121:0/2254155294 learned_addr learned my addr 172.21.15.121:0/2254155294 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371179700 0 0) 0x7fab6c001110 con 0x7fab70155f50 2023-08-18T20:43:50.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab5c0035b0 con 0x7fab70155f50 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3105810467 0 0) 0x7fab5c0035b0 con 0x7fab70155f50 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 >> v2:172.21.15.121:3300/0 conn(0x7fab700c39d0 msgr2=0x7fab70158c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 --2- 172.21.15.121:0/2254155294 >> v2:172.21.15.121:3300/0 conn(0x7fab700c39d0 0x7fab70158c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 >> v1:172.21.15.121:6789/0 conn(0x7fab700c44a0 legacy=0x7fab701591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70156330 con 0x7fab70155f50 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fab6c001800 con 0x7fab70155f50 2023-08-18T20:43:50.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 >> v1:172.21.15.122:6789/0 conn(0x7fab70155f50 legacy=0x7fab700c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab5c003a70 0x7fab5c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c004850 0x7fab5c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab5c00bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c00c3e0 con 0x7fab5c009a00 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c00c550 con 0x7fab5c004850 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c00c710 con 0x7fab5c003a70 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.928+0000 7fab76612700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab5c00bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab75e11700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab5c003a70 0x7fab5c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 -- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab5c003a70 msgr2=0x7fab5c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab5c003a70 0x7fab5c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 -- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c004850 msgr2=0x7fab5c004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab5c004850 0x7fab5c004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 -- 172.21.15.121:0/2254155294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70156330 con 0x7fab5c009a00 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 -- 172.21.15.121:0/2254155294 reap_dead start 2023-08-18T20:43:50.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.929+0000 7fab76612700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab5c00bdf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c190 tx=0x7fab5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b206f7c386cf6cd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.930+0000 7f53ca281700 1 -- 172.21.15.121:0/3463906636 shutdown_connections 2023-08-18T20:43:50.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.930+0000 7f53ca281700 1 --2- 172.21.15.121:0/3463906636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c4153bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.930+0000 7f53ca281700 1 --2- 172.21.15.121:0/3463906636 >> v2:172.21.15.121:3300/0 conn(0x7f53c40c2570 0x7f53c40c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.930+0000 7f53ca281700 1 -- 172.21.15.121:0/3463906636 >> 172.21.15.121:0/3463906636 conn(0x7f53c406a930 msgr2=0x7f53c40a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.935+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68001d90 con 0x7fab5c009a00 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.935+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800cd10 con 0x7fab5c009a00 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.935+0000 7fab74e0f700 1 -- 172.21.15.121:0/2254155294 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68003c40 con 0x7fab5c009a00 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 -- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 msgr2=0x7fab5c00bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab5c00bdf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c190 tx=0x7fab5c005880 comp rx=0 tx=0).stop 2023-08-18T20:43:50.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 -- 172.21.15.121:0/2254155294 shutdown_connections 2023-08-18T20:43:50.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 --2- 172.21.15.121:0/2254155294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab5c00bdf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 -- 172.21.15.121:0/2254155294 >> 172.21.15.121:0/2254155294 conn(0x7fab7006a4b0 msgr2=0x7fab7006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:50.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 -- 172.21.15.121:0/2254155294 shutdown_connections 2023-08-18T20:43:50.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7f53ca281700 1 -- 172.21.15.121:0/3463906636 shutdown_connections 2023-08-18T20:43:50.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7f53ca281700 1 -- 172.21.15.121:0/3463906636 wait complete. 2023-08-18T20:43:50.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.942+0000 7f53ca281700 1 Processor -- start 2023-08-18T20:43:50.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.936+0000 7fab78075700 1 -- 172.21.15.121:0/2254155294 wait complete. 2023-08-18T20:43:50.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.938+0000 7fab78075700 1 Processor -- start 2023-08-18T20:43:50.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.938+0000 7fab78075700 1 -- start start 2023-08-18T20:43:50.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab700a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab700aa3b0 0x7fab700aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700abe20 con 0x7fab5c009a00 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7008a6a0 con 0x7fab700aa3b0 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.940+0000 7fab78075700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab700bc680 con 0x7fab70071960 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.941+0000 7fab76612700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.942+0000 7fab76612700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36760/0 (socket says 172.21.15.121:36760) 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.942+0000 7fab76612700 1 -- 172.21.15.121:0/1383960071 learned_addr learned my addr 172.21.15.121:0/1383960071 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 -- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab700aa3b0 msgr2=0x7fab700aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab700aa3b0 0x7fab700aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 -- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 msgr2=0x7fab700a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab700a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 -- 172.21.15.121:0/1383960071 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700bb740 con 0x7fab70071960 2023-08-18T20:43:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.943+0000 7fab76612700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab700c5ac0 tx=0x7fab680014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.945+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680050d0 con 0x7fab70071960 2023-08-18T20:43:50.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.945+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68005250 con 0x7fab70071960 2023-08-18T20:43:50.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.945+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68005600 con 0x7fab70071960 2023-08-18T20:43:50.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.945+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab700ab4f0 con 0x7fab70071960 2023-08-18T20:43:50.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.945+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab700abab0 con 0x7fab70071960 2023-08-18T20:43:50.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.949+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab68005760 con 0x7fab70071960 2023-08-18T20:43:50.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.950+0000 7fab667fc700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 0x7fab5406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.950+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab68089b40 con 0x7fab70071960 2023-08-18T20:43:50.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.951+0000 7f53ca281700 1 -- start start 2023-08-18T20:43:50.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 0x7f53c41f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c40a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c40c2570 0x7f53c4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c4161020 con 0x7f53c40c2570 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41f2060 con 0x7f53c406dc30 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7f53ca281700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40aa900 con 0x7f53c40ab1b0 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.952+0000 7fab75e11700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 0x7fab5406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.953+0000 7fab75e11700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 0x7fab5406c6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0012b0 tx=0x7fab6c001080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.954+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab580052f0 con 0x7fab70071960 2023-08-18T20:43:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.954+0000 7f53c37fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c40a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.954+0000 7f53c3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 0x7f53c41f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.954+0000 7f53c37fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c40a7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36768/0 (socket says 172.21.15.121:36768) 2023-08-18T20:43:50.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.954+0000 7f53c37fe700 1 -- 172.21.15.121:0/2512167556 learned_addr learned my addr 172.21.15.121:0/2512167556 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.955+0000 7f53c3fff700 1 -- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 msgr2=0x7f53c40a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.955+0000 7f53c3fff700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c40a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.955+0000 7f53c3fff700 1 -- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c40c2570 msgr2=0x7f53c4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.955+0000 7f53c3fff700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c40c2570 0x7f53c4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.955+0000 7f53c3fff700 1 -- 172.21.15.121:0/2512167556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009550 con 0x7f53c406dc30 2023-08-18T20:43:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.956+0000 7f53c3fff700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 0x7f53c41f1b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00bda0 tx=0x7f53bc00bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.956+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00cc90 con 0x7f53c406dc30 2023-08-18T20:43:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.956+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00ce10 con 0x7f53c406dc30 2023-08-18T20:43:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.956+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc014680 con 0x7f53c406dc30 2023-08-18T20:43:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.959+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fab680553c0 con 0x7fab70071960 2023-08-18T20:43:50.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.963+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c4162470 con 0x7f53c406dc30 2023-08-18T20:43:50.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.963+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c4072490 con 0x7f53c406dc30 2023-08-18T20:43:50.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.977+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f53bc01d3b0 con 0x7f53c406dc30 2023-08-18T20:43:50.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.977+0000 7f53c0ff9700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 0x7f53b006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:50.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.977+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53bc006e40 con 0x7f53c406dc30 2023-08-18T20:43:50.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.981+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c4074730 con 0x7f53c406dc30 2023-08-18T20:43:50.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.988+0000 7f53c37fe700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 0x7f53b006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:50.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.988+0000 7f53c37fe700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 0x7f53b006c670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53b80099f0 tx=0x7f53b8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:50.993+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f53bc053bd0 con 0x7f53c406dc30 2023-08-18T20:43:51.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.212+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55100055a0 con 0x7f55340c3d30 2023-08-18T20:43:51.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.219+0000 7f5523fff700 1 -- 172.21.15.121:0/3835201037 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5524056ef0 con 0x7f55340c3d30 2023-08-18T20:43:51.230 INFO:teuthology.orchestra.run.smithi121.stdout:60129542148 2023-08-18T20:43:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.256+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 msgr2=0x7f551806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.256+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 0x7f551806c640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5528009520 tx=0x7f55280092c0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.256+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 msgr2=0x7f55340a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.256+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 0x7f55340a6410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f552400c3e0 tx=0x7f552400c6f0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 shutdown_connections 2023-08-18T20:43:51.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55340c3d30 0x7f55340a6410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55340aaaf0 0x7f55340a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f551806a180 0x7f551806c640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 --2- 172.21.15.121:0/3835201037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55340aaed0 0x7f55341ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.271+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 >> 172.21.15.121:0/3835201037 conn(0x7f553406a4b0 msgr2=0x7f553406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.290+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 shutdown_connections 2023-08-18T20:43:51.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.301+0000 7f5539ed7700 1 -- 172.21.15.121:0/3835201037 wait complete. 2023-08-18T20:43:51.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.326+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f918c005870 con 0x7f91ac14b390 2023-08-18T20:43:51.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.326+0000 7f9193fff700 1 -- 172.21.15.121:0/2664676901 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f919c057260 con 0x7f91ac14b390 2023-08-18T20:43:51.329 INFO:teuthology.orchestra.run.smithi121.stdout:60129542148 2023-08-18T20:43:51.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.329+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f00241780d0 con 0x7f002400b880 2023-08-18T20:43:51.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.331+0000 7f0028ff9700 1 -- 172.21.15.121:0/2404381843 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00241780d0 con 0x7f002400b880 2023-08-18T20:43:51.334 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2023-08-18T20:43:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 msgr2=0x7f919806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 0x7f919806c5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0a71f0 tx=0x7f91a0009040 comp rx=0 tx=0).stop 2023-08-18T20:43:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 msgr2=0x7f91ac14dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f919c00b780 tx=0x7f919c00ba90 comp rx=0 tx=0).stop 2023-08-18T20:43:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 shutdown_connections 2023-08-18T20:43:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91ac0a6c70 0x7f91ac1ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f919806a130 0x7f919806c5f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f919400a790 0x7f91ac0a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 --2- 172.21.15.121:0/2664676901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91ac14b390 0x7f91ac14dc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.343+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 >> 172.21.15.121:0/2664676901 conn(0x7f91ac06a4b0 msgr2=0x7f91ac0a7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.344+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 shutdown_connections 2023-08-18T20:43:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.344+0000 7f91b1a82700 1 -- 172.21.15.121:0/2664676901 wait complete. 2023-08-18T20:43:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 msgr2=0x7f001006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 0x7f001006c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00240d5130 tx=0x7f0018009040 comp rx=0 tx=0).stop 2023-08-18T20:43:51.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 msgr2=0x7f00240d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0020004000 tx=0x7f0020004750 comp rx=0 tx=0).stop 2023-08-18T20:43:51.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2023-08-18T20:43:51.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 shutdown_connections 2023-08-18T20:43:51.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f001006a1b0 0x7f001006c670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00240d7020 0x7f0024030ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002400b880 0x7f00240d5b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 --2- 172.21.15.121:0/2404381843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002403eda0 0x7f0024030960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.345+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 >> 172.21.15.121:0/2404381843 conn(0x7f0024048310 msgr2=0x7f00240486f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.354+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 shutdown_connections 2023-08-18T20:43:51.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.354+0000 7f0032a58700 1 -- 172.21.15.121:0/2404381843 wait complete. 2023-08-18T20:43:51.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.359+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab580055a0 con 0x7fab70071960 2023-08-18T20:43:51.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.360+0000 7fab667fc700 1 -- 172.21.15.121:0/1383960071 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab68016070 con 0x7fab70071960 2023-08-18T20:43:51.360 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:51.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2023-08-18T20:43:51.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f34f40055a0 con 0x7f35180c3d30 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 msgr2=0x7fab5406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 0x7fab5406c6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0012b0 tx=0x7fab6c001080 comp rx=0 tx=0).stop 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 msgr2=0x7fab70071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab700c5ac0 tx=0x7fab680014a0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 shutdown_connections 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab70071960 0x7fab70071e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fab5406a1e0 0x7fab5406c6a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab5c009a00 0x7fab700a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 --2- 172.21.15.121:0/1383960071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab700aa3b0 0x7fab700aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 >> 172.21.15.121:0/1383960071 conn(0x7fab7006a4b0 msgr2=0x7fab700c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7f35157fa700 1 -- 172.21.15.121:0/1278190232 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35100540f0 con 0x7f35180c3d30 2023-08-18T20:43:51.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.368+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 shutdown_connections 2023-08-18T20:43:51.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.369+0000 7fab78075700 1 -- 172.21.15.121:0/1383960071 wait complete. 2023-08-18T20:43:51.375 INFO:teuthology.orchestra.run.smithi121.stdout:60129542148 2023-08-18T20:43:51.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.374+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f014c074730 con 0x7f014c070950 2023-08-18T20:43:51.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2023-08-18T20:43:51.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.375+0000 7f013affd700 1 -- 172.21.15.121:0/621095798 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f013c0572e0 con 0x7f014c070950 2023-08-18T20:43:51.376 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 msgr2=0x7f34fc06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 0x7f34fc06c570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3508004610 tx=0x7f3508009040 comp rx=0 tx=0).stop 2023-08-18T20:43:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 msgr2=0x7f35181f7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 0x7f35181f7880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f351000c940 tx=0x7f351000cc50 comp rx=0 tx=0).stop 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 shutdown_connections 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35180c3d30 0x7f35181f7880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35180aaaf0 0x7f35181fa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f34fc06a0b0 0x7f34fc06c570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 --2- 172.21.15.121:0/1278190232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35180aaed0 0x7f35180a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 >> 172.21.15.121:0/1278190232 conn(0x7f351806a4b0 msgr2=0x7f351806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 msgr2=0x7f012c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 0x7f012c06c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0140006fd0 tx=0x7f0140006bc0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 msgr2=0x7f014c0c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e870 tx=0x7f013c00eb80 comp rx=0 tx=0).stop 2023-08-18T20:43:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 shutdown_connections 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f014c14e950 0x7f014c0c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012c06a0e0 0x7f012c06c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f014c070950 0x7f014c0c50d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 --2- 172.21.15.121:0/621095798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f014c0c4b10 0x7f014c0c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 >> 172.21.15.121:0/621095798 conn(0x7f014c0c6b10 msgr2=0x7f014c14e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 shutdown_connections 2023-08-18T20:43:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.379+0000 7f0150cc9700 1 -- 172.21.15.121:0/621095798 wait complete. 2023-08-18T20:43:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.380+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 shutdown_connections 2023-08-18T20:43:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.380+0000 7f351ec54700 1 -- 172.21.15.121:0/1278190232 wait complete. 2023-08-18T20:43:51.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2023-08-18T20:43:51.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.384+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3e4c0055a0 con 0x7f3e7015c5e0 2023-08-18T20:43:51.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.385+0000 7f3e5ffff700 1 -- 172.21.15.121:0/1032745305 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e68020090 con 0x7f3e7015c5e0 2023-08-18T20:43:51.385 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:51.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 msgr2=0x7f3e5406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 0x7f3e5406c570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3e60001600 tx=0x7f3e60007a20 comp rx=0 tx=0).stop 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 msgr2=0x7f3e700a66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e68015040 tx=0x7f3e68004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 shutdown_connections 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015c5e0 0x7f3e700a66f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3e5406a0b0 0x7f3e5406c570 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e700c05a0 0x7f3e700a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 --2- 172.21.15.121:0/1032745305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e700c4410 0x7f3e701fa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.387+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 >> 172.21.15.121:0/1032745305 conn(0x7f3e7006a930 msgr2=0x7f3e700a56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.388+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 shutdown_connections 2023-08-18T20:43:51.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.388+0000 7f3e75bed700 1 -- 172.21.15.121:0/1032745305 wait complete. 2023-08-18T20:43:51.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2023-08-18T20:43:51.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-08-18T20:43:51.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2023-08-18T20:43:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.406+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f53c40a54b0 con 0x7f53c406dc30 2023-08-18T20:43:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.406+0000 7f53c0ff9700 1 -- 172.21.15.121:0/2512167556 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53bc019070 con 0x7f53c406dc30 2023-08-18T20:43:51.407 INFO:teuthology.orchestra.run.smithi121.stdout:60129542147 2023-08-18T20:43:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.408+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 msgr2=0x7f53b006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.408+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 0x7f53b006c670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53b80099f0 tx=0x7f53b8009190 comp rx=0 tx=0).stop 2023-08-18T20:43:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 msgr2=0x7f53c41f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 0x7f53c41f1b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00bda0 tx=0x7f53bc00bdd0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 shutdown_connections 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f53b006a1b0 0x7f53b006c670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c40c2570 0x7f53c4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53c406dc30 0x7f53c41f1b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 --2- 172.21.15.121:0/2512167556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53c40ab1b0 0x7f53c40a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 >> 172.21.15.121:0/2512167556 conn(0x7f53c406a930 msgr2=0x7f53c40a8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 shutdown_connections 2023-08-18T20:43:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:51.409+0000 7f53ca281700 1 -- 172.21.15.121:0/2512167556 wait complete. 2023-08-18T20:43:51.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2023-08-18T20:43:52.356 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-18T20:43:52.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-18T20:43:52.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-18T20:43:52.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-18T20:43:52.398 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-18T20:43:52.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-18T20:43:52.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-18T20:43:52.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-18T20:43:52.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.532+0000 7f33acf34700 1 Processor -- start 2023-08-18T20:43:52.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.532+0000 7f33acf34700 1 -- start start 2023-08-18T20:43:52.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33acf34700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33acf34700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 0x7f33a80c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33acf34700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a81620b0 con 0x7f33a80c6010 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33acf34700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a8165650 con 0x7f33a80c4fd0 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33acf34700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80c5950 con 0x7f33a80c4640 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.534+0000 7f33a5d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.535+0000 7f33a5d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36776/0 (socket says 172.21.15.121:36776) 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.535+0000 7f33a5d9b700 1 -- 172.21.15.121:0/4024279807 learned_addr learned my addr 172.21.15.121:0/4024279807 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.538+0000 7f33a5d9b700 1 -- 172.21.15.121:0/4024279807 >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 msgr2=0x7f33a80c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.536+0000 7f33a6d9d700 1 --2- 172.21.15.121:0/4024279807 >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 0x7f33a80c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.539+0000 7f33a5d9b700 1 --2- 172.21.15.121:0/4024279807 >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 0x7f33a80c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.539+0000 7f33a5d9b700 1 -- 172.21.15.121:0/4024279807 >> v1:172.21.15.121:6789/0 conn(0x7f33a80c6010 legacy=0x7f33a8164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.539+0000 7f33a5d9b700 1 -- 172.21.15.121:0/4024279807 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8164ab0 con 0x7f33a80c4640 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.539+0000 7f33a6d9d700 1 --2- 172.21.15.121:0/4024279807 >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 0x7f33a80c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.545+0000 7f33a5d9b700 1 --2- 172.21.15.121:0/4024279807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33980078e0 tx=0x7f3398007bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d15572653c4441d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.550+0000 7f33a559a700 1 -- 172.21.15.121:0/4024279807 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800f070 con 0x7f33a80c4640 2023-08-18T20:43:52.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.550+0000 7f33a559a700 1 -- 172.21.15.121:0/4024279807 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398004030 con 0x7f33a80c4640 2023-08-18T20:43:52.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.550+0000 7f33a559a700 1 -- 172.21.15.121:0/4024279807 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33980043c0 con 0x7f33a80c4640 2023-08-18T20:43:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.553+0000 7f33acf34700 1 -- 172.21.15.121:0/4024279807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 msgr2=0x7f33a8161b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.553+0000 7f33acf34700 1 --2- 172.21.15.121:0/4024279807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33980078e0 tx=0x7f3398007bf0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.558+0000 7f33acf34700 1 -- 172.21.15.121:0/4024279807 shutdown_connections 2023-08-18T20:43:52.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.558+0000 7f33acf34700 1 --2- 172.21.15.121:0/4024279807 >> v2:172.21.15.121:3300/0 conn(0x7f33a80c4fd0 0x7f33a80c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.558+0000 7f33acf34700 1 --2- 172.21.15.121:0/4024279807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4640 0x7f33a8161b70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.558+0000 7f33acf34700 1 -- 172.21.15.121:0/4024279807 >> 172.21.15.121:0/4024279807 conn(0x7f33a806a4b0 msgr2=0x7f33a806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.561+0000 7f33acf34700 1 -- 172.21.15.121:0/4024279807 shutdown_connections 2023-08-18T20:43:52.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.562+0000 7f33acf34700 1 -- 172.21.15.121:0/4024279807 wait complete. 2023-08-18T20:43:52.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.564+0000 7f33acf34700 1 Processor -- start 2023-08-18T20:43:52.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.564+0000 7f33acf34700 1 -- start start 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a80c4640 0x7f33a815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4fd0 0x7f33a80a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80a3fb0 con 0x7f33a80c4640 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a816e790 con 0x7f33a80c6010 2023-08-18T20:43:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33acf34700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80a3090 con 0x7f33a80c4fd0 2023-08-18T20:43:52.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.565+0000 7f33a6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.566+0000 7f33a6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50212/0 (socket says 172.21.15.121:50212) 2023-08-18T20:43:52.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.566+0000 7f33a6d9d700 1 -- 172.21.15.121:0/1612042576 learned_addr learned my addr 172.21.15.121:0/1612042576 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.566+0000 7f33a5d9b700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4fd0 0x7f33a80a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.567+0000 7f33a6d9d700 1 -- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4fd0 msgr2=0x7f33a80a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.567+0000 7f33a6d9d700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4fd0 0x7f33a80a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.567+0000 7f33a6d9d700 1 -- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a80c4640 msgr2=0x7f33a815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.567+0000 7f33a6d9d700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a80c4640 0x7f33a815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.567+0000 7f33a6d9d700 1 -- 172.21.15.121:0/1612042576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980075c0 con 0x7f33a80c6010 2023-08-18T20:43:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.575+0000 7f33a6d9d700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cef0 tx=0x7f33a000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.582+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000ae50 con 0x7f33a80c6010 2023-08-18T20:43:52.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.582+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0015440 con 0x7f33a80c6010 2023-08-18T20:43:52.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.582+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00157f0 con 0x7f33a80c6010 2023-08-18T20:43:52.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.582+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8165100 con 0x7f33a80c6010 2023-08-18T20:43:52.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.582+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80a2d20 con 0x7f33a80c6010 2023-08-18T20:43:52.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.585+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0052f0 con 0x7f33a80c6010 2023-08-18T20:43:52.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.587+0000 7f2ae85bb700 1 Processor -- start 2023-08-18T20:43:52.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.587+0000 7f2ae85bb700 1 -- start start 2023-08-18T20:43:52.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.587+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33a000d430 con 0x7f33a80c6010 2023-08-18T20:43:52.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.587+0000 7f3396ffd700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 0x7f338806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33a0088f90 con 0x7f33a80c6010 2023-08-18T20:43:52.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f33a659c700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 0x7f338806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f33a659c700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 0x7f338806c6a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f339c0096f0 tx=0x7f339c006c50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ae00c39d0 0x7f2ae0158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2ae00c44a0 0x7f2ae01591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00c0930 con 0x7f2ae00c39d0 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae015be20 con 0x7f2ae00c44a0 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.588+0000 7f2ae85bb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00c1370 con 0x7f2ae0155f50 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ae00c39d0 0x7f2ae0158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ae00c39d0 0x7f2ae0158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40378/0 (socket says 172.21.15.121:40378) 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 -- 172.21.15.121:0/3938796696 learned_addr learned my addr 172.21.15.121:0/3938796696 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 -- 172.21.15.121:0/3938796696 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 msgr2=0x7f2ae00c6100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-18T20:43:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/3938796696 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae00c6100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 -- 172.21.15.121:0/3938796696 >> v2:172.21.15.122:3300/0 conn(0x7f2ae00c44a0 msgr2=0x7f2ae01591b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/3938796696 >> v2:172.21.15.122:3300/0 conn(0x7f2ae00c44a0 0x7f2ae01591b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 -- 172.21.15.121:0/3938796696 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0156330 con 0x7f2ae00c39d0 2023-08-18T20:43:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.589+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/3938796696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae0158c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ae006dae0 tx=0x7f2ad800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb1d77f42af49e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.596+0000 7f2ae5355700 1 -- 172.21.15.121:0/3938796696 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800e070 con 0x7f2ae00c39d0 2023-08-18T20:43:52.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.596+0000 7f2ae5355700 1 -- 172.21.15.121:0/3938796696 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800b9c0 con 0x7f2ae00c39d0 2023-08-18T20:43:52.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.596+0000 7f2ae5355700 1 -- 172.21.15.121:0/3938796696 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800bd70 con 0x7f2ae00c39d0 2023-08-18T20:43:52.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.597+0000 7f2ae85bb700 1 -- 172.21.15.121:0/3938796696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 msgr2=0x7f2ae0158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.597+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/3938796696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae0158c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ae006dae0 tx=0x7f2ad800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:52.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.596+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f33a00546f0 con 0x7f33a80c6010 2023-08-18T20:43:52.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.601+0000 7f7a5c791700 1 Processor -- start 2023-08-18T20:43:52.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.601+0000 7f7a5c791700 1 -- start start 2023-08-18T20:43:52.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.602+0000 7f7a5c791700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7a540aaaf0 0x7f7a540c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.602+0000 7f7a5c791700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7a540aaed0 0x7f7a540c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.602+0000 7f7a5c791700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a54154a20 con 0x7f7a540c3d30 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.602+0000 7f7a5c791700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a540c12c0 con 0x7f7a540aaed0 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.602+0000 7f7a5c791700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a54154470 con 0x7f7a540aaaf0 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.603+0000 7f7a59d2c700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7a540c3d30 0x7f7a540c4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:56090/0 (socket says 172.21.15.121:56090) 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.603+0000 7f7a59d2c700 1 -- 172.21.15.121:0/3316519005 learned_addr learned my addr 172.21.15.121:0/3316519005 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.603+0000 7f7a5a52d700 1 --2- 172.21.15.121:0/3316519005 >> v2:172.21.15.122:3300/0 conn(0x7f7a540aaaf0 0x7f7a540c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f7a5a52d700 1 -- 172.21.15.121:0/3316519005 >> v2:172.21.15.121:3300/0 conn(0x7f7a540aaed0 msgr2=0x7f7a540c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f7a5a52d700 1 --2- 172.21.15.121:0/3316519005 >> v2:172.21.15.121:3300/0 conn(0x7f7a540aaed0 0x7f7a540c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f7a5a52d700 1 -- 172.21.15.121:0/3316519005 >> v1:172.21.15.122:6789/0 conn(0x7f7a540c3d30 legacy=0x7f7a540c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f7a5a52d700 1 -- 172.21.15.121:0/3316519005 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54154740 con 0x7f7a540aaaf0 2023-08-18T20:43:52.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f2ae85bb700 1 -- 172.21.15.121:0/3938796696 shutdown_connections 2023-08-18T20:43:52.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/3938796696 >> v2:172.21.15.122:3300/0 conn(0x7f2ae00c44a0 0x7f2ae01591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/3938796696 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae00c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/3938796696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae0158c70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.604+0000 7f2ae85bb700 1 -- 172.21.15.121:0/3938796696 >> 172.21.15.121:0/3938796696 conn(0x7f2ae006a4b0 msgr2=0x7f2ae006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.605+0000 7f7a5a52d700 1 --2- 172.21.15.121:0/3316519005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaaf0 0x7f7a540c23b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a540c3070 tx=0x7f7a5000acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9727cfb210cc860b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.605+0000 7f2ae85bb700 1 -- 172.21.15.121:0/3938796696 shutdown_connections 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.606+0000 7f2ae85bb700 1 -- 172.21.15.121:0/3938796696 wait complete. 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f2ae85bb700 1 Processor -- start 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.605+0000 7f7a5952b700 1 -- 172.21.15.121:0/3316519005 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000aea0 con 0x7f7a540aaaf0 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.606+0000 7f7a5952b700 1 -- 172.21.15.121:0/3316519005 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50004230 con 0x7f7a540aaaf0 2023-08-18T20:43:52.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.606+0000 7f7a5952b700 1 -- 172.21.15.121:0/3316519005 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000c870 con 0x7f7a540aaaf0 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.606+0000 7f7a5c791700 1 -- 172.21.15.121:0/3316519005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaaf0 msgr2=0x7f7a540c23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 --2- 172.21.15.121:0/3316519005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaaf0 0x7f7a540c23b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a540c3070 tx=0x7f7a5000acc0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 -- 172.21.15.121:0/3316519005 shutdown_connections 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 --2- 172.21.15.121:0/3316519005 >> v2:172.21.15.121:3300/0 conn(0x7f7a540aaed0 0x7f7a540c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 --2- 172.21.15.121:0/3316519005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaaf0 0x7f7a540c23b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 -- 172.21.15.121:0/3316519005 >> 172.21.15.121:0/3316519005 conn(0x7f7a5406a4b0 msgr2=0x7f7a5406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 -- 172.21.15.121:0/3316519005 shutdown_connections 2023-08-18T20:43:52.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.608+0000 7f2ae85bb700 1 -- start start 2023-08-18T20:43:52.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae01f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01f2250 con 0x7f2ae00c39d0 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00a8bf0 con 0x7f2ae00c44a0 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae85bb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00a8ed0 con 0x7f2ae0155f50 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50226/0 (socket says 172.21.15.121:50226) 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 -- 172.21.15.121:0/1115383806 learned_addr learned my addr 172.21.15.121:0/1115383806 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 -- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 msgr2=0x7f2ae014dcd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:52.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae014dcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 -- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 msgr2=0x7f2ae01f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae01f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f2ae5b56700 1 -- 172.21.15.121:0/1115383806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009b30 con 0x7f2ae00c44a0 2023-08-18T20:43:52.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.607+0000 7f7a5c791700 1 -- 172.21.15.121:0/3316519005 wait complete. 2023-08-18T20:43:52.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.609+0000 7f7a5c791700 1 Processor -- start 2023-08-18T20:43:52.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f2ae5b56700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00c3650 tx=0x7f2ad8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.610+0000 7f7a5c791700 1 -- start start 2023-08-18T20:43:52.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a540aaaf0 0x7f7a540bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 0x7f7a541f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 0x7f7a541f8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54150300 con 0x7f7a540c3d30 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541f7b90 con 0x7f7a540aaed0 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.611+0000 7f7a5c791700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54150020 con 0x7f7a540aaaf0 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.612+0000 7f7a59d2c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 0x7f7a541f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.612+0000 7f7a5a52d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a540aaaf0 0x7f7a540bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.612+0000 7f7a5ad2e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 0x7f7a541f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.612+0000 7f7a5ad2e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 0x7f7a541f8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40396/0 (socket says 172.21.15.121:40396) 2023-08-18T20:43:52.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.612+0000 7f7a5ad2e700 1 -- 172.21.15.121:0/2254296825 learned_addr learned my addr 172.21.15.121:0/2254296825 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.613+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8004390 con 0x7f2ae00c44a0 2023-08-18T20:43:52.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.613+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80044f0 con 0x7f2ae00c44a0 2023-08-18T20:43:52.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.613+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8004880 con 0x7f2ae00c44a0 2023-08-18T20:43:52.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.613+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae00a91b0 con 0x7f2ae00c44a0 2023-08-18T20:43:52.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.613+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae0070f30 con 0x7f2ae00c44a0 2023-08-18T20:43:52.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f22cdad1700 1 Processor -- start 2023-08-18T20:43:52.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.615+0000 7f22cdad1700 1 -- start start 2023-08-18T20:43:52.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f7a59d2c700 1 -- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a540aaaf0 msgr2=0x7f7a540bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f7a59d2c700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a540aaaf0 0x7f7a540bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f7a59d2c700 1 -- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 msgr2=0x7f7a541f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f7a59d2c700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 0x7f7a541f8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.614+0000 7f7a59d2c700 1 -- 172.21.15.121:0/2254296825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5000a640 con 0x7f7a540aaed0 2023-08-18T20:43:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22cdad1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c8155f50 0x7f22c80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22cdad1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22c80c39d0 0x7f22c8158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22cdad1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c815be20 con 0x7f22c80c44a0 2023-08-18T20:43:52.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22cdad1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80c0930 con 0x7f22c80c39d0 2023-08-18T20:43:52.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22cdad1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80c1370 con 0x7f22c8155f50 2023-08-18T20:43:52.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22c6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22c80c39d0 0x7f22c8158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22c6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22c80c39d0 0x7f22c8158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40400/0 (socket says 172.21.15.121:40400) 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f22c6ffd700 1 -- 172.21.15.121:0/1022078589 learned_addr learned my addr 172.21.15.121:0/1022078589 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.619+0000 7f22c6ffd700 1 -- 172.21.15.121:0/1022078589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c8155f50 msgr2=0x7f22c80c6100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.619+0000 7f22c6ffd700 1 --2- 172.21.15.121:0/1022078589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c8155f50 0x7f22c80c6100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.619+0000 7f22c6ffd700 1 -- 172.21.15.121:0/1022078589 >> v1:172.21.15.122:6789/0 conn(0x7f22c80c44a0 legacy=0x7f22c81591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.619+0000 7f22c6ffd700 1 -- 172.21.15.121:0/1022078589 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8156330 con 0x7f22c80c39d0 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.621+0000 7f22c6ffd700 1 --2- 172.21.15.121:0/1022078589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c80c39d0 0x7f22c8158c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009e50 tx=0x7f22c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad15d138326915b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ad801c440 con 0x7f2ae00c44a0 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f2ad6ffd700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 0x7f2ac406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ad8089c40 con 0x7f2ae00c44a0 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.619+0000 7f2ae6357700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 0x7f2ac406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.620+0000 7f2ae6357700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 0x7f2ac406c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009770 tx=0x7f2ad0006cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f7a59d2c700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 0x7f7a541f9e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a440048d0 tx=0x7f7a4400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44004e60 con 0x7f7a540aaed0 2023-08-18T20:43:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440070d0 con 0x7f7a540aaed0 2023-08-18T20:43:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44007460 con 0x7f7a540aaed0 2023-08-18T20:43:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a541fa7a0 con 0x7f7a540aaed0 2023-08-18T20:43:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.617+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a541510f0 con 0x7f7a540aaed0 2023-08-18T20:43:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f9e1593b700 1 Processor -- start 2023-08-18T20:43:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.616+0000 7f9e1593b700 1 -- start start 2023-08-18T20:43:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e1593b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e100c39d0 0x7f9e10158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e1593b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9e100c44a0 0x7f9e101591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e1593b700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1015be20 con 0x7f9e10155f50 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e1593b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100c0930 con 0x7f9e100c39d0 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e1593b700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100c1370 con 0x7f9e100c44a0 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e100c39d0 0x7f9e10158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e100c39d0 0x7f9e10158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40412/0 (socket says 172.21.15.121:40412) 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1873979368 learned_addr learned my addr 172.21.15.121:0/1873979368 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1873979368 >> v2:172.21.15.122:3300/0 conn(0x7f9e100c44a0 msgr2=0x7f9e101591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 --2- 172.21.15.121:0/1873979368 >> v2:172.21.15.122:3300/0 conn(0x7f9e100c44a0 0x7f9e101591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1873979368 >> v1:172.21.15.122:6789/0 conn(0x7f9e10155f50 legacy=0x7f9e100c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1873979368 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10156330 con 0x7f9e100c39d0 2023-08-18T20:43:52.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.618+0000 7f9e0e7fc700 1 --2- 172.21.15.121:0/1873979368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e10158c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e10072b60 tx=0x7f9e04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9164de74a75d7f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.622+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac80052f0 con 0x7f2ae00c44a0 2023-08-18T20:43:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.622+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a440075c0 con 0x7f7a540aaed0 2023-08-18T20:43:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.621+0000 7f9e0dffb700 1 -- 172.21.15.121:0/1873979368 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04004230 con 0x7f9e100c39d0 2023-08-18T20:43:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.622+0000 7f9e0dffb700 1 -- 172.21.15.121:0/1873979368 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04004390 con 0x7f9e100c39d0 2023-08-18T20:43:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.622+0000 7f9e0dffb700 1 -- 172.21.15.121:0/1873979368 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040036a0 con 0x7f9e100c39d0 2023-08-18T20:43:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.622+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c0052f0 con 0x7f7a540aaed0 2023-08-18T20:43:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f7a4affd700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 0x7f7a3806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a440880d0 con 0x7f7a540aaed0 2023-08-18T20:43:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 -- 172.21.15.121:0/1873979368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 msgr2=0x7f9e10158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1873979368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e10158c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e10072b60 tx=0x7f9e04009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 -- 172.21.15.121:0/1873979368 shutdown_connections 2023-08-18T20:43:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1873979368 >> v2:172.21.15.122:3300/0 conn(0x7f9e100c44a0 0x7f9e101591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1873979368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e10158c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.623+0000 7f9e1593b700 1 -- 172.21.15.121:0/1873979368 >> 172.21.15.121:0/1873979368 conn(0x7f9e1006a4b0 msgr2=0x7f9e1006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.624+0000 7f22c67fc700 1 -- 172.21.15.121:0/1022078589 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000e070 con 0x7f22c80c39d0 2023-08-18T20:43:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.624+0000 7f22c67fc700 1 -- 172.21.15.121:0/1022078589 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0003a20 con 0x7f22c80c39d0 2023-08-18T20:43:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.624+0000 7f22c67fc700 1 -- 172.21.15.121:0/1022078589 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0003dd0 con 0x7f22c80c39d0 2023-08-18T20:43:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.624+0000 7f9e1593b700 1 -- 172.21.15.121:0/1873979368 shutdown_connections 2023-08-18T20:43:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.625+0000 7f22cdad1700 1 -- 172.21.15.121:0/1022078589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c80c39d0 msgr2=0x7f22c8158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.625+0000 7f22cdad1700 1 --2- 172.21.15.121:0/1022078589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c80c39d0 0x7f22c8158c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009e50 tx=0x7f22c000b330 comp rx=0 tx=0).stop 2023-08-18T20:43:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.628+0000 7f7a5a52d700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 0x7f7a3806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.628+0000 7f7a5a52d700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 0x7f7a3806c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000c00 tx=0x7f7a50012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.628+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7a44053830 con 0x7f7a540aaed0 2023-08-18T20:43:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.632+0000 7f22cdad1700 1 -- 172.21.15.121:0/1022078589 shutdown_connections 2023-08-18T20:43:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.632+0000 7f22cdad1700 1 --2- 172.21.15.121:0/1022078589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c8155f50 0x7f22c80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.632+0000 7f22cdad1700 1 --2- 172.21.15.121:0/1022078589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c80c39d0 0x7f22c8158c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.632+0000 7f22cdad1700 1 -- 172.21.15.121:0/1022078589 >> 172.21.15.121:0/1022078589 conn(0x7f22c806a4b0 msgr2=0x7f22c806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.632+0000 7f9e1593b700 1 -- 172.21.15.121:0/1873979368 wait complete. 2023-08-18T20:43:52.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.634+0000 7f9e1593b700 1 Processor -- start 2023-08-18T20:43:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.634+0000 7f9e1593b700 1 -- start start 2023-08-18T20:43:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e101443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e10155f50 0x7f9e10157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100aacd0 con 0x7f9e100c39d0 2023-08-18T20:43:52.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101576a0 con 0x7f9e100c44a0 2023-08-18T20:43:52.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e1593b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1014a130 con 0x7f9e10155f50 2023-08-18T20:43:52.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e0e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e0e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50256/0 (socket says 172.21.15.121:50256) 2023-08-18T20:43:52.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.635+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1215497725 learned_addr learned my addr 172.21.15.121:0/1215497725 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e10155f50 msgr2=0x7f9e10157160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e10155f50 0x7f9e10157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 msgr2=0x7f9e101443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e101443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 -- 172.21.15.121:0/1215497725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04009550 con 0x7f9e100c44a0 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.636+0000 7f9e0e7fc700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e04004000 tx=0x7f9e04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.637+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2ad80553a0 con 0x7f2ae00c44a0 2023-08-18T20:43:52.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.643+0000 7f22cdad1700 1 -- 172.21.15.121:0/1022078589 shutdown_connections 2023-08-18T20:43:52.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.645+0000 7f22cdad1700 1 -- 172.21.15.121:0/1022078589 wait complete. 2023-08-18T20:43:52.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.646+0000 7f22cdad1700 1 Processor -- start 2023-08-18T20:43:52.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.649+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011630 con 0x7f9e100c44a0 2023-08-18T20:43:52.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.649+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04011790 con 0x7f9e100c44a0 2023-08-18T20:43:52.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.649+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011b40 con 0x7f9e100c44a0 2023-08-18T20:43:52.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.650+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e10145b00 con 0x7f9e100c44a0 2023-08-18T20:43:52.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.650+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e101412d0 con 0x7f9e100c44a0 2023-08-18T20:43:52.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.654+0000 7f22cdad1700 1 -- start start 2023-08-18T20:43:52.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c80c39d0 0x7f22c8154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 0x7f22c81ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 0x7f22c81efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80711f0 con 0x7f22c8155f50 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80a8f20 con 0x7f22c80c44a0 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22cdad1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8071440 con 0x7f22c80c39d0 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22c6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 0x7f22c81ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22c77fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c80c39d0 0x7f22c8154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22c7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 0x7f22c81efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22c7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 0x7f22c81efe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40426/0 (socket says 172.21.15.121:40426) 2023-08-18T20:43:52.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.655+0000 7f22c7fff700 1 -- 172.21.15.121:0/2766279705 learned_addr learned my addr 172.21.15.121:0/2766279705 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 -- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c80c39d0 msgr2=0x7f22c8154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c80c39d0 0x7f22c8154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 -- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 msgr2=0x7f22c81efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 0x7f22c81efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 -- 172.21.15.121:0/2766279705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0009b30 con 0x7f22c80c44a0 2023-08-18T20:43:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.656+0000 7f22c6ffd700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 0x7f22c81ef940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22c0014000 tx=0x7f22c0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.652+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e10074730 con 0x7f9e100c44a0 2023-08-18T20:43:52.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.658+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0004440 con 0x7f22c80c44a0 2023-08-18T20:43:52.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.658+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c00092e0 con 0x7f22c80c44a0 2023-08-18T20:43:52.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.658+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0004840 con 0x7f22c80c44a0 2023-08-18T20:43:52.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.657+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e0401b440 con 0x7f9e100c44a0 2023-08-18T20:43:52.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.658+0000 7f9df7fff700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 0x7f9dfc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.658+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e04089c30 con 0x7f9e100c44a0 2023-08-18T20:43:52.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.659+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c8071720 con 0x7f22c80c44a0 2023-08-18T20:43:52.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.659+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c81549d0 con 0x7f22c80c44a0 2023-08-18T20:43:52.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.662+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22c001e430 con 0x7f22c80c44a0 2023-08-18T20:43:52.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.663+0000 7f22affff700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 0x7f22b406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.663+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22c0089950 con 0x7f22c80c44a0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.663+0000 7f22c77fe700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 0x7f22b406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.664+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80052f0 con 0x7f22c80c44a0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.664+0000 7f22c77fe700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 0x7f22b406c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22c8154da0 tx=0x7f22bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.661+0000 7f9e0effd700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 0x7f9dfc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.661+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9e04055390 con 0x7f9e100c44a0 2023-08-18T20:43:52.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.661+0000 7f9e0effd700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 0x7f9dfc06c6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e00003df0 tx=0x7f9e00007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.676+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f22c0055160 con 0x7f22c80c44a0 2023-08-18T20:43:52.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.701+0000 7f849bd75700 1 Processor -- start 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.701+0000 7f849bd75700 1 -- start start 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849bd75700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84940c3d30 0x7f84940c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849bd75700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8494154a20 con 0x7f84940aaed0 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849bd75700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8494154470 con 0x7f84940aaaf0 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849bd75700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940c12c0 con 0x7f84940c3d30 2023-08-18T20:43:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849a312700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84940aaed0 0x7f84940c4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47014/0 (socket says 172.21.15.121:47014) 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.703+0000 7f849a312700 1 -- 172.21.15.121:0/3502307538 learned_addr learned my addr 172.21.15.121:0/3502307538 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816713982 0 0) 0x7f8494154a20 con 0x7f84940aaed0 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84800046c0 con 0x7f84940aaed0 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1651392994 0 0) 0x7f84800046c0 con 0x7f84940aaed0 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 >> v2:172.21.15.121:3300/0 conn(0x7f84940c3d30 msgr2=0x7f84940c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 --2- 172.21.15.121:0/3502307538 >> v2:172.21.15.121:3300/0 conn(0x7f84940c3d30 0x7f84940c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 >> v1:172.21.15.122:6789/0 conn(0x7f84940aaaf0 legacy=0x7f84940c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494154740 con 0x7f84940aaed0 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f848c0050e0 con 0x7f84940aaed0 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 >> v1:172.21.15.121:6789/0 conn(0x7f84940aaed0 legacy=0x7f84940c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8480004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8480005960 0x7f8480005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f848000ab10 0x7f848000cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c12c0 con 0x7f8480004bd0 2023-08-18T20:43:52.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848000d550 con 0x7f848000ab10 2023-08-18T20:43:52.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.704+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848000d710 con 0x7f8480005960 2023-08-18T20:43:52.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8480004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f849a312700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f848000ab10 0x7f848000cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 -- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8480005960 msgr2=0x7f8480005de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8480005960 0x7f8480005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 -- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f848000ab10 msgr2=0x7f848000cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f848000ab10 0x7f848000cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 -- 172.21.15.121:0/3502307538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800046c0 con 0x7f8480004bd0 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f8499b11700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8480004ff0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8490001430 tx=0x7f8480006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac66e8bb7ed9f6bb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f849a312700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f848000ab10 0x7f848000cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.705+0000 7f849a312700 1 -- 172.21.15.121:0/3502307538 reap_dead start 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.706+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900123d0 con 0x7f8480004bd0 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.706+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490012530 con 0x7f8480004bd0 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.706+0000 7f8498b0f700 1 -- 172.21.15.121:0/3502307538 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900052d0 con 0x7f8480004bd0 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.707+0000 7f849bd75700 1 -- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 msgr2=0x7f8480004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.707+0000 7f849bd75700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8480004ff0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8490001430 tx=0x7f8480006990 comp rx=0 tx=0).stop 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.708+0000 7f849bd75700 1 -- 172.21.15.121:0/3502307538 shutdown_connections 2023-08-18T20:43:52.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.708+0000 7f849bd75700 1 --2- 172.21.15.121:0/3502307538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8480004ff0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.708+0000 7f849bd75700 1 -- 172.21.15.121:0/3502307538 >> 172.21.15.121:0/3502307538 conn(0x7f849406a4b0 msgr2=0x7f849406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.708+0000 7f849bd75700 1 -- 172.21.15.121:0/3502307538 shutdown_connections 2023-08-18T20:43:52.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.708+0000 7f849bd75700 1 -- 172.21.15.121:0/3502307538 wait complete. 2023-08-18T20:43:52.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.710+0000 7f849bd75700 1 Processor -- start 2023-08-18T20:43:52.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.710+0000 7f849bd75700 1 -- start start 2023-08-18T20:43:52.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8494152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 0x7f849414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f849414d8c0 0x7f849406f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84941e62d0 con 0x7f8480004bd0 2023-08-18T20:43:52.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84941e5460 con 0x7f849414d8c0 2023-08-18T20:43:52.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.711+0000 7f849bd75700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849414dd50 con 0x7f8494071b60 2023-08-18T20:43:52.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.712+0000 7f8499310700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 0x7f849414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.712+0000 7f8499310700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 0x7f849414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:36856/0 (socket says 172.21.15.121:36856) 2023-08-18T20:43:52.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.712+0000 7f8499310700 1 -- 172.21.15.121:0/3455987766 learned_addr learned my addr 172.21.15.121:0/3455987766 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.712+0000 7f849a312700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f849414d8c0 0x7f849406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.712+0000 7f8499b11700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8494152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 -- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 msgr2=0x7f849414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 0x7f849414d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 -- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f849414d8c0 msgr2=0x7f849406f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f849414d8c0 0x7f849406f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 -- 172.21.15.121:0/3455987766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84941e5650 con 0x7f8480004bd0 2023-08-18T20:43:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.713+0000 7f8499b11700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8494152f30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f849001c000 tx=0x7f8490007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.718+0000 7fc089526700 1 Processor -- start 2023-08-18T20:43:52.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.718+0000 7fc089526700 1 -- start start 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc089526700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0840c3d30 0x7fc0840c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc089526700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc084154a20 con 0x7fc0840aaed0 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc089526700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc084154470 con 0x7fc0840aaaf0 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc089526700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840c12c0 con 0x7fc0840c3d30 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc0837fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc0840aaed0 0x7fc0840c4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47034/0 (socket says 172.21.15.121:47034) 2023-08-18T20:43:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.719+0000 7fc0837fe700 1 -- 172.21.15.121:0/3475591813 learned_addr learned my addr 172.21.15.121:0/3475591813 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.720+0000 7fc0827fc700 1 --2- 172.21.15.121:0/3475591813 >> v2:172.21.15.121:3300/0 conn(0x7fc0840c3d30 0x7fc0840c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.720+0000 7fc0827fc700 1 -- 172.21.15.121:0/3475591813 >> v1:172.21.15.122:6789/0 conn(0x7fc0840aaaf0 legacy=0x7fc0840c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.720+0000 7fc0827fc700 1 -- 172.21.15.121:0/3475591813 >> v1:172.21.15.121:6789/0 conn(0x7fc0840aaed0 legacy=0x7fc0840c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.720+0000 7fc0827fc700 1 -- 172.21.15.121:0/3475591813 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084154740 con 0x7fc0840c3d30 2023-08-18T20:43:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.720+0000 7fc0827fc700 1 --2- 172.21.15.121:0/3475591813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840c3d30 0x7fc0840c4820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc07800a9e0 tx=0x7fc07800acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e73a5c33b7ae80 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.724+0000 7fc081ffb700 1 -- 172.21.15.121:0/3475591813 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078004230 con 0x7fc0840c3d30 2023-08-18T20:43:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.724+0000 7fc081ffb700 1 -- 172.21.15.121:0/3475591813 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078004390 con 0x7fc0840c3d30 2023-08-18T20:43:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.724+0000 7fc081ffb700 1 -- 172.21.15.121:0/3475591813 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800c870 con 0x7fc0840c3d30 2023-08-18T20:43:52.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.728+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490012b70 con 0x7f8480004bd0 2023-08-18T20:43:52.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.728+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490012cd0 con 0x7f8480004bd0 2023-08-18T20:43:52.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.728+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900038c0 con 0x7f8480004bd0 2023-08-18T20:43:52.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.729+0000 7fc089526700 1 -- 172.21.15.121:0/3475591813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840c3d30 msgr2=0x7fc0840c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.729+0000 7fc089526700 1 --2- 172.21.15.121:0/3475591813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840c3d30 0x7fc0840c4820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc07800a9e0 tx=0x7fc07800acf0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.729+0000 7fc089526700 1 -- 172.21.15.121:0/3475591813 shutdown_connections 2023-08-18T20:43:52.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.729+0000 7fc089526700 1 --2- 172.21.15.121:0/3475591813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840c3d30 0x7fc0840c4820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.729+0000 7fc089526700 1 -- 172.21.15.121:0/3475591813 >> 172.21.15.121:0/3475591813 conn(0x7fc08406a4b0 msgr2=0x7fc08406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.730+0000 7fc089526700 1 -- 172.21.15.121:0/3475591813 shutdown_connections 2023-08-18T20:43:52.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.728+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84941e5930 con 0x7f8480004bd0 2023-08-18T20:43:52.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.728+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84941e5ef0 con 0x7f8480004bd0 2023-08-18T20:43:52.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.730+0000 7fc089526700 1 -- 172.21.15.121:0/3475591813 wait complete. 2023-08-18T20:43:52.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.732+0000 7fc089526700 1 Processor -- start 2023-08-18T20:43:52.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.732+0000 7fc089526700 1 -- start start 2023-08-18T20:43:52.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0840aaaf0 0x7fc08415d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840aaed0 0x7fc084070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08415bec0 con 0x7fc0840aaed0 2023-08-18T20:43:52.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840a44d0 con 0x7fc0840c3d30 2023-08-18T20:43:52.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc089526700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840a47b0 con 0x7fc0840aaaf0 2023-08-18T20:43:52.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50294/0 (socket says 172.21.15.121:50294) 2023-08-18T20:43:52.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7fc0837fe700 1 -- 172.21.15.121:0/2939102244 learned_addr learned my addr 172.21.15.121:0/2939102244 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8490003a20 con 0x7f8480004bd0 2023-08-18T20:43:52.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7f848a7fc700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 0x7f848006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.734+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8490088ce0 con 0x7f8480004bd0 2023-08-18T20:43:52.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 -- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0840aaaf0 msgr2=0x7fc08415d870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-18T20:43:52.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0840aaaf0 0x7fc08415d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 -- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840aaed0 msgr2=0x7fc084070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840aaed0 0x7fc084070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 -- 172.21.15.121:0/2939102244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07800a640 con 0x7fc0840c3d30 2023-08-18T20:43:52.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7f8499310700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 0x7f848006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7fc0837fe700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00cb30 tx=0x7fc07c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.735+0000 7f8499310700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 0x7f848006e440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8484006fd0 tx=0x7f84840092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.736+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00ab50 con 0x7fc0840c3d30 2023-08-18T20:43:52.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.736+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00acd0 con 0x7fc0840c3d30 2023-08-18T20:43:52.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.736+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08415c160 con 0x7fc0840c3d30 2023-08-18T20:43:52.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.736+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08415ddb0 con 0x7fc0840c3d30 2023-08-18T20:43:52.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.736+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007310 con 0x7fc0840c3d30 2023-08-18T20:43:52.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.737+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc084070cf0 con 0x7fc0840c3d30 2023-08-18T20:43:52.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.738+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c0052f0 con 0x7f8480004bd0 2023-08-18T20:43:52.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.738+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc07c007d50 con 0x7fc0840c3d30 2023-08-18T20:43:52.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.738+0000 7fc06b7fe700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 0x7fc06c06c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.738+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc07c0880a0 con 0x7fc0840c3d30 2023-08-18T20:43:52.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.740+0000 7fc082ffd700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 0x7fc06c06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.740+0000 7fc082ffd700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 0x7fc06c06c830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc074000f60 tx=0x7fc074007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc084070cf0 con 0x7fc0840c3d30 2023-08-18T20:43:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.741+0000 7f2c9b96b700 1 Processor -- start 2023-08-18T20:43:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.741+0000 7f2c9b96b700 1 -- start start 2023-08-18T20:43:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.743+0000 7f2c9b96b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 0x7f2c94159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.743+0000 7f2c9b96b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9415be20 con 0x7f2c94155f50 2023-08-18T20:43:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.743+0000 7f2c9b96b700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940c1370 con 0x7f2c940c39d0 2023-08-18T20:43:52.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.743+0000 7f2c9b96b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c0930 con 0x7f2c940c44a0 2023-08-18T20:43:52.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c98f06700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2c940c39d0 0x7f2c94158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:56168/0 (socket says 172.21.15.121:56168) 2023-08-18T20:43:52.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c98f06700 1 -- 172.21.15.121:0/1575965976 learned_addr learned my addr 172.21.15.121:0/1575965976 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:52.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c99f08700 1 --2- 172.21.15.121:0/1575965976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 0x7f2c94159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c99f08700 1 -- 172.21.15.121:0/1575965976 >> v1:172.21.15.122:6789/0 conn(0x7f2c940c39d0 legacy=0x7f2c94158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c99f08700 1 -- 172.21.15.121:0/1575965976 >> v1:172.21.15.121:6789/0 conn(0x7f2c94155f50 legacy=0x7f2c940c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:52.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.744+0000 7f2c99f08700 1 -- 172.21.15.121:0/1575965976 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94156330 con 0x7f2c940c44a0 2023-08-18T20:43:52.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.745+0000 7f2c99f08700 1 --2- 172.21.15.121:0/1575965976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 0x7f2c94159380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097f0 tx=0x7f2c90009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4732023dab9b6de7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.747+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8490054610 con 0x7f8480004bd0 2023-08-18T20:43:52.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.753+0000 7f2c8bfff700 1 -- 172.21.15.121:0/1575965976 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004230 con 0x7f2c940c44a0 2023-08-18T20:43:52.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.753+0000 7f2c8bfff700 1 -- 172.21.15.121:0/1575965976 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90004390 con 0x7f2c940c44a0 2023-08-18T20:43:52.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.753+0000 7f2c8bfff700 1 -- 172.21.15.121:0/1575965976 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900036a0 con 0x7f2c940c44a0 2023-08-18T20:43:52.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.754+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1575965976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 msgr2=0x7f2c94159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.754+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1575965976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 0x7f2c94159380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097f0 tx=0x7f2c90009b00 comp rx=0 tx=0).stop 2023-08-18T20:43:52.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.758+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1575965976 shutdown_connections 2023-08-18T20:43:52.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.758+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1575965976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c44a0 0x7f2c94159380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.758+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1575965976 >> 172.21.15.121:0/1575965976 conn(0x7f2c9406a4b0 msgr2=0x7f2c9406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:52.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.758+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1575965976 shutdown_connections 2023-08-18T20:43:52.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.758+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1575965976 wait complete. 2023-08-18T20:43:52.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.760+0000 7f2c9b96b700 1 Processor -- start 2023-08-18T20:43:52.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.760+0000 7f2c9b96b700 1 -- start start 2023-08-18T20:43:52.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c39d0 0x7f2c94137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c94155f50 0x7f2c9413e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94070700 con 0x7f2c94155f50 2023-08-18T20:43:52.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9413dfe0 con 0x7f2c940c44a0 2023-08-18T20:43:52.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.761+0000 7f2c9b96b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94070d10 con 0x7f2c940c39d0 2023-08-18T20:43:52.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.769+0000 7f2c99707700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c39d0 0x7f2c94137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.769+0000 7f2c98f06700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.769+0000 7f2c98f06700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50310/0 (socket says 172.21.15.121:50310) 2023-08-18T20:43:52.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.769+0000 7f2c98f06700 1 -- 172.21.15.121:0/1763312955 learned_addr learned my addr 172.21.15.121:0/1763312955 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:52.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.769+0000 7f2c99f08700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c94155f50 0x7f2c9413e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.770+0000 7f2c98f06700 1 -- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c39d0 msgr2=0x7f2c94137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.770+0000 7f2c98f06700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c39d0 0x7f2c94137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.770+0000 7f2c98f06700 1 -- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c94155f50 msgr2=0x7f2c9413e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:52.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.770+0000 7f2c98f06700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c94155f50 0x7f2c9413e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:52.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.770+0000 7f2c98f06700 1 -- 172.21.15.121:0/1763312955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c940c44a0 2023-08-18T20:43:52.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.781+0000 7f2c98f06700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00cfa0 tx=0x7f2c8c00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.790+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0070d0 con 0x7f2c940c44a0 2023-08-18T20:43:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.790+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c007230 con 0x7f2c940c44a0 2023-08-18T20:43:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.790+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0075a0 con 0x7f2c940c44a0 2023-08-18T20:43:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.790+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9406fea0 con 0x7f2c940c44a0 2023-08-18T20:43:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.790+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94070140 con 0x7f2c940c44a0 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.803+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c8c007700 con 0x7f2c940c44a0 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.803+0000 7f2c89ffb700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 0x7f2c7806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.803+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c8c0884b0 con 0x7f2c940c44a0 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.804+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940c1370 con 0x7f2c940c44a0 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.804+0000 7f2c99707700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 0x7f2c7806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:52.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.805+0000 7f2c99707700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 0x7f2c7806c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406fe30 tx=0x7f2c840090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:52.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:52.825+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2c940c1370 con 0x7f2c940c44a0 2023-08-18T20:43:53.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.010+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f338c005870 con 0x7f33a80c6010 2023-08-18T20:43:53.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.014+0000 7f3396ffd700 1 -- 172.21.15.121:0/1612042576 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33a001a020 con 0x7f33a80c6010 2023-08-18T20:43:53.017 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:53.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.025+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a3c0055a0 con 0x7f7a540aaed0 2023-08-18T20:43:53.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.026+0000 7f7a4affd700 1 -- 172.21.15.121:0/2254296825 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a44056e50 con 0x7f7a540aaed0 2023-08-18T20:43:53.029 INFO:teuthology.orchestra.run.smithi121.stdout:60129542152 2023-08-18T20:43:53.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.030+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 msgr2=0x7f7a3806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.030+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 0x7f7a3806c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000c00 tx=0x7f7a50012000 comp rx=0 tx=0).stop 2023-08-18T20:43:53.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.030+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 msgr2=0x7f7a541f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.030+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 0x7f7a541f9e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a440048d0 tx=0x7f7a4400c800 comp rx=0 tx=0).stop 2023-08-18T20:43:53.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 shutdown_connections 2023-08-18T20:43:53.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7a3806a1b0 0x7f7a3806c670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a540c3d30 0x7f7a541f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a540aaaf0 0x7f7a540bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 --2- 172.21.15.121:0/2254296825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a540aaed0 0x7f7a541f9e60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 >> 172.21.15.121:0/2254296825 conn(0x7f7a5406a4b0 msgr2=0x7f7a540a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 msgr2=0x7f338806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 0x7f338806c6a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f339c0096f0 tx=0x7f339c006c50 comp rx=0 tx=0).stop 2023-08-18T20:43:53.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 msgr2=0x7f33a80a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.031+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cef0 tx=0x7f33a000a340 comp rx=0 tx=0).stop 2023-08-18T20:43:53.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.032+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 shutdown_connections 2023-08-18T20:43:53.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.032+0000 7f7a5c791700 1 -- 172.21.15.121:0/2254296825 wait complete. 2023-08-18T20:43:53.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 shutdown_connections 2023-08-18T20:43:53.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33a80c6010 0x7f33a80a3330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f338806a1e0 0x7f338806c6a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a80c4640 0x7f33a815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 --2- 172.21.15.121:0/1612042576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33a80c4fd0 0x7f33a80a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 >> 172.21.15.121:0/1612042576 conn(0x7f33a806a4b0 msgr2=0x7f33a80c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 shutdown_connections 2023-08-18T20:43:53.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.033+0000 7f33acf34700 1 -- 172.21.15.121:0/1612042576 wait complete. 2023-08-18T20:43:53.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.039+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ac80055a0 con 0x7f2ae00c44a0 2023-08-18T20:43:53.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.039+0000 7f2ad6ffd700 1 -- 172.21.15.121:0/1115383806 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ad8020030 con 0x7f2ae00c44a0 2023-08-18T20:43:53.040 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2023-08-18T20:43:53.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 msgr2=0x7f2ac406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 0x7f2ac406c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009770 tx=0x7f2ad0006cd0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 msgr2=0x7f2ae0153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00c3650 tx=0x7f2ad8004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 shutdown_connections 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ae0155f50 0x7f2ae014dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2ac406a1b0 0x7f2ac406c670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.047+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ae00c39d0 0x7f2ae01f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.048+0000 7f2ae85bb700 1 --2- 172.21.15.121:0/1115383806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ae00c44a0 0x7f2ae0153450 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.048+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 >> 172.21.15.121:0/1115383806 conn(0x7f2ae006a4b0 msgr2=0x7f2ae00c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.048+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 shutdown_connections 2023-08-18T20:43:53.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.048+0000 7f2ae85bb700 1 -- 172.21.15.121:0/1115383806 wait complete. 2023-08-18T20:43:53.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.1 2023-08-18T20:43:53.053 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.3 2023-08-18T20:43:53.059 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.0 2023-08-18T20:43:53.064 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.085+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9e100a74d0 con 0x7f9e100c44a0 2023-08-18T20:43:53.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.085+0000 7f9df7fff700 1 -- 172.21.15.121:0/1215497725 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e040589b0 con 0x7f9e100c44a0 2023-08-18T20:43:53.086 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:53.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 msgr2=0x7f9dfc06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 0x7f9dfc06c6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e00003df0 tx=0x7f9e00007a40 comp rx=0 tx=0).stop 2023-08-18T20:43:53.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 msgr2=0x7f9e10156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e04004000 tx=0x7f9e04004750 comp rx=0 tx=0).stop 2023-08-18T20:43:53.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 shutdown_connections 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e10155f50 0x7f9e10157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9dfc06a1e0 0x7f9dfc06c6a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e100c39d0 0x7f9e101443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 --2- 172.21.15.121:0/1215497725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e100c44a0 0x7f9e10156c20 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e04004000 tx=0x7f9e04004750 comp rx=0 tx=0).stop 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.088+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 >> 172.21.15.121:0/1215497725 conn(0x7f9e1006a4b0 msgr2=0x7f9e1015b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.089+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 shutdown_connections 2023-08-18T20:43:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.089+0000 7f9e1593b700 1 -- 172.21.15.121:0/1215497725 wait complete. 2023-08-18T20:43:53.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.7 2023-08-18T20:43:53.107 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.114+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc084070cf0 con 0x7fc0840c3d30 2023-08-18T20:43:53.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.114+0000 7fc06b7fe700 1 -- 172.21.15.121:0/2939102244 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc084070cf0 con 0x7fc0840c3d30 2023-08-18T20:43:53.115 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2023-08-18T20:43:53.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.117+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 msgr2=0x7fc06c06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.117+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 0x7fc06c06c830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc074000f60 tx=0x7fc074007a20 comp rx=0 tx=0).stop 2023-08-18T20:43:53.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.117+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 msgr2=0x7fc084071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.117+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00cb30 tx=0x7fc07c00cef0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 shutdown_connections 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0840c3d30 0x7fc084071510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0840aaaf0 0x7fc08415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc06c06a370 0x7fc06c06c830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 --2- 172.21.15.121:0/2939102244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0840aaed0 0x7fc084070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 >> 172.21.15.121:0/2939102244 conn(0x7fc08406a4b0 msgr2=0x7fc0840c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 shutdown_connections 2023-08-18T20:43:53.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.118+0000 7fc089526700 1 -- 172.21.15.121:0/2939102244 wait complete. 2023-08-18T20:43:53.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.4 2023-08-18T20:43:53.135 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.143+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22a80055a0 con 0x7f22c80c44a0 2023-08-18T20:43:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.144+0000 7f22affff700 1 -- 172.21.15.121:0/2766279705 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22c0017030 con 0x7f22c80c44a0 2023-08-18T20:43:53.144 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2023-08-18T20:43:53.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 msgr2=0x7f22b406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 0x7f22b406c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22c8154da0 tx=0x7f22bc008040 comp rx=0 tx=0).stop 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 msgr2=0x7f22c81ef940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 0x7f22c81ef940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22c0014000 tx=0x7f22c0004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 shutdown_connections 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22b406a1b0 0x7f22b406c670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22c8155f50 0x7f22c81efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22c80c39d0 0x7f22c8154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 --2- 172.21.15.121:0/2766279705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c80c44a0 0x7f22c81ef940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 >> 172.21.15.121:0/2766279705 conn(0x7f22c806a4b0 msgr2=0x7f22c815b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 shutdown_connections 2023-08-18T20:43:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.146+0000 7f22cdad1700 1 -- 172.21.15.121:0/2766279705 wait complete. 2023-08-18T20:43:53.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.154+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f847c0055a0 con 0x7f8480004bd0 2023-08-18T20:43:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.154+0000 7f848a7fc700 1 -- 172.21.15.121:0/3455987766 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f849001f090 con 0x7f8480004bd0 2023-08-18T20:43:53.155 INFO:teuthology.orchestra.run.smithi121.stdout:60129542152 2023-08-18T20:43:53.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 msgr2=0x7f848006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 0x7f848006e440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8484006fd0 tx=0x7f84840092c0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 msgr2=0x7f8494152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8494152f30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f849001c000 tx=0x7f8490007d10 comp rx=0 tx=0).stop 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 shutdown_connections 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f849414d8c0 0x7f849406f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f848006bf80 0x7f848006e440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8480004bd0 0x7f8494152f30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 --2- 172.21.15.121:0/3455987766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8494071b60 0x7f849414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 >> 172.21.15.121:0/3455987766 conn(0x7f849406a4b0 msgr2=0x7f84940a7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 shutdown_connections 2023-08-18T20:43:53.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.158+0000 7f849bd75700 1 -- 172.21.15.121:0/3455987766 wait complete. 2023-08-18T20:43:53.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.2 2023-08-18T20:43:53.161 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2023-08-18T20:43:53.171 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.233+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2c9413e150 con 0x7f2c940c44a0 2023-08-18T20:43:53.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.234+0000 7f2c89ffb700 1 -- 172.21.15.121:0/1763312955 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c9413e150 con 0x7f2c940c44a0 2023-08-18T20:43:53.234 INFO:teuthology.orchestra.run.smithi121.stdout:60129542152 2023-08-18T20:43:53.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 msgr2=0x7f2c7806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 0x7f2c7806c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406fe30 tx=0x7f2c840090e0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 msgr2=0x7f2c9415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00cfa0 tx=0x7f2c8c00a340 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 shutdown_connections 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c7806a180 0x7f2c7806c640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c94155f50 0x7f2c9413e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c940c39d0 0x7f2c94137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 --2- 172.21.15.121:0/1763312955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c940c44a0 0x7f2c9415ae40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 >> 172.21.15.121:0/1763312955 conn(0x7f2c9406a4b0 msgr2=0x7f2c9406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 shutdown_connections 2023-08-18T20:43:53.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.236+0000 7f2c9b96b700 1 -- 172.21.15.121:0/1763312955 wait complete. 2023-08-18T20:43:53.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.6 2023-08-18T20:43:53.248 DEBUG:teuthology.parallel:result is None 2023-08-18T20:43:53.248 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-18T20:43:53.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:43:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.368+0000 7f152fda9700 1 Processor -- start 2023-08-18T20:43:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.368+0000 7f152fda9700 1 -- start start 2023-08-18T20:43:53.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.368+0000 7f152fda9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f15280c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.368+0000 7f152fda9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1528155e00 0x7f1528156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.368+0000 7f152fda9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528155970 con 0x7f152814fb90 2023-08-18T20:43:53.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152fda9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15281567d0 con 0x7f1528155e00 2023-08-18T20:43:53.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152fda9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152814ff70 con 0x7f1528152250 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152db45700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f152814fb90 0x7f152806a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47060/0 (socket says 172.21.15.121:47060) 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152db45700 1 -- 172.21.15.121:0/2110614786 learned_addr learned my addr 172.21.15.121:0/2110614786 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152e346700 1 --2- 172.21.15.121:0/2110614786 >> v2:172.21.15.122:3300/0 conn(0x7f1528155e00 0x7f1528156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152d344700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f15280c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629276984 0 0) 0x7f1528155970 con 0x7f152814fb90 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15140035b0 con 0x7f152814fb90 2023-08-18T20:43:53.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764887328 0 0) 0x7f15140035b0 con 0x7f152814fb90 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 msgr2=0x7f15280c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f15280c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 >> v2:172.21.15.122:3300/0 conn(0x7f1528155e00 msgr2=0x7f1528156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 --2- 172.21.15.121:0/2110614786 >> v2:172.21.15.122:3300/0 conn(0x7f1528155e00 0x7f1528156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152806e830 con 0x7f152814fb90 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1518001670 con 0x7f152814fb90 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 >> v1:172.21.15.121:6789/0 conn(0x7f152814fb90 legacy=0x7f152806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f1514003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1514003ff0 0x7f1514004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514004d90 0x7f1514005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281567d0 con 0x7f1514003ff0 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151400ba10 con 0x7f1514004d90 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151400bb80 con 0x7f1528152250 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152d344700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1514003ff0 0x7f1514004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152db45700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f1514003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.369+0000 7f152e346700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514004d90 0x7f1514005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 -- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 msgr2=0x7f1514003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1528152250 0x7f1514003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 -- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514004d90 msgr2=0x7f1514005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514004d90 0x7f1514005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 -- 172.21.15.121:0/2110614786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140035b0 con 0x7f1514003ff0 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152d344700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1514003ff0 0x7f1514004850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1524009b30 tx=0x7f1514005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d15e2c87bdf67 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400e6c0 con 0x7f1514003ff0 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400e820 con 0x7f1514003ff0 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152cb43700 1 -- 172.21.15.121:0/2110614786 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400eb90 con 0x7f1514003ff0 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 -- 172.21.15.121:0/2110614786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1514003ff0 msgr2=0x7f1514004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 --2- 172.21.15.121:0/2110614786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1514003ff0 0x7f1514004850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1524009b30 tx=0x7f1514005880 comp rx=0 tx=0).stop 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152e346700 1 -- 172.21.15.121:0/2110614786 reap_dead start 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 -- 172.21.15.121:0/2110614786 shutdown_connections 2023-08-18T20:43:53.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 -- 172.21.15.121:0/2110614786 >> 172.21.15.121:0/2110614786 conn(0x7f15280c6b10 msgr2=0x7f15280c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 -- 172.21.15.121:0/2110614786 shutdown_connections 2023-08-18T20:43:53.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.370+0000 7f152fda9700 1 -- 172.21.15.121:0/2110614786 wait complete. 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 Processor -- start 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 -- start start 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514003ff0 0x7f152814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152814c7e0 0x7f1528153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152814f9a0 con 0x7f15280c2230 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281535f0 con 0x7f1514003ff0 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152fda9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1528155240 con 0x7f152814c7e0 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152e346700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152e346700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40494/0 (socket says 172.21.15.121:40494) 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152e346700 1 -- 172.21.15.121:0/3837527880 learned_addr learned my addr 172.21.15.121:0/3837527880 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152db45700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514003ff0 0x7f152814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.372+0000 7f152d344700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152814c7e0 0x7f1528153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 -- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152814c7e0 msgr2=0x7f1528153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152814c7e0 0x7f1528153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 -- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514003ff0 msgr2=0x7f152814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514003ff0 0x7f152814c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 -- 172.21.15.121:0/3837527880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528155520 con 0x7f15280c2230 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152e346700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15280708e0 tx=0x7f1520011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000e040 con 0x7f15280c2230 2023-08-18T20:43:53.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152000f040 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15281e7cd0 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000fc40 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.373+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15281544e0 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.374+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528154760 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.374+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1520015430 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.375+0000 7f151e7fc700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 0x7f150c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.375+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1520088d10 con 0x7f15280c2230 2023-08-18T20:43:53.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.375+0000 7f152db45700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 0x7f150c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.375+0000 7f152db45700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 0x7f150c06c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1518000c00 tx=0x7f1518007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.379+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1520057fd0 con 0x7f15280c2230 2023-08-18T20:43:53.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.567+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f152806e270 con 0x7f150c06a0e0 2023-08-18T20:43:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.575+0000 7f151e7fc700 1 -- 172.21.15.121:0/3837527880 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286880 (secure 0 0 0) 0x7f15180070c0 con 0x7f150c06a0e0 2023-08-18T20:43:53.579 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:53.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 msgr2=0x7f150c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 0x7f150c06c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1518000c00 tx=0x7f1518007980 comp rx=0 tx=0).stop 2023-08-18T20:43:53.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 msgr2=0x7f1528153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15280708e0 tx=0x7f1520011ed0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 shutdown_connections 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f150c06a0e0 0x7f150c06c5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15280c2230 0x7f1528153fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514003ff0 0x7f152814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 --2- 172.21.15.121:0/3837527880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152814c7e0 0x7f1528153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 >> 172.21.15.121:0/3837527880 conn(0x7f15280c6b10 msgr2=0x7f1528150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 shutdown_connections 2023-08-18T20:43:53.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.578+0000 7f152fda9700 1 -- 172.21.15.121:0/3837527880 wait complete. 2023-08-18T20:43:53.583 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:43:53.590 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-18T20:43:52.915383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3055616,"data_stored":1843524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.321349"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215346+0000","last_change":"2023-08-18T20:43:44.613436+0000","last_active":"2023-08-18T20:43:46.215346+0000","last_peered":"2023-08-18T20:43:46.215346+0000","last_clean":"2023-08-18T20:43:46.215346+0000","last_became_active":"2023-08-18T20:43:44.613171+0000","last_became_peered":"2023-08-18T20:43:44.613171+0000","last_unstale":"2023-08-18T20:43:46.215346+0000","last_undegraded":"2023-08-18T20:43:46.215346+0000","last_fullsized":"2023-08-18T20:43:46.215346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:51:41.119353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215643+0000","last_change":"2023-08-18T20:43:44.619506+0000","last_active":"2023-08-18T20:43:46.215643+0000","last_peered":"2023-08-18T20:43:46.215643+0000","last_clean":"2023-08-18T20:43:46.215643+0000","last_became_active":"2023-08-18T20:43:44.619216+0000","last_became_peered":"2023-08-18T20:43:44.619216+0000","last_unstale":"2023-08-18T20:43:46.215643+0000","last_undegraded":"2023-08-18T20:43:46.215643+0000","last_fullsized":"2023-08-18T20:43:46.215643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714146+0000","last_change":"2023-08-18T20:43:44.615835+0000","last_active":"2023-08-18T20:43:45.714146+0000","last_peered":"2023-08-18T20:43:45.714146+0000","last_clean":"2023-08-18T20:43:45.714146+0000","last_became_active":"2023-08-18T20:43:44.615439+0000","last_became_peered":"2023-08-18T20:43:44.615439+0000","last_unstale":"2023-08-18T20:43:45.714146+0000","last_undegraded":"2023-08-18T20:43:45.714146+0000","last_fullsized":"2023-08-18T20:43:45.714146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:18.373624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618189+0000","last_change":"2023-08-18T20:43:44.611672+0000","last_active":"2023-08-18T20:43:45.618189+0000","last_peered":"2023-08-18T20:43:45.618189+0000","last_clean":"2023-08-18T20:43:45.618189+0000","last_became_active":"2023-08-18T20:43:44.611355+0000","last_became_peered":"2023-08-18T20:43:44.611355+0000","last_unstale":"2023-08-18T20:43:45.618189+0000","last_undegraded":"2023-08-18T20:43:45.618189+0000","last_fullsized":"2023-08-18T20:43:45.618189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214898+0000","last_change":"2023-08-18T20:43:44.624219+0000","last_active":"2023-08-18T20:43:46.214898+0000","last_peered":"2023-08-18T20:43:46.214898+0000","last_clean":"2023-08-18T20:43:46.214898+0000","last_became_active":"2023-08-18T20:43:44.623964+0000","last_became_peered":"2023-08-18T20:43:44.623964+0000","last_unstale":"2023-08-18T20:43:46.214898+0000","last_undegraded":"2023-08-18T20:43:46.214898+0000","last_fullsized":"2023-08-18T20:43:46.214898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713758+0000","last_change":"2023-08-18T20:43:44.619846+0000","last_active":"2023-08-18T20:43:45.713758+0000","last_peered":"2023-08-18T20:43:45.713758+0000","last_clean":"2023-08-18T20:43:45.713758+0000","last_became_active":"2023-08-18T20:43:44.619591+0000","last_became_peered":"2023-08-18T20:43:44.619591+0000","last_unstale":"2023-08-18T20:43:45.713758+0000","last_undegraded":"2023-08-18T20:43:45.713758+0000","last_fullsized":"2023-08-18T20:43:45.713758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215228+0000","last_change":"2023-08-18T20:43:44.628859+0000","last_active":"2023-08-18T20:43:46.215228+0000","last_peered":"2023-08-18T20:43:46.215228+0000","last_clean":"2023-08-18T20:43:46.215228+0000","last_became_active":"2023-08-18T20:43:44.628585+0000","last_became_peered":"2023-08-18T20:43:44.628585+0000","last_unstale":"2023-08-18T20:43:46.215228+0000","last_undegraded":"2023-08-18T20:43:46.215228+0000","last_fullsized":"2023-08-18T20:43:46.215228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:11.821010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214860+0000","last_change":"2023-08-18T20:43:44.618307+0000","last_active":"2023-08-18T20:43:46.214860+0000","last_peered":"2023-08-18T20:43:46.214860+0000","last_clean":"2023-08-18T20:43:46.214860+0000","last_became_active":"2023-08-18T20:43:44.617977+0000","last_became_peered":"2023-08-18T20:43:44.617977+0000","last_unstale":"2023-08-18T20:43:46.214860+0000","last_undegraded":"2023-08-18T20:43:46.214860+0000","last_fullsized":"2023-08-18T20:43:46.214860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214817+0000","last_change":"2023-08-18T20:43:44.616362+0000","last_active":"2023-08-18T20:43:46.214817+0000","last_peered":"2023-08-18T20:43:46.214817+0000","last_clean":"2023-08-18T20:43:46.214817+0000","last_became_active":"2023-08-18T20:43:44.615973+0000","last_became_peered":"2023-08-18T20:43:44.615973+0000","last_unstale":"2023-08-18T20:43:46.214817+0000","last_undegraded":"2023-08-18T20:43:46.214817+0000","last_fullsized":"2023-08-18T20:43:46.214817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215511+0000","last_change":"2023-08-18T20:43:44.618993+0000","last_active":"2023-08-18T20:43:46.215511+0000","last_peered":"2023-08-18T20:43:46.215511+0000","last_clean":"2023-08-18T20:43:46.215511+0000","last_became_active":"2023-08-18T20:43:44.618718+0000","last_became_peered":"2023-08-18T20:43:44.618718+0000","last_unstale":"2023-08-18T20:43:46.215511+0000","last_undegraded":"2023-08-18T20:43:46.215511+0000","last_fullsized":"2023-08-18T20:43:46.215511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714250+0000","last_change":"2023-08-18T20:43:44.624641+0000","last_active":"2023-08-18T20:43:45.714250+0000","last_peered":"2023-08-18T20:43:45.714250+0000","last_clean":"2023-08-18T20:43:45.714250+0000","last_became_active":"2023-08-18T20:43:44.624090+0000","last_became_peered":"2023-08-18T20:43:44.624090+0000","last_unstale":"2023-08-18T20:43:45.714250+0000","last_undegraded":"2023-08-18T20:43:45.714250+0000","last_fullsized":"2023-08-18T20:43:45.714250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:21.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214357+0000","last_change":"2023-08-18T20:43:44.622302+0000","last_active":"2023-08-18T20:43:46.214357+0000","last_peered":"2023-08-18T20:43:46.214357+0000","last_clean":"2023-08-18T20:43:46.214357+0000","last_became_active":"2023-08-18T20:43:44.622083+0000","last_became_peered":"2023-08-18T20:43:44.622083+0000","last_unstale":"2023-08-18T20:43:46.214357+0000","last_undegraded":"2023-08-18T20:43:46.214357+0000","last_fullsized":"2023-08-18T20:43:46.214357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:42.153363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214384+0000","last_change":"2023-08-18T20:43:44.621350+0000","last_active":"2023-08-18T20:43:46.214384+0000","last_peered":"2023-08-18T20:43:46.214384+0000","last_clean":"2023-08-18T20:43:46.214384+0000","last_became_active":"2023-08-18T20:43:44.620947+0000","last_became_peered":"2023-08-18T20:43:44.620947+0000","last_unstale":"2023-08-18T20:43:46.214384+0000","last_undegraded":"2023-08-18T20:43:46.214384+0000","last_fullsized":"2023-08-18T20:43:46.214384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:20:09.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215117+0000","last_change":"2023-08-18T20:43:44.615387+0000","last_active":"2023-08-18T20:43:46.215117+0000","last_peered":"2023-08-18T20:43:46.215117+0000","last_clean":"2023-08-18T20:43:46.215117+0000","last_became_active":"2023-08-18T20:43:44.615141+0000","last_became_peered":"2023-08-18T20:43:44.615141+0000","last_unstale":"2023-08-18T20:43:46.215117+0000","last_undegraded":"2023-08-18T20:43:46.215117+0000","last_fullsized":"2023-08-18T20:43:46.215117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215422+0000","last_change":"2023-08-18T20:43:44.629068+0000","last_active":"2023-08-18T20:43:46.215422+0000","last_peered":"2023-08-18T20:43:46.215422+0000","last_clean":"2023-08-18T20:43:46.215422+0000","last_became_active":"2023-08-18T20:43:44.628499+0000","last_became_peered":"2023-08-18T20:43:44.628499+0000","last_unstale":"2023-08-18T20:43:46.215422+0000","last_undegraded":"2023-08-18T20:43:46.215422+0000","last_fullsized":"2023-08-18T20:43:46.215422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713784+0000","last_change":"2023-08-18T20:43:44.614503+0000","last_active":"2023-08-18T20:43:45.713784+0000","last_peered":"2023-08-18T20:43:45.713784+0000","last_clean":"2023-08-18T20:43:45.713784+0000","last_became_active":"2023-08-18T20:43:44.614201+0000","last_became_peered":"2023-08-18T20:43:44.614201+0000","last_unstale":"2023-08-18T20:43:45.713784+0000","last_undegraded":"2023-08-18T20:43:45.713784+0000","last_fullsized":"2023-08-18T20:43:45.713784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214970+0000","last_change":"2023-08-18T20:43:44.620433+0000","last_active":"2023-08-18T20:43:46.214970+0000","last_peered":"2023-08-18T20:43:46.214970+0000","last_clean":"2023-08-18T20:43:46.214970+0000","last_became_active":"2023-08-18T20:43:44.620183+0000","last_became_peered":"2023-08-18T20:43:44.620183+0000","last_unstale":"2023-08-18T20:43:46.214970+0000","last_undegraded":"2023-08-18T20:43:46.214970+0000","last_fullsized":"2023-08-18T20:43:46.214970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714292+0000","last_change":"2023-08-18T20:43:44.619040+0000","last_active":"2023-08-18T20:43:45.714292+0000","last_peered":"2023-08-18T20:43:45.714292+0000","last_clean":"2023-08-18T20:43:45.714292+0000","last_became_active":"2023-08-18T20:43:44.618758+0000","last_became_peered":"2023-08-18T20:43:44.618758+0000","last_unstale":"2023-08-18T20:43:45.714292+0000","last_undegraded":"2023-08-18T20:43:45.714292+0000","last_fullsized":"2023-08-18T20:43:45.714292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:40.432183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214657+0000","last_change":"2023-08-18T20:43:44.610425+0000","last_active":"2023-08-18T20:43:46.214657+0000","last_peered":"2023-08-18T20:43:46.214657+0000","last_clean":"2023-08-18T20:43:46.214657+0000","last_became_active":"2023-08-18T20:43:44.610083+0000","last_became_peered":"2023-08-18T20:43:44.610083+0000","last_unstale":"2023-08-18T20:43:46.214657+0000","last_undegraded":"2023-08-18T20:43:46.214657+0000","last_fullsized":"2023-08-18T20:43:46.214657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:13:17.038436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714045+0000","last_change":"2023-08-18T20:43:44.617819+0000","last_active":"2023-08-18T20:43:45.714045+0000","last_peered":"2023-08-18T20:43:45.714045+0000","last_clean":"2023-08-18T20:43:45.714045+0000","last_became_active":"2023-08-18T20:43:44.617544+0000","last_became_peered":"2023-08-18T20:43:44.617544+0000","last_unstale":"2023-08-18T20:43:45.714045+0000","last_undegraded":"2023-08-18T20:43:45.714045+0000","last_fullsized":"2023-08-18T20:43:45.714045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:13.397598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215659+0000","last_change":"2023-08-18T20:43:44.628884+0000","last_active":"2023-08-18T20:43:46.215659+0000","last_peered":"2023-08-18T20:43:46.215659+0000","last_clean":"2023-08-18T20:43:46.215659+0000","last_became_active":"2023-08-18T20:43:44.628405+0000","last_became_peered":"2023-08-18T20:43:44.628405+0000","last_unstale":"2023-08-18T20:43:46.215659+0000","last_undegraded":"2023-08-18T20:43:46.215659+0000","last_fullsized":"2023-08-18T20:43:46.215659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214670+0000","last_change":"2023-08-18T20:43:44.618393+0000","last_active":"2023-08-18T20:43:46.214670+0000","last_peered":"2023-08-18T20:43:46.214670+0000","last_clean":"2023-08-18T20:43:46.214670+0000","last_became_active":"2023-08-18T20:43:44.618136+0000","last_became_peered":"2023-08-18T20:43:44.618136+0000","last_unstale":"2023-08-18T20:43:46.214670+0000","last_undegraded":"2023-08-18T20:43:46.214670+0000","last_fullsized":"2023-08-18T20:43:46.214670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617524+0000","last_change":"2023-08-18T20:43:44.614686+0000","last_active":"2023-08-18T20:43:45.617524+0000","last_peered":"2023-08-18T20:43:45.617524+0000","last_clean":"2023-08-18T20:43:45.617524+0000","last_became_active":"2023-08-18T20:43:44.612205+0000","last_became_peered":"2023-08-18T20:43:44.612205+0000","last_unstale":"2023-08-18T20:43:45.617524+0000","last_undegraded":"2023-08-18T20:43:45.617524+0000","last_fullsized":"2023-08-18T20:43:45.617524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214980+0000","last_change":"2023-08-18T20:43:44.629057+0000","last_active":"2023-08-18T20:43:46.214980+0000","last_peered":"2023-08-18T20:43:46.214980+0000","last_clean":"2023-08-18T20:43:46.214980+0000","last_became_active":"2023-08-18T20:43:44.628753+0000","last_became_peered":"2023-08-18T20:43:44.628753+0000","last_unstale":"2023-08-18T20:43:46.214980+0000","last_undegraded":"2023-08-18T20:43:46.214980+0000","last_fullsized":"2023-08-18T20:43:46.214980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613163+0000","last_change":"2023-08-18T20:43:44.622856+0000","last_active":"2023-08-18T20:43:45.613163+0000","last_peered":"2023-08-18T20:43:45.613163+0000","last_clean":"2023-08-18T20:43:45.613163+0000","last_became_active":"2023-08-18T20:43:44.622446+0000","last_became_peered":"2023-08-18T20:43:44.622446+0000","last_unstale":"2023-08-18T20:43:45.613163+0000","last_undegraded":"2023-08-18T20:43:45.613163+0000","last_fullsized":"2023-08-18T20:43:45.613163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613287+0000","last_change":"2023-08-18T20:43:44.614336+0000","last_active":"2023-08-18T20:43:45.613287+0000","last_peered":"2023-08-18T20:43:45.613287+0000","last_clean":"2023-08-18T20:43:45.613287+0000","last_became_active":"2023-08-18T20:43:44.613311+0000","last_became_peered":"2023-08-18T20:43:44.613311+0000","last_unstale":"2023-08-18T20:43:45.613287+0000","last_undegraded":"2023-08-18T20:43:45.613287+0000","last_fullsized":"2023-08-18T20:43:45.613287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215500+0000","last_change":"2023-08-18T20:43:44.619472+0000","last_active":"2023-08-18T20:43:46.215500+0000","last_peered":"2023-08-18T20:43:46.215500+0000","last_clean":"2023-08-18T20:43:46.215500+0000","last_became_active":"2023-08-18T20:43:44.619129+0000","last_became_peered":"2023-08-18T20:43:44.619129+0000","last_unstale":"2023-08-18T20:43:46.215500+0000","last_undegraded":"2023-08-18T20:43:46.215500+0000","last_fullsized":"2023-08-18T20:43:46.215500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713985+0000","last_change":"2023-08-18T20:43:43.609894+0000","last_active":"2023-08-18T20:43:45.713985+0000","last_peered":"2023-08-18T20:43:45.713985+0000","last_clean":"2023-08-18T20:43:45.713985+0000","last_became_active":"2023-08-18T20:43:43.609607+0000","last_became_peered":"2023-08-18T20:43:43.609607+0000","last_unstale":"2023-08-18T20:43:45.713985+0000","last_undegraded":"2023-08-18T20:43:45.713985+0000","last_fullsized":"2023-08-18T20:43:45.713985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:01.890051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617654+0000","last_change":"2023-08-18T20:43:44.609769+0000","last_active":"2023-08-18T20:43:45.617654+0000","last_peered":"2023-08-18T20:43:45.617654+0000","last_clean":"2023-08-18T20:43:45.617654+0000","last_became_active":"2023-08-18T20:43:44.609493+0000","last_became_peered":"2023-08-18T20:43:44.609493+0000","last_unstale":"2023-08-18T20:43:45.617654+0000","last_undegraded":"2023-08-18T20:43:45.617654+0000","last_fullsized":"2023-08-18T20:43:45.617654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:16.085957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613008+0000","last_change":"2023-08-18T20:43:43.599440+0000","last_active":"2023-08-18T20:43:45.613008+0000","last_peered":"2023-08-18T20:43:45.613008+0000","last_clean":"2023-08-18T20:43:45.613008+0000","last_became_active":"2023-08-18T20:43:43.599128+0000","last_became_peered":"2023-08-18T20:43:43.599128+0000","last_unstale":"2023-08-18T20:43:45.613008+0000","last_undegraded":"2023-08-18T20:43:45.613008+0000","last_fullsized":"2023-08-18T20:43:45.613008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215208+0000","last_change":"2023-08-18T20:43:44.623290+0000","last_active":"2023-08-18T20:43:46.215208+0000","last_peered":"2023-08-18T20:43:46.215208+0000","last_clean":"2023-08-18T20:43:46.215208+0000","last_became_active":"2023-08-18T20:43:44.623038+0000","last_became_peered":"2023-08-18T20:43:44.623038+0000","last_unstale":"2023-08-18T20:43:46.215208+0000","last_undegraded":"2023-08-18T20:43:46.215208+0000","last_fullsized":"2023-08-18T20:43:46.215208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617757+0000","last_change":"2023-08-18T20:43:43.610873+0000","last_active":"2023-08-18T20:43:45.617757+0000","last_peered":"2023-08-18T20:43:45.617757+0000","last_clean":"2023-08-18T20:43:45.617757+0000","last_became_active":"2023-08-18T20:43:43.610621+0000","last_became_peered":"2023-08-18T20:43:43.610621+0000","last_unstale":"2023-08-18T20:43:45.617757+0000","last_undegraded":"2023-08-18T20:43:45.617757+0000","last_fullsized":"2023-08-18T20:43:45.617757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:10.811810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618237+0000","last_change":"2023-08-18T20:43:44.620235+0000","last_active":"2023-08-18T20:43:45.618237+0000","last_peered":"2023-08-18T20:43:45.618237+0000","last_clean":"2023-08-18T20:43:45.618237+0000","last_became_active":"2023-08-18T20:43:44.619362+0000","last_became_peered":"2023-08-18T20:43:44.619362+0000","last_unstale":"2023-08-18T20:43:45.618237+0000","last_undegraded":"2023-08-18T20:43:45.618237+0000","last_fullsized":"2023-08-18T20:43:45.618237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215096+0000","last_change":"2023-08-18T20:43:43.610434+0000","last_active":"2023-08-18T20:43:46.215096+0000","last_peered":"2023-08-18T20:43:46.215096+0000","last_clean":"2023-08-18T20:43:46.215096+0000","last_became_active":"2023-08-18T20:43:43.610177+0000","last_became_peered":"2023-08-18T20:43:43.610177+0000","last_unstale":"2023-08-18T20:43:46.215096+0000","last_undegraded":"2023-08-18T20:43:46.215096+0000","last_fullsized":"2023-08-18T20:43:46.215096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:19.057032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618022+0000","last_change":"2023-08-18T20:43:44.600116+0000","last_active":"2023-08-18T20:43:45.618022+0000","last_peered":"2023-08-18T20:43:45.618022+0000","last_clean":"2023-08-18T20:43:45.618022+0000","last_became_active":"2023-08-18T20:43:44.599850+0000","last_became_peered":"2023-08-18T20:43:44.599850+0000","last_unstale":"2023-08-18T20:43:45.618022+0000","last_undegraded":"2023-08-18T20:43:45.618022+0000","last_fullsized":"2023-08-18T20:43:45.618022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:06.146312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215310+0000","last_change":"2023-08-18T20:43:43.610800+0000","last_active":"2023-08-18T20:43:46.215310+0000","last_peered":"2023-08-18T20:43:46.215310+0000","last_clean":"2023-08-18T20:43:46.215310+0000","last_became_active":"2023-08-18T20:43:43.610488+0000","last_became_peered":"2023-08-18T20:43:43.610488+0000","last_unstale":"2023-08-18T20:43:46.215310+0000","last_undegraded":"2023-08-18T20:43:46.215310+0000","last_fullsized":"2023-08-18T20:43:46.215310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:32.789941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617668+0000","last_change":"2023-08-18T20:43:44.616549+0000","last_active":"2023-08-18T20:43:45.617668+0000","last_peered":"2023-08-18T20:43:45.617668+0000","last_clean":"2023-08-18T20:43:45.617668+0000","last_became_active":"2023-08-18T20:43:44.613672+0000","last_became_peered":"2023-08-18T20:43:44.613672+0000","last_unstale":"2023-08-18T20:43:45.617668+0000","last_undegraded":"2023-08-18T20:43:45.617668+0000","last_fullsized":"2023-08-18T20:43:45.617668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:31.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215791+0000","last_change":"2023-08-18T20:43:43.614627+0000","last_active":"2023-08-18T20:43:46.215791+0000","last_peered":"2023-08-18T20:43:46.215791+0000","last_clean":"2023-08-18T20:43:46.215791+0000","last_became_active":"2023-08-18T20:43:43.614337+0000","last_became_peered":"2023-08-18T20:43:43.614337+0000","last_unstale":"2023-08-18T20:43:46.215791+0000","last_undegraded":"2023-08-18T20:43:46.215791+0000","last_fullsized":"2023-08-18T20:43:46.215791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:30.384402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613191+0000","last_change":"2023-08-18T20:43:44.617560+0000","last_active":"2023-08-18T20:43:45.613191+0000","last_peered":"2023-08-18T20:43:45.613191+0000","last_clean":"2023-08-18T20:43:45.613191+0000","last_became_active":"2023-08-18T20:43:44.617204+0000","last_became_peered":"2023-08-18T20:43:44.617204+0000","last_unstale":"2023-08-18T20:43:45.613191+0000","last_undegraded":"2023-08-18T20:43:45.613191+0000","last_fullsized":"2023-08-18T20:43:45.613191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714256+0000","last_change":"2023-08-18T20:43:43.612457+0000","last_active":"2023-08-18T20:43:45.714256+0000","last_peered":"2023-08-18T20:43:45.714256+0000","last_clean":"2023-08-18T20:43:45.714256+0000","last_became_active":"2023-08-18T20:43:43.611975+0000","last_became_peered":"2023-08-18T20:43:43.611975+0000","last_unstale":"2023-08-18T20:43:45.714256+0000","last_undegraded":"2023-08-18T20:43:45.714256+0000","last_fullsized":"2023-08-18T20:43:45.714256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:48.357748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.616260+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.615966+0000","last_became_peered":"2023-08-18T20:43:44.615966+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:29.215124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215294+0000","last_change":"2023-08-18T20:43:43.613070+0000","last_active":"2023-08-18T20:43:46.215294+0000","last_peered":"2023-08-18T20:43:46.215294+0000","last_clean":"2023-08-18T20:43:46.215294+0000","last_became_active":"2023-08-18T20:43:43.612736+0000","last_became_peered":"2023-08-18T20:43:43.612736+0000","last_unstale":"2023-08-18T20:43:46.215294+0000","last_undegraded":"2023-08-18T20:43:46.215294+0000","last_fullsized":"2023-08-18T20:43:46.215294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:05.137112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617756+0000","last_change":"2023-08-18T20:43:44.609790+0000","last_active":"2023-08-18T20:43:45.617756+0000","last_peered":"2023-08-18T20:43:45.617756+0000","last_clean":"2023-08-18T20:43:45.617756+0000","last_became_active":"2023-08-18T20:43:44.609536+0000","last_became_peered":"2023-08-18T20:43:44.609536+0000","last_unstale":"2023-08-18T20:43:45.617756+0000","last_undegraded":"2023-08-18T20:43:45.617756+0000","last_fullsized":"2023-08-18T20:43:45.617756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:40.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214802+0000","last_change":"2023-08-18T20:43:43.611373+0000","last_active":"2023-08-18T20:43:46.214802+0000","last_peered":"2023-08-18T20:43:46.214802+0000","last_clean":"2023-08-18T20:43:46.214802+0000","last_became_active":"2023-08-18T20:43:43.611071+0000","last_became_peered":"2023-08-18T20:43:43.611071+0000","last_unstale":"2023-08-18T20:43:46.214802+0000","last_undegraded":"2023-08-18T20:43:46.214802+0000","last_fullsized":"2023-08-18T20:43:46.214802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:58.232785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215579+0000","last_change":"2023-08-18T20:43:44.618343+0000","last_active":"2023-08-18T20:43:46.215579+0000","last_peered":"2023-08-18T20:43:46.215579+0000","last_clean":"2023-08-18T20:43:46.215579+0000","last_became_active":"2023-08-18T20:43:44.618015+0000","last_became_peered":"2023-08-18T20:43:44.618015+0000","last_unstale":"2023-08-18T20:43:46.215579+0000","last_undegraded":"2023-08-18T20:43:46.215579+0000","last_fullsized":"2023-08-18T20:43:46.215579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215130+0000","last_change":"2023-08-18T20:43:43.613459+0000","last_active":"2023-08-18T20:43:46.215130+0000","last_peered":"2023-08-18T20:43:46.215130+0000","last_clean":"2023-08-18T20:43:46.215130+0000","last_became_active":"2023-08-18T20:43:43.613116+0000","last_became_peered":"2023-08-18T20:43:43.613116+0000","last_unstale":"2023-08-18T20:43:46.215130+0000","last_undegraded":"2023-08-18T20:43:46.215130+0000","last_fullsized":"2023-08-18T20:43:46.215130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:15.076757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215008+0000","last_change":"2023-08-18T20:43:44.613785+0000","last_active":"2023-08-18T20:43:46.215008+0000","last_peered":"2023-08-18T20:43:46.215008+0000","last_clean":"2023-08-18T20:43:46.215008+0000","last_became_active":"2023-08-18T20:43:44.612998+0000","last_became_peered":"2023-08-18T20:43:44.612998+0000","last_unstale":"2023-08-18T20:43:46.215008+0000","last_undegraded":"2023-08-18T20:43:46.215008+0000","last_fullsized":"2023-08-18T20:43:46.215008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617840+0000","last_change":"2023-08-18T20:43:43.611887+0000","last_active":"2023-08-18T20:43:45.617840+0000","last_peered":"2023-08-18T20:43:45.617840+0000","last_clean":"2023-08-18T20:43:45.617840+0000","last_became_active":"2023-08-18T20:43:43.611272+0000","last_became_peered":"2023-08-18T20:43:43.611272+0000","last_unstale":"2023-08-18T20:43:45.617840+0000","last_undegraded":"2023-08-18T20:43:45.617840+0000","last_fullsized":"2023-08-18T20:43:45.617840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618290+0000","last_change":"2023-08-18T20:43:44.625002+0000","last_active":"2023-08-18T20:43:45.618290+0000","last_peered":"2023-08-18T20:43:45.618290+0000","last_clean":"2023-08-18T20:43:45.618290+0000","last_became_active":"2023-08-18T20:43:44.624280+0000","last_became_peered":"2023-08-18T20:43:44.624280+0000","last_unstale":"2023-08-18T20:43:45.618290+0000","last_undegraded":"2023-08-18T20:43:45.618290+0000","last_fullsized":"2023-08-18T20:43:45.618290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215595+0000","last_change":"2023-08-18T20:43:43.613335+0000","last_active":"2023-08-18T20:43:46.215595+0000","last_peered":"2023-08-18T20:43:46.215595+0000","last_clean":"2023-08-18T20:43:46.215595+0000","last_became_active":"2023-08-18T20:43:43.613099+0000","last_became_peered":"2023-08-18T20:43:43.613099+0000","last_unstale":"2023-08-18T20:43:46.215595+0000","last_undegraded":"2023-08-18T20:43:46.215595+0000","last_fullsized":"2023-08-18T20:43:46.215595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214883+0000","last_change":"2023-08-18T20:43:44.618882+0000","last_active":"2023-08-18T20:43:46.214883+0000","last_peered":"2023-08-18T20:43:46.214883+0000","last_clean":"2023-08-18T20:43:46.214883+0000","last_became_active":"2023-08-18T20:43:44.618569+0000","last_became_peered":"2023-08-18T20:43:44.618569+0000","last_unstale":"2023-08-18T20:43:46.214883+0000","last_undegraded":"2023-08-18T20:43:46.214883+0000","last_fullsized":"2023-08-18T20:43:46.214883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215383+0000","last_change":"2023-08-18T20:43:43.613693+0000","last_active":"2023-08-18T20:43:46.215383+0000","last_peered":"2023-08-18T20:43:46.215383+0000","last_clean":"2023-08-18T20:43:46.215383+0000","last_became_active":"2023-08-18T20:43:43.613209+0000","last_became_peered":"2023-08-18T20:43:43.613209+0000","last_unstale":"2023-08-18T20:43:46.215383+0000","last_undegraded":"2023-08-18T20:43:46.215383+0000","last_fullsized":"2023-08-18T20:43:46.215383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:39.620078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713787+0000","last_change":"2023-08-18T20:43:44.624612+0000","last_active":"2023-08-18T20:43:45.713787+0000","last_peered":"2023-08-18T20:43:45.713787+0000","last_clean":"2023-08-18T20:43:45.713787+0000","last_became_active":"2023-08-18T20:43:44.624178+0000","last_became_peered":"2023-08-18T20:43:44.624178+0000","last_unstale":"2023-08-18T20:43:45.713787+0000","last_undegraded":"2023-08-18T20:43:45.713787+0000","last_fullsized":"2023-08-18T20:43:45.713787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215599+0000","last_change":"2023-08-18T20:43:43.610565+0000","last_active":"2023-08-18T20:43:46.215599+0000","last_peered":"2023-08-18T20:43:46.215599+0000","last_clean":"2023-08-18T20:43:46.215599+0000","last_became_active":"2023-08-18T20:43:43.610257+0000","last_became_peered":"2023-08-18T20:43:43.610257+0000","last_unstale":"2023-08-18T20:43:46.215599+0000","last_undegraded":"2023-08-18T20:43:46.215599+0000","last_fullsized":"2023-08-18T20:43:46.215599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618026+0000","last_change":"2023-08-18T20:43:44.624063+0000","last_active":"2023-08-18T20:43:45.618026+0000","last_peered":"2023-08-18T20:43:45.618026+0000","last_clean":"2023-08-18T20:43:45.618026+0000","last_became_active":"2023-08-18T20:43:44.623724+0000","last_became_peered":"2023-08-18T20:43:44.623724+0000","last_unstale":"2023-08-18T20:43:45.618026+0000","last_undegraded":"2023-08-18T20:43:45.618026+0000","last_fullsized":"2023-08-18T20:43:45.618026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:21.323341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215772+0000","last_change":"2023-08-18T20:43:43.609105+0000","last_active":"2023-08-18T20:43:46.215772+0000","last_peered":"2023-08-18T20:43:46.215772+0000","last_clean":"2023-08-18T20:43:46.215772+0000","last_became_active":"2023-08-18T20:43:43.608685+0000","last_became_peered":"2023-08-18T20:43:43.608685+0000","last_unstale":"2023-08-18T20:43:46.215772+0000","last_undegraded":"2023-08-18T20:43:46.215772+0000","last_fullsized":"2023-08-18T20:43:46.215772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:18.860564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214810+0000","last_change":"2023-08-18T20:43:44.618819+0000","last_active":"2023-08-18T20:43:46.214810+0000","last_peered":"2023-08-18T20:43:46.214810+0000","last_clean":"2023-08-18T20:43:46.214810+0000","last_became_active":"2023-08-18T20:43:44.618612+0000","last_became_peered":"2023-08-18T20:43:44.618612+0000","last_unstale":"2023-08-18T20:43:46.214810+0000","last_undegraded":"2023-08-18T20:43:46.214810+0000","last_fullsized":"2023-08-18T20:43:46.214810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618091+0000","last_change":"2023-08-18T20:43:43.612421+0000","last_active":"2023-08-18T20:43:45.618091+0000","last_peered":"2023-08-18T20:43:45.618091+0000","last_clean":"2023-08-18T20:43:45.618091+0000","last_became_active":"2023-08-18T20:43:43.612128+0000","last_became_peered":"2023-08-18T20:43:43.612128+0000","last_unstale":"2023-08-18T20:43:45.618091+0000","last_undegraded":"2023-08-18T20:43:45.618091+0000","last_fullsized":"2023-08-18T20:43:45.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714114+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:45.714114+0000","last_peered":"2023-08-18T20:43:45.714114+0000","last_clean":"2023-08-18T20:43:45.714114+0000","last_became_active":"2023-08-18T20:43:44.620147+0000","last_became_peered":"2023-08-18T20:43:44.620147+0000","last_unstale":"2023-08-18T20:43:45.714114+0000","last_undegraded":"2023-08-18T20:43:45.714114+0000","last_fullsized":"2023-08-18T20:43:45.714114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:44.950335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618011+0000","last_change":"2023-08-18T20:43:43.611666+0000","last_active":"2023-08-18T20:43:45.618011+0000","last_peered":"2023-08-18T20:43:45.618011+0000","last_clean":"2023-08-18T20:43:45.618011+0000","last_became_active":"2023-08-18T20:43:43.611286+0000","last_became_peered":"2023-08-18T20:43:43.611286+0000","last_unstale":"2023-08-18T20:43:45.618011+0000","last_undegraded":"2023-08-18T20:43:45.618011+0000","last_fullsized":"2023-08-18T20:43:45.618011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.619092+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.618797+0000","last_became_peered":"2023-08-18T20:43:44.618797+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:45.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713975+0000","last_change":"2023-08-18T20:43:43.616812+0000","last_active":"2023-08-18T20:43:45.713975+0000","last_peered":"2023-08-18T20:43:45.713975+0000","last_clean":"2023-08-18T20:43:45.713975+0000","last_became_active":"2023-08-18T20:43:43.616539+0000","last_became_peered":"2023-08-18T20:43:43.616539+0000","last_unstale":"2023-08-18T20:43:45.713975+0000","last_undegraded":"2023-08-18T20:43:45.713975+0000","last_fullsized":"2023-08-18T20:43:45.713975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:51.228568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714401+0000","last_change":"2023-08-18T20:43:44.618501+0000","last_active":"2023-08-18T20:43:45.714401+0000","last_peered":"2023-08-18T20:43:45.714401+0000","last_clean":"2023-08-18T20:43:45.714401+0000","last_became_active":"2023-08-18T20:43:44.615330+0000","last_became_peered":"2023-08-18T20:43:44.615330+0000","last_unstale":"2023-08-18T20:43:45.714401+0000","last_undegraded":"2023-08-18T20:43:45.714401+0000","last_fullsized":"2023-08-18T20:43:45.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:45:22.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617352+0000","last_change":"2023-08-18T20:43:43.602148+0000","last_active":"2023-08-18T20:43:45.617352+0000","last_peered":"2023-08-18T20:43:45.617352+0000","last_clean":"2023-08-18T20:43:45.617352+0000","last_became_active":"2023-08-18T20:43:43.601869+0000","last_became_peered":"2023-08-18T20:43:43.601869+0000","last_unstale":"2023-08-18T20:43:45.617352+0000","last_undegraded":"2023-08-18T20:43:45.617352+0000","last_fullsized":"2023-08-18T20:43:45.617352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:37.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613324+0000","last_change":"2023-08-18T20:43:44.626768+0000","last_active":"2023-08-18T20:43:45.613324+0000","last_peered":"2023-08-18T20:43:45.613324+0000","last_clean":"2023-08-18T20:43:45.613324+0000","last_became_active":"2023-08-18T20:43:44.626427+0000","last_became_peered":"2023-08-18T20:43:44.626427+0000","last_unstale":"2023-08-18T20:43:45.613324+0000","last_undegraded":"2023-08-18T20:43:45.613324+0000","last_fullsized":"2023-08-18T20:43:45.613324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:54.206575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618198+0000","last_change":"2023-08-18T20:43:43.611362+0000","last_active":"2023-08-18T20:43:45.618198+0000","last_peered":"2023-08-18T20:43:45.618198+0000","last_clean":"2023-08-18T20:43:45.618198+0000","last_became_active":"2023-08-18T20:43:43.611092+0000","last_became_peered":"2023-08-18T20:43:43.611092+0000","last_unstale":"2023-08-18T20:43:45.618198+0000","last_undegraded":"2023-08-18T20:43:45.618198+0000","last_fullsized":"2023-08-18T20:43:45.618198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714288+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:43:45.714288+0000","last_peered":"2023-08-18T20:43:45.714288+0000","last_clean":"2023-08-18T20:43:45.714288+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:43:45.714288+0000","last_undegraded":"2023-08-18T20:43:45.714288+0000","last_fullsized":"2023-08-18T20:43:45.714288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:49.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617274+0000","last_change":"2023-08-18T20:43:44.613070+0000","last_active":"2023-08-18T20:43:45.617274+0000","last_peered":"2023-08-18T20:43:45.617274+0000","last_clean":"2023-08-18T20:43:45.617274+0000","last_became_active":"2023-08-18T20:43:44.612463+0000","last_became_peered":"2023-08-18T20:43:44.612463+0000","last_unstale":"2023-08-18T20:43:45.617274+0000","last_undegraded":"2023-08-18T20:43:45.617274+0000","last_fullsized":"2023-08-18T20:43:45.617274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:20.211699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617706+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:43:45.617706+0000","last_peered":"2023-08-18T20:43:45.617706+0000","last_clean":"2023-08-18T20:43:45.617706+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:43:45.617706+0000","last_undegraded":"2023-08-18T20:43:45.617706+0000","last_fullsized":"2023-08-18T20:43:45.617706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215325+0000","last_change":"2023-08-18T20:43:43.613950+0000","last_active":"2023-08-18T20:43:46.215325+0000","last_peered":"2023-08-18T20:43:46.215325+0000","last_clean":"2023-08-18T20:43:46.215325+0000","last_became_active":"2023-08-18T20:43:43.613664+0000","last_became_peered":"2023-08-18T20:43:43.613664+0000","last_unstale":"2023-08-18T20:43:46.215325+0000","last_undegraded":"2023-08-18T20:43:46.215325+0000","last_fullsized":"2023-08-18T20:43:46.215325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:30.816523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713790+0000","last_change":"2023-08-18T20:43:44.618793+0000","last_active":"2023-08-18T20:43:45.713790+0000","last_peered":"2023-08-18T20:43:45.713790+0000","last_clean":"2023-08-18T20:43:45.713790+0000","last_became_active":"2023-08-18T20:43:44.618505+0000","last_became_peered":"2023-08-18T20:43:44.618505+0000","last_unstale":"2023-08-18T20:43:45.713790+0000","last_undegraded":"2023-08-18T20:43:45.713790+0000","last_fullsized":"2023-08-18T20:43:45.713790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612813+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:43:45.612813+0000","last_peered":"2023-08-18T20:43:45.612813+0000","last_clean":"2023-08-18T20:43:45.612813+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:43:45.612813+0000","last_undegraded":"2023-08-18T20:43:45.612813+0000","last_fullsized":"2023-08-18T20:43:45.612813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:04.764493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215453+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:43:46.215453+0000","last_peered":"2023-08-18T20:43:46.215453+0000","last_clean":"2023-08-18T20:43:46.215453+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:43:46.215453+0000","last_undegraded":"2023-08-18T20:43:46.215453+0000","last_fullsized":"2023-08-18T20:43:46.215453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:47.995440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214649+0000","last_change":"2023-08-18T20:43:43.613219+0000","last_active":"2023-08-18T20:43:46.214649+0000","last_peered":"2023-08-18T20:43:46.214649+0000","last_clean":"2023-08-18T20:43:46.214649+0000","last_became_active":"2023-08-18T20:43:43.612915+0000","last_became_peered":"2023-08-18T20:43:43.612915+0000","last_unstale":"2023-08-18T20:43:46.214649+0000","last_undegraded":"2023-08-18T20:43:46.214649+0000","last_fullsized":"2023-08-18T20:43:46.214649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215110+0000","last_change":"2023-08-18T20:43:44.617320+0000","last_active":"2023-08-18T20:43:46.215110+0000","last_peered":"2023-08-18T20:43:46.215110+0000","last_clean":"2023-08-18T20:43:46.215110+0000","last_became_active":"2023-08-18T20:43:44.617066+0000","last_became_peered":"2023-08-18T20:43:44.617066+0000","last_unstale":"2023-08-18T20:43:46.215110+0000","last_undegraded":"2023-08-18T20:43:46.215110+0000","last_fullsized":"2023-08-18T20:43:46.215110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215134+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:43:46.215134+0000","last_peered":"2023-08-18T20:43:46.215134+0000","last_clean":"2023-08-18T20:43:46.215134+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:43:46.215134+0000","last_undegraded":"2023-08-18T20:43:46.215134+0000","last_fullsized":"2023-08-18T20:43:46.215134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:25.909452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612853+0000","last_change":"2023-08-18T20:43:43.613422+0000","last_active":"2023-08-18T20:43:45.612853+0000","last_peered":"2023-08-18T20:43:45.612853+0000","last_clean":"2023-08-18T20:43:45.612853+0000","last_became_active":"2023-08-18T20:43:43.613191+0000","last_became_peered":"2023-08-18T20:43:43.613191+0000","last_unstale":"2023-08-18T20:43:45.612853+0000","last_undegraded":"2023-08-18T20:43:45.612853+0000","last_fullsized":"2023-08-18T20:43:45.612853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613301+0000","last_change":"2023-08-18T20:43:44.623058+0000","last_active":"2023-08-18T20:43:45.613301+0000","last_peered":"2023-08-18T20:43:45.613301+0000","last_clean":"2023-08-18T20:43:45.613301+0000","last_became_active":"2023-08-18T20:43:44.622774+0000","last_became_peered":"2023-08-18T20:43:44.622774+0000","last_unstale":"2023-08-18T20:43:45.613301+0000","last_undegraded":"2023-08-18T20:43:45.613301+0000","last_fullsized":"2023-08-18T20:43:45.613301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215163+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:43:46.215163+0000","last_peered":"2023-08-18T20:43:46.215163+0000","last_clean":"2023-08-18T20:43:46.215163+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:43:46.215163+0000","last_undegraded":"2023-08-18T20:43:46.215163+0000","last_fullsized":"2023-08-18T20:43:46.215163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617483+0000","last_change":"2023-08-18T20:43:43.610119+0000","last_active":"2023-08-18T20:43:45.617483+0000","last_peered":"2023-08-18T20:43:45.617483+0000","last_clean":"2023-08-18T20:43:45.617483+0000","last_became_active":"2023-08-18T20:43:43.609659+0000","last_became_peered":"2023-08-18T20:43:43.609659+0000","last_unstale":"2023-08-18T20:43:45.617483+0000","last_undegraded":"2023-08-18T20:43:45.617483+0000","last_fullsized":"2023-08-18T20:43:45.617483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:06:20.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618138+0000","last_change":"2023-08-18T20:43:44.617516+0000","last_active":"2023-08-18T20:43:45.618138+0000","last_peered":"2023-08-18T20:43:45.618138+0000","last_clean":"2023-08-18T20:43:45.618138+0000","last_became_active":"2023-08-18T20:43:44.617219+0000","last_became_peered":"2023-08-18T20:43:44.617219+0000","last_unstale":"2023-08-18T20:43:45.618138+0000","last_undegraded":"2023-08-18T20:43:45.618138+0000","last_fullsized":"2023-08-18T20:43:45.618138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215084+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:43:46.215084+0000","last_peered":"2023-08-18T20:43:46.215084+0000","last_clean":"2023-08-18T20:43:46.215084+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:43:46.215084+0000","last_undegraded":"2023-08-18T20:43:46.215084+0000","last_fullsized":"2023-08-18T20:43:46.215084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:48.156778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713952+0000","last_change":"2023-08-18T20:43:43.611453+0000","last_active":"2023-08-18T20:43:45.713952+0000","last_peered":"2023-08-18T20:43:45.713952+0000","last_clean":"2023-08-18T20:43:45.713952+0000","last_became_active":"2023-08-18T20:43:43.611180+0000","last_became_peered":"2023-08-18T20:43:43.611180+0000","last_unstale":"2023-08-18T20:43:45.713952+0000","last_undegraded":"2023-08-18T20:43:45.713952+0000","last_fullsized":"2023-08-18T20:43:45.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613427+0000","last_change":"2023-08-18T20:43:44.615672+0000","last_active":"2023-08-18T20:43:45.613427+0000","last_peered":"2023-08-18T20:43:45.613427+0000","last_clean":"2023-08-18T20:43:45.613427+0000","last_became_active":"2023-08-18T20:43:44.615430+0000","last_became_peered":"2023-08-18T20:43:44.615430+0000","last_unstale":"2023-08-18T20:43:45.613427+0000","last_undegraded":"2023-08-18T20:43:45.613427+0000","last_fullsized":"2023-08-18T20:43:45.613427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618058+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:43:45.618058+0000","last_peered":"2023-08-18T20:43:45.618058+0000","last_clean":"2023-08-18T20:43:45.618058+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:43:45.618058+0000","last_undegraded":"2023-08-18T20:43:45.618058+0000","last_fullsized":"2023-08-18T20:43:45.618058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:36.724764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613478+0000","last_change":"2023-08-18T20:43:43.617151+0000","last_active":"2023-08-18T20:43:45.613478+0000","last_peered":"2023-08-18T20:43:45.613478+0000","last_clean":"2023-08-18T20:43:45.613478+0000","last_became_active":"2023-08-18T20:43:43.616926+0000","last_became_peered":"2023-08-18T20:43:43.616926+0000","last_unstale":"2023-08-18T20:43:45.613478+0000","last_undegraded":"2023-08-18T20:43:45.613478+0000","last_fullsized":"2023-08-18T20:43:45.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214991+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:46.214991+0000","last_peered":"2023-08-18T20:43:46.214991+0000","last_clean":"2023-08-18T20:43:46.214991+0000","last_became_active":"2023-08-18T20:43:44.620156+0000","last_became_peered":"2023-08-18T20:43:44.620156+0000","last_unstale":"2023-08-18T20:43:46.214991+0000","last_undegraded":"2023-08-18T20:43:46.214991+0000","last_fullsized":"2023-08-18T20:43:46.214991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618184+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:43:45.618184+0000","last_peered":"2023-08-18T20:43:45.618184+0000","last_clean":"2023-08-18T20:43:45.618184+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:43:45.618184+0000","last_undegraded":"2023-08-18T20:43:45.618184+0000","last_fullsized":"2023-08-18T20:43:45.618184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:54.431916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215661+0000","last_change":"2023-08-18T20:43:43.608982+0000","last_active":"2023-08-18T20:43:46.215661+0000","last_peered":"2023-08-18T20:43:46.215661+0000","last_clean":"2023-08-18T20:43:46.215661+0000","last_became_active":"2023-08-18T20:43:43.608436+0000","last_became_peered":"2023-08-18T20:43:43.608436+0000","last_unstale":"2023-08-18T20:43:46.215661+0000","last_undegraded":"2023-08-18T20:43:46.215661+0000","last_fullsized":"2023-08-18T20:43:46.215661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:30.816523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613067+0000","last_change":"2023-08-18T20:43:44.622842+0000","last_active":"2023-08-18T20:43:45.613067+0000","last_peered":"2023-08-18T20:43:45.613067+0000","last_clean":"2023-08-18T20:43:45.613067+0000","last_became_active":"2023-08-18T20:43:44.622577+0000","last_became_peered":"2023-08-18T20:43:44.622577+0000","last_unstale":"2023-08-18T20:43:45.613067+0000","last_undegraded":"2023-08-18T20:43:45.613067+0000","last_fullsized":"2023-08-18T20:43:45.613067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214894+0000","last_change":"2023-08-18T20:43:43.613207+0000","last_active":"2023-08-18T20:43:46.214894+0000","last_peered":"2023-08-18T20:43:46.214894+0000","last_clean":"2023-08-18T20:43:46.214894+0000","last_became_active":"2023-08-18T20:43:43.612885+0000","last_became_peered":"2023-08-18T20:43:43.612885+0000","last_unstale":"2023-08-18T20:43:46.214894+0000","last_undegraded":"2023-08-18T20:43:46.214894+0000","last_fullsized":"2023-08-18T20:43:46.214894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:53.197375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214652+0000","last_change":"2023-08-18T20:43:44.617706+0000","last_active":"2023-08-18T20:43:46.214652+0000","last_peered":"2023-08-18T20:43:46.214652+0000","last_clean":"2023-08-18T20:43:46.214652+0000","last_became_active":"2023-08-18T20:43:44.617472+0000","last_became_peered":"2023-08-18T20:43:44.617472+0000","last_unstale":"2023-08-18T20:43:46.214652+0000","last_undegraded":"2023-08-18T20:43:46.214652+0000","last_fullsized":"2023-08-18T20:43:46.214652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:41:55.321112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215476+0000","last_change":"2023-08-18T20:43:43.610453+0000","last_active":"2023-08-18T20:43:46.215476+0000","last_peered":"2023-08-18T20:43:46.215476+0000","last_clean":"2023-08-18T20:43:46.215476+0000","last_became_active":"2023-08-18T20:43:43.609644+0000","last_became_peered":"2023-08-18T20:43:43.609644+0000","last_unstale":"2023-08-18T20:43:46.215476+0000","last_undegraded":"2023-08-18T20:43:46.215476+0000","last_fullsized":"2023-08-18T20:43:46.215476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714226+0000","last_change":"2023-08-18T20:43:44.621321+0000","last_active":"2023-08-18T20:43:45.714226+0000","last_peered":"2023-08-18T20:43:45.714226+0000","last_clean":"2023-08-18T20:43:45.714226+0000","last_became_active":"2023-08-18T20:43:44.621044+0000","last_became_peered":"2023-08-18T20:43:44.621044+0000","last_unstale":"2023-08-18T20:43:45.714226+0000","last_undegraded":"2023-08-18T20:43:45.714226+0000","last_fullsized":"2023-08-18T20:43:45.714226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:35.764016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215710+0000","last_change":"2023-08-18T20:43:43.614525+0000","last_active":"2023-08-18T20:43:46.215710+0000","last_peered":"2023-08-18T20:43:46.215710+0000","last_clean":"2023-08-18T20:43:46.215710+0000","last_became_active":"2023-08-18T20:43:43.614214+0000","last_became_peered":"2023-08-18T20:43:43.614214+0000","last_unstale":"2023-08-18T20:43:46.215710+0000","last_undegraded":"2023-08-18T20:43:46.215710+0000","last_fullsized":"2023-08-18T20:43:46.215710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713962+0000","last_change":"2023-08-18T20:43:44.620995+0000","last_active":"2023-08-18T20:43:45.713962+0000","last_peered":"2023-08-18T20:43:45.713962+0000","last_clean":"2023-08-18T20:43:45.713962+0000","last_became_active":"2023-08-18T20:43:44.620698+0000","last_became_peered":"2023-08-18T20:43:44.620698+0000","last_unstale":"2023-08-18T20:43:45.713962+0000","last_undegraded":"2023-08-18T20:43:45.713962+0000","last_fullsized":"2023-08-18T20:43:45.713962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:19.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617903+0000","last_change":"2023-08-18T20:43:43.599844+0000","last_active":"2023-08-18T20:43:45.617903+0000","last_peered":"2023-08-18T20:43:45.617903+0000","last_clean":"2023-08-18T20:43:45.617903+0000","last_became_active":"2023-08-18T20:43:43.599644+0000","last_became_peered":"2023-08-18T20:43:43.599644+0000","last_unstale":"2023-08-18T20:43:45.617903+0000","last_undegraded":"2023-08-18T20:43:45.617903+0000","last_fullsized":"2023-08-18T20:43:45.617903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:53.036037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617578+0000","last_change":"2023-08-18T20:43:44.613247+0000","last_active":"2023-08-18T20:43:45.617578+0000","last_peered":"2023-08-18T20:43:45.617578+0000","last_clean":"2023-08-18T20:43:45.617578+0000","last_became_active":"2023-08-18T20:43:44.611831+0000","last_became_peered":"2023-08-18T20:43:44.611831+0000","last_unstale":"2023-08-18T20:43:45.617578+0000","last_undegraded":"2023-08-18T20:43:45.617578+0000","last_fullsized":"2023-08-18T20:43:45.617578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215200+0000","last_change":"2023-08-18T20:43:43.611094+0000","last_active":"2023-08-18T20:43:46.215200+0000","last_peered":"2023-08-18T20:43:46.215200+0000","last_clean":"2023-08-18T20:43:46.215200+0000","last_became_active":"2023-08-18T20:43:43.610833+0000","last_became_peered":"2023-08-18T20:43:43.610833+0000","last_unstale":"2023-08-18T20:43:46.215200+0000","last_undegraded":"2023-08-18T20:43:46.215200+0000","last_fullsized":"2023-08-18T20:43:46.215200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:47.260434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713650+0000","last_change":"2023-08-18T20:43:44.613774+0000","last_active":"2023-08-18T20:43:45.713650+0000","last_peered":"2023-08-18T20:43:45.713650+0000","last_clean":"2023-08-18T20:43:45.713650+0000","last_became_active":"2023-08-18T20:43:44.613493+0000","last_became_peered":"2023-08-18T20:43:44.613493+0000","last_unstale":"2023-08-18T20:43:45.713650+0000","last_undegraded":"2023-08-18T20:43:45.713650+0000","last_fullsized":"2023-08-18T20:43:45.713650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617919+0000","last_change":"2023-08-18T20:43:44.612368+0000","last_active":"2023-08-18T20:43:45.617919+0000","last_peered":"2023-08-18T20:43:45.617919+0000","last_clean":"2023-08-18T20:43:45.617919+0000","last_became_active":"2023-08-18T20:43:44.611952+0000","last_became_peered":"2023-08-18T20:43:44.611952+0000","last_unstale":"2023-08-18T20:43:45.617919+0000","last_undegraded":"2023-08-18T20:43:45.617919+0000","last_fullsized":"2023-08-18T20:43:45.617919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:48.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617451+0000","last_change":"2023-08-18T20:43:44.603180+0000","last_active":"2023-08-18T20:43:45.617451+0000","last_peered":"2023-08-18T20:43:45.617451+0000","last_clean":"2023-08-18T20:43:45.617451+0000","last_became_active":"2023-08-18T20:43:44.602914+0000","last_became_peered":"2023-08-18T20:43:44.602914+0000","last_unstale":"2023-08-18T20:43:45.617451+0000","last_undegraded":"2023-08-18T20:43:45.617451+0000","last_fullsized":"2023-08-18T20:43:45.617451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:26:32.716597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713791+0000","last_change":"2023-08-18T20:43:44.617909+0000","last_active":"2023-08-18T20:43:45.713791+0000","last_peered":"2023-08-18T20:43:45.713791+0000","last_clean":"2023-08-18T20:43:45.713791+0000","last_became_active":"2023-08-18T20:43:44.617629+0000","last_became_peered":"2023-08-18T20:43:44.617629+0000","last_unstale":"2023-08-18T20:43:45.713791+0000","last_undegraded":"2023-08-18T20:43:45.713791+0000","last_fullsized":"2023-08-18T20:43:45.713791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.825723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618144+0000","last_change":"2023-08-18T20:43:44.625243+0000","last_active":"2023-08-18T20:43:45.618144+0000","last_peered":"2023-08-18T20:43:45.618144+0000","last_clean":"2023-08-18T20:43:45.618144+0000","last_became_active":"2023-08-18T20:43:44.624028+0000","last_became_peered":"2023-08-18T20:43:44.624028+0000","last_unstale":"2023-08-18T20:43:45.618144+0000","last_undegraded":"2023-08-18T20:43:45.618144+0000","last_fullsized":"2023-08-18T20:43:45.618144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613366+0000","last_change":"2023-08-18T20:43:44.613989+0000","last_active":"2023-08-18T20:43:45.613366+0000","last_peered":"2023-08-18T20:43:45.613366+0000","last_clean":"2023-08-18T20:43:45.613366+0000","last_became_active":"2023-08-18T20:43:44.613732+0000","last_became_peered":"2023-08-18T20:43:44.613732+0000","last_unstale":"2023-08-18T20:43:45.613366+0000","last_undegraded":"2023-08-18T20:43:45.613366+0000","last_fullsized":"2023-08-18T20:43:45.613366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":674442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":672614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":82828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0230000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.260999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":83914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:43:53.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:43:53.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.750+0000 7f13c8063700 1 Processor -- start 2023-08-18T20:43:53.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.750+0000 7f13c8063700 1 -- start start 2023-08-18T20:43:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c006fd30 0x7f13c00c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f13c0152450 0x7f13c00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f13c01559c0 0x7f13c014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c01529a0 con 0x7f13c0152450 2023-08-18T20:43:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c0152c80 con 0x7f13c01559c0 2023-08-18T20:43:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c8063700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0152f60 con 0x7f13c006fd30 2023-08-18T20:43:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f13c0152450 0x7f13c00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f13c0152450 0x7f13c00c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40498/0 (socket says 172.21.15.121:40498) 2023-08-18T20:43:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 -- 172.21.15.121:0/289406127 learned_addr learned my addr 172.21.15.121:0/289406127 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c6600700 1 --2- 172.21.15.121:0/289406127 >> v2:172.21.15.122:3300/0 conn(0x7f13c01559c0 0x7f13c014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c5dff700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c006fd30 0x7f13c00c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 -- 172.21.15.121:0/289406127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c006fd30 msgr2=0x7f13c00c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c006fd30 0x7f13c00c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 -- 172.21.15.121:0/289406127 >> v2:172.21.15.122:3300/0 conn(0x7f13c01559c0 msgr2=0x7f13c014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:53.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 --2- 172.21.15.121:0/289406127 >> v2:172.21.15.122:3300/0 conn(0x7f13c01559c0 0x7f13c014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.751+0000 7f13c55fe700 1 -- 172.21.15.121:0/289406127 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0153240 con 0x7f13c0152450 2023-08-18T20:43:53.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c55fe700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c0152450 0x7f13c00c7270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c00add60 tx=0x7f13b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adfce1d8b2b6cb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c4dfd700 1 -- 172.21.15.121:0/289406127 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000b870 con 0x7f13c0152450 2023-08-18T20:43:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c4dfd700 1 -- 172.21.15.121:0/289406127 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b000b9d0 con 0x7f13c0152450 2023-08-18T20:43:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c4dfd700 1 -- 172.21.15.121:0/289406127 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000bd60 con 0x7f13c0152450 2023-08-18T20:43:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 -- 172.21.15.121:0/289406127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c0152450 msgr2=0x7f13c00c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c0152450 0x7f13c00c7270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c00add60 tx=0x7f13b0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 -- 172.21.15.121:0/289406127 shutdown_connections 2023-08-18T20:43:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 --2- 172.21.15.121:0/289406127 >> v2:172.21.15.122:3300/0 conn(0x7f13c01559c0 0x7f13c014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c006fd30 0x7f13c00c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 --2- 172.21.15.121:0/289406127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c0152450 0x7f13c00c7270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.752+0000 7f13c8063700 1 -- 172.21.15.121:0/289406127 >> 172.21.15.121:0/289406127 conn(0x7f13c00c7bf0 msgr2=0x7f13c00c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.753+0000 7f13c8063700 1 -- 172.21.15.121:0/289406127 shutdown_connections 2023-08-18T20:43:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.753+0000 7f13c8063700 1 -- 172.21.15.121:0/289406127 wait complete. 2023-08-18T20:43:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 Processor -- start 2023-08-18T20:43:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 -- start start 2023-08-18T20:43:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c0152450 0x7f13c014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13c01559c0 0x7f13c014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c014f250 con 0x7f13c006fd30 2023-08-18T20:43:53.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00becc0 con 0x7f13c01559c0 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c8063700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00bdab0 con 0x7f13c0152450 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c5dff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c5dff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40504/0 (socket says 172.21.15.121:40504) 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.754+0000 7f13c5dff700 1 -- 172.21.15.121:0/954069054 learned_addr learned my addr 172.21.15.121:0/954069054 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 -- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c0152450 msgr2=0x7f13c014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c0152450 0x7f13c014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 -- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13c01559c0 msgr2=0x7f13c014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13c01559c0 0x7f13c014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 -- 172.21.15.121:0/954069054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009550 con 0x7f13c006fd30 2023-08-18T20:43:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c5dff700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e810 tx=0x7f13bc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc013610 con 0x7f13c006fd30 2023-08-18T20:43:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc013770 con 0x7f13c006fd30 2023-08-18T20:43:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c00bdd90 con 0x7f13c006fd30 2023-08-18T20:43:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc013b00 con 0x7f13c006fd30 2023-08-18T20:43:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.755+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c00bf1b0 con 0x7f13c006fd30 2023-08-18T20:43:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.756+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c00bf520 con 0x7f13c006fd30 2023-08-18T20:43:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.756+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f13bc013c60 con 0x7f13c006fd30 2023-08-18T20:43:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.757+0000 7f13b67fc700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 0x7f13a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:53.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.757+0000 7f13c55fe700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 0x7f13a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:53.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.757+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13bc088110 con 0x7f13c006fd30 2023-08-18T20:43:53.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.757+0000 7f13c55fe700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 0x7f13a406c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13c00add60 tx=0x7f13b0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:53.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.761+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f13bc053890 con 0x7f13c006fd30 2023-08-18T20:43:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.947+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c00c3580 con 0x7f13a406a0e0 2023-08-18T20:43:53.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.954+0000 7f13b67fc700 1 -- 172.21.15.121:0/954069054 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286880 (secure 0 0 0) 0x7f13b001f070 con 0x7f13a406a0e0 2023-08-18T20:43:53.958 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:53.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 msgr2=0x7f13a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 0x7f13a406c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13c00add60 tx=0x7f13b0010000 comp rx=0 tx=0).stop 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 msgr2=0x7f13c0154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e810 tx=0x7f13bc00ebd0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 shutdown_connections 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13c01559c0 0x7f13c014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f13a406a0e0 0x7f13a406c5a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c006fd30 0x7f13c0154850 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 --2- 172.21.15.121:0/954069054 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13c0152450 0x7f13c014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 >> 172.21.15.121:0/954069054 conn(0x7f13c00c7bf0 msgr2=0x7f13c00c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 shutdown_connections 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:53.958+0000 7f13c8063700 1 -- 172.21.15.121:0/954069054 wait complete. 2023-08-18T20:43:53.962 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:43:53.971 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-18T20:43:52.915383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3055616,"data_stored":1843524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.321349"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215346+0000","last_change":"2023-08-18T20:43:44.613436+0000","last_active":"2023-08-18T20:43:46.215346+0000","last_peered":"2023-08-18T20:43:46.215346+0000","last_clean":"2023-08-18T20:43:46.215346+0000","last_became_active":"2023-08-18T20:43:44.613171+0000","last_became_peered":"2023-08-18T20:43:44.613171+0000","last_unstale":"2023-08-18T20:43:46.215346+0000","last_undegraded":"2023-08-18T20:43:46.215346+0000","last_fullsized":"2023-08-18T20:43:46.215346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:51:41.119353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215643+0000","last_change":"2023-08-18T20:43:44.619506+0000","last_active":"2023-08-18T20:43:46.215643+0000","last_peered":"2023-08-18T20:43:46.215643+0000","last_clean":"2023-08-18T20:43:46.215643+0000","last_became_active":"2023-08-18T20:43:44.619216+0000","last_became_peered":"2023-08-18T20:43:44.619216+0000","last_unstale":"2023-08-18T20:43:46.215643+0000","last_undegraded":"2023-08-18T20:43:46.215643+0000","last_fullsized":"2023-08-18T20:43:46.215643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714146+0000","last_change":"2023-08-18T20:43:44.615835+0000","last_active":"2023-08-18T20:43:45.714146+0000","last_peered":"2023-08-18T20:43:45.714146+0000","last_clean":"2023-08-18T20:43:45.714146+0000","last_became_active":"2023-08-18T20:43:44.615439+0000","last_became_peered":"2023-08-18T20:43:44.615439+0000","last_unstale":"2023-08-18T20:43:45.714146+0000","last_undegraded":"2023-08-18T20:43:45.714146+0000","last_fullsized":"2023-08-18T20:43:45.714146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:18.373624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618189+0000","last_change":"2023-08-18T20:43:44.611672+0000","last_active":"2023-08-18T20:43:45.618189+0000","last_peered":"2023-08-18T20:43:45.618189+0000","last_clean":"2023-08-18T20:43:45.618189+0000","last_became_active":"2023-08-18T20:43:44.611355+0000","last_became_peered":"2023-08-18T20:43:44.611355+0000","last_unstale":"2023-08-18T20:43:45.618189+0000","last_undegraded":"2023-08-18T20:43:45.618189+0000","last_fullsized":"2023-08-18T20:43:45.618189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214898+0000","last_change":"2023-08-18T20:43:44.624219+0000","last_active":"2023-08-18T20:43:46.214898+0000","last_peered":"2023-08-18T20:43:46.214898+0000","last_clean":"2023-08-18T20:43:46.214898+0000","last_became_active":"2023-08-18T20:43:44.623964+0000","last_became_peered":"2023-08-18T20:43:44.623964+0000","last_unstale":"2023-08-18T20:43:46.214898+0000","last_undegraded":"2023-08-18T20:43:46.214898+0000","last_fullsized":"2023-08-18T20:43:46.214898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713758+0000","last_change":"2023-08-18T20:43:44.619846+0000","last_active":"2023-08-18T20:43:45.713758+0000","last_peered":"2023-08-18T20:43:45.713758+0000","last_clean":"2023-08-18T20:43:45.713758+0000","last_became_active":"2023-08-18T20:43:44.619591+0000","last_became_peered":"2023-08-18T20:43:44.619591+0000","last_unstale":"2023-08-18T20:43:45.713758+0000","last_undegraded":"2023-08-18T20:43:45.713758+0000","last_fullsized":"2023-08-18T20:43:45.713758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215228+0000","last_change":"2023-08-18T20:43:44.628859+0000","last_active":"2023-08-18T20:43:46.215228+0000","last_peered":"2023-08-18T20:43:46.215228+0000","last_clean":"2023-08-18T20:43:46.215228+0000","last_became_active":"2023-08-18T20:43:44.628585+0000","last_became_peered":"2023-08-18T20:43:44.628585+0000","last_unstale":"2023-08-18T20:43:46.215228+0000","last_undegraded":"2023-08-18T20:43:46.215228+0000","last_fullsized":"2023-08-18T20:43:46.215228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:11.821010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214860+0000","last_change":"2023-08-18T20:43:44.618307+0000","last_active":"2023-08-18T20:43:46.214860+0000","last_peered":"2023-08-18T20:43:46.214860+0000","last_clean":"2023-08-18T20:43:46.214860+0000","last_became_active":"2023-08-18T20:43:44.617977+0000","last_became_peered":"2023-08-18T20:43:44.617977+0000","last_unstale":"2023-08-18T20:43:46.214860+0000","last_undegraded":"2023-08-18T20:43:46.214860+0000","last_fullsized":"2023-08-18T20:43:46.214860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214817+0000","last_change":"2023-08-18T20:43:44.616362+0000","last_active":"2023-08-18T20:43:46.214817+0000","last_peered":"2023-08-18T20:43:46.214817+0000","last_clean":"2023-08-18T20:43:46.214817+0000","last_became_active":"2023-08-18T20:43:44.615973+0000","last_became_peered":"2023-08-18T20:43:44.615973+0000","last_unstale":"2023-08-18T20:43:46.214817+0000","last_undegraded":"2023-08-18T20:43:46.214817+0000","last_fullsized":"2023-08-18T20:43:46.214817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215511+0000","last_change":"2023-08-18T20:43:44.618993+0000","last_active":"2023-08-18T20:43:46.215511+0000","last_peered":"2023-08-18T20:43:46.215511+0000","last_clean":"2023-08-18T20:43:46.215511+0000","last_became_active":"2023-08-18T20:43:44.618718+0000","last_became_peered":"2023-08-18T20:43:44.618718+0000","last_unstale":"2023-08-18T20:43:46.215511+0000","last_undegraded":"2023-08-18T20:43:46.215511+0000","last_fullsized":"2023-08-18T20:43:46.215511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714250+0000","last_change":"2023-08-18T20:43:44.624641+0000","last_active":"2023-08-18T20:43:45.714250+0000","last_peered":"2023-08-18T20:43:45.714250+0000","last_clean":"2023-08-18T20:43:45.714250+0000","last_became_active":"2023-08-18T20:43:44.624090+0000","last_became_peered":"2023-08-18T20:43:44.624090+0000","last_unstale":"2023-08-18T20:43:45.714250+0000","last_undegraded":"2023-08-18T20:43:45.714250+0000","last_fullsized":"2023-08-18T20:43:45.714250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:21.160909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214357+0000","last_change":"2023-08-18T20:43:44.622302+0000","last_active":"2023-08-18T20:43:46.214357+0000","last_peered":"2023-08-18T20:43:46.214357+0000","last_clean":"2023-08-18T20:43:46.214357+0000","last_became_active":"2023-08-18T20:43:44.622083+0000","last_became_peered":"2023-08-18T20:43:44.622083+0000","last_unstale":"2023-08-18T20:43:46.214357+0000","last_undegraded":"2023-08-18T20:43:46.214357+0000","last_fullsized":"2023-08-18T20:43:46.214357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:42.153363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214384+0000","last_change":"2023-08-18T20:43:44.621350+0000","last_active":"2023-08-18T20:43:46.214384+0000","last_peered":"2023-08-18T20:43:46.214384+0000","last_clean":"2023-08-18T20:43:46.214384+0000","last_became_active":"2023-08-18T20:43:44.620947+0000","last_became_peered":"2023-08-18T20:43:44.620947+0000","last_unstale":"2023-08-18T20:43:46.214384+0000","last_undegraded":"2023-08-18T20:43:46.214384+0000","last_fullsized":"2023-08-18T20:43:46.214384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:20:09.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215117+0000","last_change":"2023-08-18T20:43:44.615387+0000","last_active":"2023-08-18T20:43:46.215117+0000","last_peered":"2023-08-18T20:43:46.215117+0000","last_clean":"2023-08-18T20:43:46.215117+0000","last_became_active":"2023-08-18T20:43:44.615141+0000","last_became_peered":"2023-08-18T20:43:44.615141+0000","last_unstale":"2023-08-18T20:43:46.215117+0000","last_undegraded":"2023-08-18T20:43:46.215117+0000","last_fullsized":"2023-08-18T20:43:46.215117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215422+0000","last_change":"2023-08-18T20:43:44.629068+0000","last_active":"2023-08-18T20:43:46.215422+0000","last_peered":"2023-08-18T20:43:46.215422+0000","last_clean":"2023-08-18T20:43:46.215422+0000","last_became_active":"2023-08-18T20:43:44.628499+0000","last_became_peered":"2023-08-18T20:43:44.628499+0000","last_unstale":"2023-08-18T20:43:46.215422+0000","last_undegraded":"2023-08-18T20:43:46.215422+0000","last_fullsized":"2023-08-18T20:43:46.215422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713784+0000","last_change":"2023-08-18T20:43:44.614503+0000","last_active":"2023-08-18T20:43:45.713784+0000","last_peered":"2023-08-18T20:43:45.713784+0000","last_clean":"2023-08-18T20:43:45.713784+0000","last_became_active":"2023-08-18T20:43:44.614201+0000","last_became_peered":"2023-08-18T20:43:44.614201+0000","last_unstale":"2023-08-18T20:43:45.713784+0000","last_undegraded":"2023-08-18T20:43:45.713784+0000","last_fullsized":"2023-08-18T20:43:45.713784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:20.066232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214970+0000","last_change":"2023-08-18T20:43:44.620433+0000","last_active":"2023-08-18T20:43:46.214970+0000","last_peered":"2023-08-18T20:43:46.214970+0000","last_clean":"2023-08-18T20:43:46.214970+0000","last_became_active":"2023-08-18T20:43:44.620183+0000","last_became_peered":"2023-08-18T20:43:44.620183+0000","last_unstale":"2023-08-18T20:43:46.214970+0000","last_undegraded":"2023-08-18T20:43:46.214970+0000","last_fullsized":"2023-08-18T20:43:46.214970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714292+0000","last_change":"2023-08-18T20:43:44.619040+0000","last_active":"2023-08-18T20:43:45.714292+0000","last_peered":"2023-08-18T20:43:45.714292+0000","last_clean":"2023-08-18T20:43:45.714292+0000","last_became_active":"2023-08-18T20:43:44.618758+0000","last_became_peered":"2023-08-18T20:43:44.618758+0000","last_unstale":"2023-08-18T20:43:45.714292+0000","last_undegraded":"2023-08-18T20:43:45.714292+0000","last_fullsized":"2023-08-18T20:43:45.714292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:40.432183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214657+0000","last_change":"2023-08-18T20:43:44.610425+0000","last_active":"2023-08-18T20:43:46.214657+0000","last_peered":"2023-08-18T20:43:46.214657+0000","last_clean":"2023-08-18T20:43:46.214657+0000","last_became_active":"2023-08-18T20:43:44.610083+0000","last_became_peered":"2023-08-18T20:43:44.610083+0000","last_unstale":"2023-08-18T20:43:46.214657+0000","last_undegraded":"2023-08-18T20:43:46.214657+0000","last_fullsized":"2023-08-18T20:43:46.214657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:13:17.038436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714045+0000","last_change":"2023-08-18T20:43:44.617819+0000","last_active":"2023-08-18T20:43:45.714045+0000","last_peered":"2023-08-18T20:43:45.714045+0000","last_clean":"2023-08-18T20:43:45.714045+0000","last_became_active":"2023-08-18T20:43:44.617544+0000","last_became_peered":"2023-08-18T20:43:44.617544+0000","last_unstale":"2023-08-18T20:43:45.714045+0000","last_undegraded":"2023-08-18T20:43:45.714045+0000","last_fullsized":"2023-08-18T20:43:45.714045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:13.397598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215659+0000","last_change":"2023-08-18T20:43:44.628884+0000","last_active":"2023-08-18T20:43:46.215659+0000","last_peered":"2023-08-18T20:43:46.215659+0000","last_clean":"2023-08-18T20:43:46.215659+0000","last_became_active":"2023-08-18T20:43:44.628405+0000","last_became_peered":"2023-08-18T20:43:44.628405+0000","last_unstale":"2023-08-18T20:43:46.215659+0000","last_undegraded":"2023-08-18T20:43:46.215659+0000","last_fullsized":"2023-08-18T20:43:46.215659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214670+0000","last_change":"2023-08-18T20:43:44.618393+0000","last_active":"2023-08-18T20:43:46.214670+0000","last_peered":"2023-08-18T20:43:46.214670+0000","last_clean":"2023-08-18T20:43:46.214670+0000","last_became_active":"2023-08-18T20:43:44.618136+0000","last_became_peered":"2023-08-18T20:43:44.618136+0000","last_unstale":"2023-08-18T20:43:46.214670+0000","last_undegraded":"2023-08-18T20:43:46.214670+0000","last_fullsized":"2023-08-18T20:43:46.214670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617524+0000","last_change":"2023-08-18T20:43:44.614686+0000","last_active":"2023-08-18T20:43:45.617524+0000","last_peered":"2023-08-18T20:43:45.617524+0000","last_clean":"2023-08-18T20:43:45.617524+0000","last_became_active":"2023-08-18T20:43:44.612205+0000","last_became_peered":"2023-08-18T20:43:44.612205+0000","last_unstale":"2023-08-18T20:43:45.617524+0000","last_undegraded":"2023-08-18T20:43:45.617524+0000","last_fullsized":"2023-08-18T20:43:45.617524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:08:53.982262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214980+0000","last_change":"2023-08-18T20:43:44.629057+0000","last_active":"2023-08-18T20:43:46.214980+0000","last_peered":"2023-08-18T20:43:46.214980+0000","last_clean":"2023-08-18T20:43:46.214980+0000","last_became_active":"2023-08-18T20:43:44.628753+0000","last_became_peered":"2023-08-18T20:43:44.628753+0000","last_unstale":"2023-08-18T20:43:46.214980+0000","last_undegraded":"2023-08-18T20:43:46.214980+0000","last_fullsized":"2023-08-18T20:43:46.214980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613163+0000","last_change":"2023-08-18T20:43:44.622856+0000","last_active":"2023-08-18T20:43:45.613163+0000","last_peered":"2023-08-18T20:43:45.613163+0000","last_clean":"2023-08-18T20:43:45.613163+0000","last_became_active":"2023-08-18T20:43:44.622446+0000","last_became_peered":"2023-08-18T20:43:44.622446+0000","last_unstale":"2023-08-18T20:43:45.613163+0000","last_undegraded":"2023-08-18T20:43:45.613163+0000","last_fullsized":"2023-08-18T20:43:45.613163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613287+0000","last_change":"2023-08-18T20:43:44.614336+0000","last_active":"2023-08-18T20:43:45.613287+0000","last_peered":"2023-08-18T20:43:45.613287+0000","last_clean":"2023-08-18T20:43:45.613287+0000","last_became_active":"2023-08-18T20:43:44.613311+0000","last_became_peered":"2023-08-18T20:43:44.613311+0000","last_unstale":"2023-08-18T20:43:45.613287+0000","last_undegraded":"2023-08-18T20:43:45.613287+0000","last_fullsized":"2023-08-18T20:43:45.613287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:33:00.481712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215500+0000","last_change":"2023-08-18T20:43:44.619472+0000","last_active":"2023-08-18T20:43:46.215500+0000","last_peered":"2023-08-18T20:43:46.215500+0000","last_clean":"2023-08-18T20:43:46.215500+0000","last_became_active":"2023-08-18T20:43:44.619129+0000","last_became_peered":"2023-08-18T20:43:44.619129+0000","last_unstale":"2023-08-18T20:43:46.215500+0000","last_undegraded":"2023-08-18T20:43:46.215500+0000","last_fullsized":"2023-08-18T20:43:46.215500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713985+0000","last_change":"2023-08-18T20:43:43.609894+0000","last_active":"2023-08-18T20:43:45.713985+0000","last_peered":"2023-08-18T20:43:45.713985+0000","last_clean":"2023-08-18T20:43:45.713985+0000","last_became_active":"2023-08-18T20:43:43.609607+0000","last_became_peered":"2023-08-18T20:43:43.609607+0000","last_unstale":"2023-08-18T20:43:45.713985+0000","last_undegraded":"2023-08-18T20:43:45.713985+0000","last_fullsized":"2023-08-18T20:43:45.713985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:01.890051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617654+0000","last_change":"2023-08-18T20:43:44.609769+0000","last_active":"2023-08-18T20:43:45.617654+0000","last_peered":"2023-08-18T20:43:45.617654+0000","last_clean":"2023-08-18T20:43:45.617654+0000","last_became_active":"2023-08-18T20:43:44.609493+0000","last_became_peered":"2023-08-18T20:43:44.609493+0000","last_unstale":"2023-08-18T20:43:45.617654+0000","last_undegraded":"2023-08-18T20:43:45.617654+0000","last_fullsized":"2023-08-18T20:43:45.617654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:16.085957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613008+0000","last_change":"2023-08-18T20:43:43.599440+0000","last_active":"2023-08-18T20:43:45.613008+0000","last_peered":"2023-08-18T20:43:45.613008+0000","last_clean":"2023-08-18T20:43:45.613008+0000","last_became_active":"2023-08-18T20:43:43.599128+0000","last_became_peered":"2023-08-18T20:43:43.599128+0000","last_unstale":"2023-08-18T20:43:45.613008+0000","last_undegraded":"2023-08-18T20:43:45.613008+0000","last_fullsized":"2023-08-18T20:43:45.613008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215208+0000","last_change":"2023-08-18T20:43:44.623290+0000","last_active":"2023-08-18T20:43:46.215208+0000","last_peered":"2023-08-18T20:43:46.215208+0000","last_clean":"2023-08-18T20:43:46.215208+0000","last_became_active":"2023-08-18T20:43:44.623038+0000","last_became_peered":"2023-08-18T20:43:44.623038+0000","last_unstale":"2023-08-18T20:43:46.215208+0000","last_undegraded":"2023-08-18T20:43:46.215208+0000","last_fullsized":"2023-08-18T20:43:46.215208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617757+0000","last_change":"2023-08-18T20:43:43.610873+0000","last_active":"2023-08-18T20:43:45.617757+0000","last_peered":"2023-08-18T20:43:45.617757+0000","last_clean":"2023-08-18T20:43:45.617757+0000","last_became_active":"2023-08-18T20:43:43.610621+0000","last_became_peered":"2023-08-18T20:43:43.610621+0000","last_unstale":"2023-08-18T20:43:45.617757+0000","last_undegraded":"2023-08-18T20:43:45.617757+0000","last_fullsized":"2023-08-18T20:43:45.617757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:20:10.811810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618237+0000","last_change":"2023-08-18T20:43:44.620235+0000","last_active":"2023-08-18T20:43:45.618237+0000","last_peered":"2023-08-18T20:43:45.618237+0000","last_clean":"2023-08-18T20:43:45.618237+0000","last_became_active":"2023-08-18T20:43:44.619362+0000","last_became_peered":"2023-08-18T20:43:44.619362+0000","last_unstale":"2023-08-18T20:43:45.618237+0000","last_undegraded":"2023-08-18T20:43:45.618237+0000","last_fullsized":"2023-08-18T20:43:45.618237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215096+0000","last_change":"2023-08-18T20:43:43.610434+0000","last_active":"2023-08-18T20:43:46.215096+0000","last_peered":"2023-08-18T20:43:46.215096+0000","last_clean":"2023-08-18T20:43:46.215096+0000","last_became_active":"2023-08-18T20:43:43.610177+0000","last_became_peered":"2023-08-18T20:43:43.610177+0000","last_unstale":"2023-08-18T20:43:46.215096+0000","last_undegraded":"2023-08-18T20:43:46.215096+0000","last_fullsized":"2023-08-18T20:43:46.215096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:31:19.057032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618022+0000","last_change":"2023-08-18T20:43:44.600116+0000","last_active":"2023-08-18T20:43:45.618022+0000","last_peered":"2023-08-18T20:43:45.618022+0000","last_clean":"2023-08-18T20:43:45.618022+0000","last_became_active":"2023-08-18T20:43:44.599850+0000","last_became_peered":"2023-08-18T20:43:44.599850+0000","last_unstale":"2023-08-18T20:43:45.618022+0000","last_undegraded":"2023-08-18T20:43:45.618022+0000","last_fullsized":"2023-08-18T20:43:45.618022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:06.146312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215310+0000","last_change":"2023-08-18T20:43:43.610800+0000","last_active":"2023-08-18T20:43:46.215310+0000","last_peered":"2023-08-18T20:43:46.215310+0000","last_clean":"2023-08-18T20:43:46.215310+0000","last_became_active":"2023-08-18T20:43:43.610488+0000","last_became_peered":"2023-08-18T20:43:43.610488+0000","last_unstale":"2023-08-18T20:43:46.215310+0000","last_undegraded":"2023-08-18T20:43:46.215310+0000","last_fullsized":"2023-08-18T20:43:46.215310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:32.789941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617668+0000","last_change":"2023-08-18T20:43:44.616549+0000","last_active":"2023-08-18T20:43:45.617668+0000","last_peered":"2023-08-18T20:43:45.617668+0000","last_clean":"2023-08-18T20:43:45.617668+0000","last_became_active":"2023-08-18T20:43:44.613672+0000","last_became_peered":"2023-08-18T20:43:44.613672+0000","last_unstale":"2023-08-18T20:43:45.617668+0000","last_undegraded":"2023-08-18T20:43:45.617668+0000","last_fullsized":"2023-08-18T20:43:45.617668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:31.959248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215791+0000","last_change":"2023-08-18T20:43:43.614627+0000","last_active":"2023-08-18T20:43:46.215791+0000","last_peered":"2023-08-18T20:43:46.215791+0000","last_clean":"2023-08-18T20:43:46.215791+0000","last_became_active":"2023-08-18T20:43:43.614337+0000","last_became_peered":"2023-08-18T20:43:43.614337+0000","last_unstale":"2023-08-18T20:43:46.215791+0000","last_undegraded":"2023-08-18T20:43:46.215791+0000","last_fullsized":"2023-08-18T20:43:46.215791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:30.384402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613191+0000","last_change":"2023-08-18T20:43:44.617560+0000","last_active":"2023-08-18T20:43:45.613191+0000","last_peered":"2023-08-18T20:43:45.613191+0000","last_clean":"2023-08-18T20:43:45.613191+0000","last_became_active":"2023-08-18T20:43:44.617204+0000","last_became_peered":"2023-08-18T20:43:44.617204+0000","last_unstale":"2023-08-18T20:43:45.613191+0000","last_undegraded":"2023-08-18T20:43:45.613191+0000","last_fullsized":"2023-08-18T20:43:45.613191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714256+0000","last_change":"2023-08-18T20:43:43.612457+0000","last_active":"2023-08-18T20:43:45.714256+0000","last_peered":"2023-08-18T20:43:45.714256+0000","last_clean":"2023-08-18T20:43:45.714256+0000","last_became_active":"2023-08-18T20:43:43.611975+0000","last_became_peered":"2023-08-18T20:43:43.611975+0000","last_unstale":"2023-08-18T20:43:45.714256+0000","last_undegraded":"2023-08-18T20:43:45.714256+0000","last_fullsized":"2023-08-18T20:43:45.714256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:48.357748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.616260+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.615966+0000","last_became_peered":"2023-08-18T20:43:44.615966+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:29.215124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215294+0000","last_change":"2023-08-18T20:43:43.613070+0000","last_active":"2023-08-18T20:43:46.215294+0000","last_peered":"2023-08-18T20:43:46.215294+0000","last_clean":"2023-08-18T20:43:46.215294+0000","last_became_active":"2023-08-18T20:43:43.612736+0000","last_became_peered":"2023-08-18T20:43:43.612736+0000","last_unstale":"2023-08-18T20:43:46.215294+0000","last_undegraded":"2023-08-18T20:43:46.215294+0000","last_fullsized":"2023-08-18T20:43:46.215294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:05.137112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617756+0000","last_change":"2023-08-18T20:43:44.609790+0000","last_active":"2023-08-18T20:43:45.617756+0000","last_peered":"2023-08-18T20:43:45.617756+0000","last_clean":"2023-08-18T20:43:45.617756+0000","last_became_active":"2023-08-18T20:43:44.609536+0000","last_became_peered":"2023-08-18T20:43:44.609536+0000","last_unstale":"2023-08-18T20:43:45.617756+0000","last_undegraded":"2023-08-18T20:43:45.617756+0000","last_fullsized":"2023-08-18T20:43:45.617756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:40.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214802+0000","last_change":"2023-08-18T20:43:43.611373+0000","last_active":"2023-08-18T20:43:46.214802+0000","last_peered":"2023-08-18T20:43:46.214802+0000","last_clean":"2023-08-18T20:43:46.214802+0000","last_became_active":"2023-08-18T20:43:43.611071+0000","last_became_peered":"2023-08-18T20:43:43.611071+0000","last_unstale":"2023-08-18T20:43:46.214802+0000","last_undegraded":"2023-08-18T20:43:46.214802+0000","last_fullsized":"2023-08-18T20:43:46.214802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:58.232785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215579+0000","last_change":"2023-08-18T20:43:44.618343+0000","last_active":"2023-08-18T20:43:46.215579+0000","last_peered":"2023-08-18T20:43:46.215579+0000","last_clean":"2023-08-18T20:43:46.215579+0000","last_became_active":"2023-08-18T20:43:44.618015+0000","last_became_peered":"2023-08-18T20:43:44.618015+0000","last_unstale":"2023-08-18T20:43:46.215579+0000","last_undegraded":"2023-08-18T20:43:46.215579+0000","last_fullsized":"2023-08-18T20:43:46.215579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215130+0000","last_change":"2023-08-18T20:43:43.613459+0000","last_active":"2023-08-18T20:43:46.215130+0000","last_peered":"2023-08-18T20:43:46.215130+0000","last_clean":"2023-08-18T20:43:46.215130+0000","last_became_active":"2023-08-18T20:43:43.613116+0000","last_became_peered":"2023-08-18T20:43:43.613116+0000","last_unstale":"2023-08-18T20:43:46.215130+0000","last_undegraded":"2023-08-18T20:43:46.215130+0000","last_fullsized":"2023-08-18T20:43:46.215130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:15.076757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215008+0000","last_change":"2023-08-18T20:43:44.613785+0000","last_active":"2023-08-18T20:43:46.215008+0000","last_peered":"2023-08-18T20:43:46.215008+0000","last_clean":"2023-08-18T20:43:46.215008+0000","last_became_active":"2023-08-18T20:43:44.612998+0000","last_became_peered":"2023-08-18T20:43:44.612998+0000","last_unstale":"2023-08-18T20:43:46.215008+0000","last_undegraded":"2023-08-18T20:43:46.215008+0000","last_fullsized":"2023-08-18T20:43:46.215008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617840+0000","last_change":"2023-08-18T20:43:43.611887+0000","last_active":"2023-08-18T20:43:45.617840+0000","last_peered":"2023-08-18T20:43:45.617840+0000","last_clean":"2023-08-18T20:43:45.617840+0000","last_became_active":"2023-08-18T20:43:43.611272+0000","last_became_peered":"2023-08-18T20:43:43.611272+0000","last_unstale":"2023-08-18T20:43:45.617840+0000","last_undegraded":"2023-08-18T20:43:45.617840+0000","last_fullsized":"2023-08-18T20:43:45.617840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:22:16.100309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618290+0000","last_change":"2023-08-18T20:43:44.625002+0000","last_active":"2023-08-18T20:43:45.618290+0000","last_peered":"2023-08-18T20:43:45.618290+0000","last_clean":"2023-08-18T20:43:45.618290+0000","last_became_active":"2023-08-18T20:43:44.624280+0000","last_became_peered":"2023-08-18T20:43:44.624280+0000","last_unstale":"2023-08-18T20:43:45.618290+0000","last_undegraded":"2023-08-18T20:43:45.618290+0000","last_fullsized":"2023-08-18T20:43:45.618290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:07.508379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215595+0000","last_change":"2023-08-18T20:43:43.613335+0000","last_active":"2023-08-18T20:43:46.215595+0000","last_peered":"2023-08-18T20:43:46.215595+0000","last_clean":"2023-08-18T20:43:46.215595+0000","last_became_active":"2023-08-18T20:43:43.613099+0000","last_became_peered":"2023-08-18T20:43:43.613099+0000","last_unstale":"2023-08-18T20:43:46.215595+0000","last_undegraded":"2023-08-18T20:43:46.215595+0000","last_fullsized":"2023-08-18T20:43:46.215595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214883+0000","last_change":"2023-08-18T20:43:44.618882+0000","last_active":"2023-08-18T20:43:46.214883+0000","last_peered":"2023-08-18T20:43:46.214883+0000","last_clean":"2023-08-18T20:43:46.214883+0000","last_became_active":"2023-08-18T20:43:44.618569+0000","last_became_peered":"2023-08-18T20:43:44.618569+0000","last_unstale":"2023-08-18T20:43:46.214883+0000","last_undegraded":"2023-08-18T20:43:46.214883+0000","last_fullsized":"2023-08-18T20:43:46.214883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215383+0000","last_change":"2023-08-18T20:43:43.613693+0000","last_active":"2023-08-18T20:43:46.215383+0000","last_peered":"2023-08-18T20:43:46.215383+0000","last_clean":"2023-08-18T20:43:46.215383+0000","last_became_active":"2023-08-18T20:43:43.613209+0000","last_became_peered":"2023-08-18T20:43:43.613209+0000","last_unstale":"2023-08-18T20:43:46.215383+0000","last_undegraded":"2023-08-18T20:43:46.215383+0000","last_fullsized":"2023-08-18T20:43:46.215383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:39.620078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713787+0000","last_change":"2023-08-18T20:43:44.624612+0000","last_active":"2023-08-18T20:43:45.713787+0000","last_peered":"2023-08-18T20:43:45.713787+0000","last_clean":"2023-08-18T20:43:45.713787+0000","last_became_active":"2023-08-18T20:43:44.624178+0000","last_became_peered":"2023-08-18T20:43:44.624178+0000","last_unstale":"2023-08-18T20:43:45.713787+0000","last_undegraded":"2023-08-18T20:43:45.713787+0000","last_fullsized":"2023-08-18T20:43:45.713787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:48.269634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215599+0000","last_change":"2023-08-18T20:43:43.610565+0000","last_active":"2023-08-18T20:43:46.215599+0000","last_peered":"2023-08-18T20:43:46.215599+0000","last_clean":"2023-08-18T20:43:46.215599+0000","last_became_active":"2023-08-18T20:43:43.610257+0000","last_became_peered":"2023-08-18T20:43:43.610257+0000","last_unstale":"2023-08-18T20:43:46.215599+0000","last_undegraded":"2023-08-18T20:43:46.215599+0000","last_fullsized":"2023-08-18T20:43:46.215599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618026+0000","last_change":"2023-08-18T20:43:44.624063+0000","last_active":"2023-08-18T20:43:45.618026+0000","last_peered":"2023-08-18T20:43:45.618026+0000","last_clean":"2023-08-18T20:43:45.618026+0000","last_became_active":"2023-08-18T20:43:44.623724+0000","last_became_peered":"2023-08-18T20:43:44.623724+0000","last_unstale":"2023-08-18T20:43:45.618026+0000","last_undegraded":"2023-08-18T20:43:45.618026+0000","last_fullsized":"2023-08-18T20:43:45.618026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:21.323341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215772+0000","last_change":"2023-08-18T20:43:43.609105+0000","last_active":"2023-08-18T20:43:46.215772+0000","last_peered":"2023-08-18T20:43:46.215772+0000","last_clean":"2023-08-18T20:43:46.215772+0000","last_became_active":"2023-08-18T20:43:43.608685+0000","last_became_peered":"2023-08-18T20:43:43.608685+0000","last_unstale":"2023-08-18T20:43:46.215772+0000","last_undegraded":"2023-08-18T20:43:46.215772+0000","last_fullsized":"2023-08-18T20:43:46.215772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:18.860564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214810+0000","last_change":"2023-08-18T20:43:44.618819+0000","last_active":"2023-08-18T20:43:46.214810+0000","last_peered":"2023-08-18T20:43:46.214810+0000","last_clean":"2023-08-18T20:43:46.214810+0000","last_became_active":"2023-08-18T20:43:44.618612+0000","last_became_peered":"2023-08-18T20:43:44.618612+0000","last_unstale":"2023-08-18T20:43:46.214810+0000","last_undegraded":"2023-08-18T20:43:46.214810+0000","last_fullsized":"2023-08-18T20:43:46.214810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:17:03.172623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618091+0000","last_change":"2023-08-18T20:43:43.612421+0000","last_active":"2023-08-18T20:43:45.618091+0000","last_peered":"2023-08-18T20:43:45.618091+0000","last_clean":"2023-08-18T20:43:45.618091+0000","last_became_active":"2023-08-18T20:43:43.612128+0000","last_became_peered":"2023-08-18T20:43:43.612128+0000","last_unstale":"2023-08-18T20:43:45.618091+0000","last_undegraded":"2023-08-18T20:43:45.618091+0000","last_fullsized":"2023-08-18T20:43:45.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:04:38.702373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714114+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:45.714114+0000","last_peered":"2023-08-18T20:43:45.714114+0000","last_clean":"2023-08-18T20:43:45.714114+0000","last_became_active":"2023-08-18T20:43:44.620147+0000","last_became_peered":"2023-08-18T20:43:44.620147+0000","last_unstale":"2023-08-18T20:43:45.714114+0000","last_undegraded":"2023-08-18T20:43:45.714114+0000","last_fullsized":"2023-08-18T20:43:45.714114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:44.950335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618011+0000","last_change":"2023-08-18T20:43:43.611666+0000","last_active":"2023-08-18T20:43:45.618011+0000","last_peered":"2023-08-18T20:43:45.618011+0000","last_clean":"2023-08-18T20:43:45.618011+0000","last_became_active":"2023-08-18T20:43:43.611286+0000","last_became_peered":"2023-08-18T20:43:43.611286+0000","last_unstale":"2023-08-18T20:43:45.618011+0000","last_undegraded":"2023-08-18T20:43:45.618011+0000","last_fullsized":"2023-08-18T20:43:45.618011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:09.805090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714419+0000","last_change":"2023-08-18T20:43:44.619092+0000","last_active":"2023-08-18T20:43:45.714419+0000","last_peered":"2023-08-18T20:43:45.714419+0000","last_clean":"2023-08-18T20:43:45.714419+0000","last_became_active":"2023-08-18T20:43:44.618797+0000","last_became_peered":"2023-08-18T20:43:44.618797+0000","last_unstale":"2023-08-18T20:43:45.714419+0000","last_undegraded":"2023-08-18T20:43:45.714419+0000","last_fullsized":"2023-08-18T20:43:45.714419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:39:45.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713975+0000","last_change":"2023-08-18T20:43:43.616812+0000","last_active":"2023-08-18T20:43:45.713975+0000","last_peered":"2023-08-18T20:43:45.713975+0000","last_clean":"2023-08-18T20:43:45.713975+0000","last_became_active":"2023-08-18T20:43:43.616539+0000","last_became_peered":"2023-08-18T20:43:43.616539+0000","last_unstale":"2023-08-18T20:43:45.713975+0000","last_undegraded":"2023-08-18T20:43:45.713975+0000","last_fullsized":"2023-08-18T20:43:45.713975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:51.228568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714401+0000","last_change":"2023-08-18T20:43:44.618501+0000","last_active":"2023-08-18T20:43:45.714401+0000","last_peered":"2023-08-18T20:43:45.714401+0000","last_clean":"2023-08-18T20:43:45.714401+0000","last_became_active":"2023-08-18T20:43:44.615330+0000","last_became_peered":"2023-08-18T20:43:44.615330+0000","last_unstale":"2023-08-18T20:43:45.714401+0000","last_undegraded":"2023-08-18T20:43:45.714401+0000","last_fullsized":"2023-08-18T20:43:45.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:45:22.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617352+0000","last_change":"2023-08-18T20:43:43.602148+0000","last_active":"2023-08-18T20:43:45.617352+0000","last_peered":"2023-08-18T20:43:45.617352+0000","last_clean":"2023-08-18T20:43:45.617352+0000","last_became_active":"2023-08-18T20:43:43.601869+0000","last_became_peered":"2023-08-18T20:43:43.601869+0000","last_unstale":"2023-08-18T20:43:45.617352+0000","last_undegraded":"2023-08-18T20:43:45.617352+0000","last_fullsized":"2023-08-18T20:43:45.617352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:37.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613324+0000","last_change":"2023-08-18T20:43:44.626768+0000","last_active":"2023-08-18T20:43:45.613324+0000","last_peered":"2023-08-18T20:43:45.613324+0000","last_clean":"2023-08-18T20:43:45.613324+0000","last_became_active":"2023-08-18T20:43:44.626427+0000","last_became_peered":"2023-08-18T20:43:44.626427+0000","last_unstale":"2023-08-18T20:43:45.613324+0000","last_undegraded":"2023-08-18T20:43:45.613324+0000","last_fullsized":"2023-08-18T20:43:45.613324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:54.206575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618198+0000","last_change":"2023-08-18T20:43:43.611362+0000","last_active":"2023-08-18T20:43:45.618198+0000","last_peered":"2023-08-18T20:43:45.618198+0000","last_clean":"2023-08-18T20:43:45.618198+0000","last_became_active":"2023-08-18T20:43:43.611092+0000","last_became_peered":"2023-08-18T20:43:43.611092+0000","last_unstale":"2023-08-18T20:43:45.618198+0000","last_undegraded":"2023-08-18T20:43:45.618198+0000","last_fullsized":"2023-08-18T20:43:45.618198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:26:07.985957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714288+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:43:45.714288+0000","last_peered":"2023-08-18T20:43:45.714288+0000","last_clean":"2023-08-18T20:43:45.714288+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:43:45.714288+0000","last_undegraded":"2023-08-18T20:43:45.714288+0000","last_fullsized":"2023-08-18T20:43:45.714288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:10:49.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617274+0000","last_change":"2023-08-18T20:43:44.613070+0000","last_active":"2023-08-18T20:43:45.617274+0000","last_peered":"2023-08-18T20:43:45.617274+0000","last_clean":"2023-08-18T20:43:45.617274+0000","last_became_active":"2023-08-18T20:43:44.612463+0000","last_became_peered":"2023-08-18T20:43:44.612463+0000","last_unstale":"2023-08-18T20:43:45.617274+0000","last_undegraded":"2023-08-18T20:43:45.617274+0000","last_fullsized":"2023-08-18T20:43:45.617274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:29:20.211699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617706+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:43:45.617706+0000","last_peered":"2023-08-18T20:43:45.617706+0000","last_clean":"2023-08-18T20:43:45.617706+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:43:45.617706+0000","last_undegraded":"2023-08-18T20:43:45.617706+0000","last_fullsized":"2023-08-18T20:43:45.617706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215325+0000","last_change":"2023-08-18T20:43:43.613950+0000","last_active":"2023-08-18T20:43:46.215325+0000","last_peered":"2023-08-18T20:43:46.215325+0000","last_clean":"2023-08-18T20:43:46.215325+0000","last_became_active":"2023-08-18T20:43:43.613664+0000","last_became_peered":"2023-08-18T20:43:43.613664+0000","last_unstale":"2023-08-18T20:43:46.215325+0000","last_undegraded":"2023-08-18T20:43:46.215325+0000","last_fullsized":"2023-08-18T20:43:46.215325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:30.816523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713790+0000","last_change":"2023-08-18T20:43:44.618793+0000","last_active":"2023-08-18T20:43:45.713790+0000","last_peered":"2023-08-18T20:43:45.713790+0000","last_clean":"2023-08-18T20:43:45.713790+0000","last_became_active":"2023-08-18T20:43:44.618505+0000","last_became_peered":"2023-08-18T20:43:44.618505+0000","last_unstale":"2023-08-18T20:43:45.713790+0000","last_undegraded":"2023-08-18T20:43:45.713790+0000","last_fullsized":"2023-08-18T20:43:45.713790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:23.558572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612813+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:43:45.612813+0000","last_peered":"2023-08-18T20:43:45.612813+0000","last_clean":"2023-08-18T20:43:45.612813+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:43:45.612813+0000","last_undegraded":"2023-08-18T20:43:45.612813+0000","last_fullsized":"2023-08-18T20:43:45.612813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:04.764493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215453+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:43:46.215453+0000","last_peered":"2023-08-18T20:43:46.215453+0000","last_clean":"2023-08-18T20:43:46.215453+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:43:46.215453+0000","last_undegraded":"2023-08-18T20:43:46.215453+0000","last_fullsized":"2023-08-18T20:43:46.215453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:47.995440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214649+0000","last_change":"2023-08-18T20:43:43.613219+0000","last_active":"2023-08-18T20:43:46.214649+0000","last_peered":"2023-08-18T20:43:46.214649+0000","last_clean":"2023-08-18T20:43:46.214649+0000","last_became_active":"2023-08-18T20:43:43.612915+0000","last_became_peered":"2023-08-18T20:43:43.612915+0000","last_unstale":"2023-08-18T20:43:46.214649+0000","last_undegraded":"2023-08-18T20:43:46.214649+0000","last_fullsized":"2023-08-18T20:43:46.214649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:51:20.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215110+0000","last_change":"2023-08-18T20:43:44.617320+0000","last_active":"2023-08-18T20:43:46.215110+0000","last_peered":"2023-08-18T20:43:46.215110+0000","last_clean":"2023-08-18T20:43:46.215110+0000","last_became_active":"2023-08-18T20:43:44.617066+0000","last_became_peered":"2023-08-18T20:43:44.617066+0000","last_unstale":"2023-08-18T20:43:46.215110+0000","last_undegraded":"2023-08-18T20:43:46.215110+0000","last_fullsized":"2023-08-18T20:43:46.215110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:04.286694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215134+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:43:46.215134+0000","last_peered":"2023-08-18T20:43:46.215134+0000","last_clean":"2023-08-18T20:43:46.215134+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:43:46.215134+0000","last_undegraded":"2023-08-18T20:43:46.215134+0000","last_fullsized":"2023-08-18T20:43:46.215134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:19:25.909452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.612853+0000","last_change":"2023-08-18T20:43:43.613422+0000","last_active":"2023-08-18T20:43:45.612853+0000","last_peered":"2023-08-18T20:43:45.612853+0000","last_clean":"2023-08-18T20:43:45.612853+0000","last_became_active":"2023-08-18T20:43:43.613191+0000","last_became_peered":"2023-08-18T20:43:43.613191+0000","last_unstale":"2023-08-18T20:43:45.612853+0000","last_undegraded":"2023-08-18T20:43:45.612853+0000","last_fullsized":"2023-08-18T20:43:45.612853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:47.412867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613301+0000","last_change":"2023-08-18T20:43:44.623058+0000","last_active":"2023-08-18T20:43:45.613301+0000","last_peered":"2023-08-18T20:43:45.613301+0000","last_clean":"2023-08-18T20:43:45.613301+0000","last_became_active":"2023-08-18T20:43:44.622774+0000","last_became_peered":"2023-08-18T20:43:44.622774+0000","last_unstale":"2023-08-18T20:43:45.613301+0000","last_undegraded":"2023-08-18T20:43:45.613301+0000","last_fullsized":"2023-08-18T20:43:45.613301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:53.876897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215163+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:43:46.215163+0000","last_peered":"2023-08-18T20:43:46.215163+0000","last_clean":"2023-08-18T20:43:46.215163+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:43:46.215163+0000","last_undegraded":"2023-08-18T20:43:46.215163+0000","last_fullsized":"2023-08-18T20:43:46.215163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:27:00.138069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617483+0000","last_change":"2023-08-18T20:43:43.610119+0000","last_active":"2023-08-18T20:43:45.617483+0000","last_peered":"2023-08-18T20:43:45.617483+0000","last_clean":"2023-08-18T20:43:45.617483+0000","last_became_active":"2023-08-18T20:43:43.609659+0000","last_became_peered":"2023-08-18T20:43:43.609659+0000","last_unstale":"2023-08-18T20:43:45.617483+0000","last_undegraded":"2023-08-18T20:43:45.617483+0000","last_fullsized":"2023-08-18T20:43:45.617483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:06:20.716429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618138+0000","last_change":"2023-08-18T20:43:44.617516+0000","last_active":"2023-08-18T20:43:45.618138+0000","last_peered":"2023-08-18T20:43:45.618138+0000","last_clean":"2023-08-18T20:43:45.618138+0000","last_became_active":"2023-08-18T20:43:44.617219+0000","last_became_peered":"2023-08-18T20:43:44.617219+0000","last_unstale":"2023-08-18T20:43:45.618138+0000","last_undegraded":"2023-08-18T20:43:45.618138+0000","last_fullsized":"2023-08-18T20:43:45.618138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:00:59.241985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215084+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:43:46.215084+0000","last_peered":"2023-08-18T20:43:46.215084+0000","last_clean":"2023-08-18T20:43:46.215084+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:43:46.215084+0000","last_undegraded":"2023-08-18T20:43:46.215084+0000","last_fullsized":"2023-08-18T20:43:46.215084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:48.156778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713952+0000","last_change":"2023-08-18T20:43:43.611453+0000","last_active":"2023-08-18T20:43:45.713952+0000","last_peered":"2023-08-18T20:43:45.713952+0000","last_clean":"2023-08-18T20:43:45.713952+0000","last_became_active":"2023-08-18T20:43:43.611180+0000","last_became_peered":"2023-08-18T20:43:43.611180+0000","last_unstale":"2023-08-18T20:43:45.713952+0000","last_undegraded":"2023-08-18T20:43:45.713952+0000","last_fullsized":"2023-08-18T20:43:45.713952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613427+0000","last_change":"2023-08-18T20:43:44.615672+0000","last_active":"2023-08-18T20:43:45.613427+0000","last_peered":"2023-08-18T20:43:45.613427+0000","last_clean":"2023-08-18T20:43:45.613427+0000","last_became_active":"2023-08-18T20:43:44.615430+0000","last_became_peered":"2023-08-18T20:43:44.615430+0000","last_unstale":"2023-08-18T20:43:45.613427+0000","last_undegraded":"2023-08-18T20:43:45.613427+0000","last_fullsized":"2023-08-18T20:43:45.613427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618058+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:43:45.618058+0000","last_peered":"2023-08-18T20:43:45.618058+0000","last_clean":"2023-08-18T20:43:45.618058+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:43:45.618058+0000","last_undegraded":"2023-08-18T20:43:45.618058+0000","last_fullsized":"2023-08-18T20:43:45.618058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:36.724764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613478+0000","last_change":"2023-08-18T20:43:43.617151+0000","last_active":"2023-08-18T20:43:45.613478+0000","last_peered":"2023-08-18T20:43:45.613478+0000","last_clean":"2023-08-18T20:43:45.613478+0000","last_became_active":"2023-08-18T20:43:43.616926+0000","last_became_peered":"2023-08-18T20:43:43.616926+0000","last_unstale":"2023-08-18T20:43:45.613478+0000","last_undegraded":"2023-08-18T20:43:45.613478+0000","last_fullsized":"2023-08-18T20:43:45.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214991+0000","last_change":"2023-08-18T20:43:44.620431+0000","last_active":"2023-08-18T20:43:46.214991+0000","last_peered":"2023-08-18T20:43:46.214991+0000","last_clean":"2023-08-18T20:43:46.214991+0000","last_became_active":"2023-08-18T20:43:44.620156+0000","last_became_peered":"2023-08-18T20:43:44.620156+0000","last_unstale":"2023-08-18T20:43:46.214991+0000","last_undegraded":"2023-08-18T20:43:46.214991+0000","last_fullsized":"2023-08-18T20:43:46.214991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:39:33.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618184+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:43:45.618184+0000","last_peered":"2023-08-18T20:43:45.618184+0000","last_clean":"2023-08-18T20:43:45.618184+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:43:45.618184+0000","last_undegraded":"2023-08-18T20:43:45.618184+0000","last_fullsized":"2023-08-18T20:43:45.618184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:54.431916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215661+0000","last_change":"2023-08-18T20:43:43.608982+0000","last_active":"2023-08-18T20:43:46.215661+0000","last_peered":"2023-08-18T20:43:46.215661+0000","last_clean":"2023-08-18T20:43:46.215661+0000","last_became_active":"2023-08-18T20:43:43.608436+0000","last_became_peered":"2023-08-18T20:43:43.608436+0000","last_unstale":"2023-08-18T20:43:46.215661+0000","last_undegraded":"2023-08-18T20:43:46.215661+0000","last_fullsized":"2023-08-18T20:43:46.215661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:30.816523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613067+0000","last_change":"2023-08-18T20:43:44.622842+0000","last_active":"2023-08-18T20:43:45.613067+0000","last_peered":"2023-08-18T20:43:45.613067+0000","last_clean":"2023-08-18T20:43:45.613067+0000","last_became_active":"2023-08-18T20:43:44.622577+0000","last_became_peered":"2023-08-18T20:43:44.622577+0000","last_unstale":"2023-08-18T20:43:45.613067+0000","last_undegraded":"2023-08-18T20:43:45.613067+0000","last_fullsized":"2023-08-18T20:43:45.613067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:44:42.774560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214894+0000","last_change":"2023-08-18T20:43:43.613207+0000","last_active":"2023-08-18T20:43:46.214894+0000","last_peered":"2023-08-18T20:43:46.214894+0000","last_clean":"2023-08-18T20:43:46.214894+0000","last_became_active":"2023-08-18T20:43:43.612885+0000","last_became_peered":"2023-08-18T20:43:43.612885+0000","last_unstale":"2023-08-18T20:43:46.214894+0000","last_undegraded":"2023-08-18T20:43:46.214894+0000","last_fullsized":"2023-08-18T20:43:46.214894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:53.197375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.214652+0000","last_change":"2023-08-18T20:43:44.617706+0000","last_active":"2023-08-18T20:43:46.214652+0000","last_peered":"2023-08-18T20:43:46.214652+0000","last_clean":"2023-08-18T20:43:46.214652+0000","last_became_active":"2023-08-18T20:43:44.617472+0000","last_became_peered":"2023-08-18T20:43:44.617472+0000","last_unstale":"2023-08-18T20:43:46.214652+0000","last_undegraded":"2023-08-18T20:43:46.214652+0000","last_fullsized":"2023-08-18T20:43:46.214652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:41:55.321112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215476+0000","last_change":"2023-08-18T20:43:43.610453+0000","last_active":"2023-08-18T20:43:46.215476+0000","last_peered":"2023-08-18T20:43:46.215476+0000","last_clean":"2023-08-18T20:43:46.215476+0000","last_became_active":"2023-08-18T20:43:43.609644+0000","last_became_peered":"2023-08-18T20:43:43.609644+0000","last_unstale":"2023-08-18T20:43:46.215476+0000","last_undegraded":"2023-08-18T20:43:46.215476+0000","last_fullsized":"2023-08-18T20:43:46.215476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:47.433358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.714226+0000","last_change":"2023-08-18T20:43:44.621321+0000","last_active":"2023-08-18T20:43:45.714226+0000","last_peered":"2023-08-18T20:43:45.714226+0000","last_clean":"2023-08-18T20:43:45.714226+0000","last_became_active":"2023-08-18T20:43:44.621044+0000","last_became_peered":"2023-08-18T20:43:44.621044+0000","last_unstale":"2023-08-18T20:43:45.714226+0000","last_undegraded":"2023-08-18T20:43:45.714226+0000","last_fullsized":"2023-08-18T20:43:45.714226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:35.764016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215710+0000","last_change":"2023-08-18T20:43:43.614525+0000","last_active":"2023-08-18T20:43:46.215710+0000","last_peered":"2023-08-18T20:43:46.215710+0000","last_clean":"2023-08-18T20:43:46.215710+0000","last_became_active":"2023-08-18T20:43:43.614214+0000","last_became_peered":"2023-08-18T20:43:43.614214+0000","last_unstale":"2023-08-18T20:43:46.215710+0000","last_undegraded":"2023-08-18T20:43:46.215710+0000","last_fullsized":"2023-08-18T20:43:46.215710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:12:54.323620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713962+0000","last_change":"2023-08-18T20:43:44.620995+0000","last_active":"2023-08-18T20:43:45.713962+0000","last_peered":"2023-08-18T20:43:45.713962+0000","last_clean":"2023-08-18T20:43:45.713962+0000","last_became_active":"2023-08-18T20:43:44.620698+0000","last_became_peered":"2023-08-18T20:43:44.620698+0000","last_unstale":"2023-08-18T20:43:45.713962+0000","last_undegraded":"2023-08-18T20:43:45.713962+0000","last_fullsized":"2023-08-18T20:43:45.713962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:47:19.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617903+0000","last_change":"2023-08-18T20:43:43.599844+0000","last_active":"2023-08-18T20:43:45.617903+0000","last_peered":"2023-08-18T20:43:45.617903+0000","last_clean":"2023-08-18T20:43:45.617903+0000","last_became_active":"2023-08-18T20:43:43.599644+0000","last_became_peered":"2023-08-18T20:43:43.599644+0000","last_unstale":"2023-08-18T20:43:45.617903+0000","last_undegraded":"2023-08-18T20:43:45.617903+0000","last_fullsized":"2023-08-18T20:43:45.617903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:53.036037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617578+0000","last_change":"2023-08-18T20:43:44.613247+0000","last_active":"2023-08-18T20:43:45.617578+0000","last_peered":"2023-08-18T20:43:45.617578+0000","last_clean":"2023-08-18T20:43:45.617578+0000","last_became_active":"2023-08-18T20:43:44.611831+0000","last_became_peered":"2023-08-18T20:43:44.611831+0000","last_unstale":"2023-08-18T20:43:45.617578+0000","last_undegraded":"2023-08-18T20:43:45.617578+0000","last_fullsized":"2023-08-18T20:43:45.617578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:44:16.444361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:46.215200+0000","last_change":"2023-08-18T20:43:43.611094+0000","last_active":"2023-08-18T20:43:46.215200+0000","last_peered":"2023-08-18T20:43:46.215200+0000","last_clean":"2023-08-18T20:43:46.215200+0000","last_became_active":"2023-08-18T20:43:43.610833+0000","last_became_peered":"2023-08-18T20:43:43.610833+0000","last_unstale":"2023-08-18T20:43:46.215200+0000","last_undegraded":"2023-08-18T20:43:46.215200+0000","last_fullsized":"2023-08-18T20:43:46.215200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:42.577265+0000","last_clean_scrub_stamp":"2023-08-18T20:43:42.577265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:59:47.260434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713650+0000","last_change":"2023-08-18T20:43:44.613774+0000","last_active":"2023-08-18T20:43:45.713650+0000","last_peered":"2023-08-18T20:43:45.713650+0000","last_clean":"2023-08-18T20:43:45.713650+0000","last_became_active":"2023-08-18T20:43:44.613493+0000","last_became_peered":"2023-08-18T20:43:44.613493+0000","last_unstale":"2023-08-18T20:43:45.713650+0000","last_undegraded":"2023-08-18T20:43:45.713650+0000","last_fullsized":"2023-08-18T20:43:45.713650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:48.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617919+0000","last_change":"2023-08-18T20:43:44.612368+0000","last_active":"2023-08-18T20:43:45.617919+0000","last_peered":"2023-08-18T20:43:45.617919+0000","last_clean":"2023-08-18T20:43:45.617919+0000","last_became_active":"2023-08-18T20:43:44.611952+0000","last_became_peered":"2023-08-18T20:43:44.611952+0000","last_unstale":"2023-08-18T20:43:45.617919+0000","last_undegraded":"2023-08-18T20:43:45.617919+0000","last_fullsized":"2023-08-18T20:43:45.617919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:44:48.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.617451+0000","last_change":"2023-08-18T20:43:44.603180+0000","last_active":"2023-08-18T20:43:45.617451+0000","last_peered":"2023-08-18T20:43:45.617451+0000","last_clean":"2023-08-18T20:43:45.617451+0000","last_became_active":"2023-08-18T20:43:44.602914+0000","last_became_peered":"2023-08-18T20:43:44.602914+0000","last_unstale":"2023-08-18T20:43:45.617451+0000","last_undegraded":"2023-08-18T20:43:45.617451+0000","last_fullsized":"2023-08-18T20:43:45.617451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:26:32.716597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.713791+0000","last_change":"2023-08-18T20:43:44.617909+0000","last_active":"2023-08-18T20:43:45.713791+0000","last_peered":"2023-08-18T20:43:45.713791+0000","last_clean":"2023-08-18T20:43:45.713791+0000","last_became_active":"2023-08-18T20:43:44.617629+0000","last_became_peered":"2023-08-18T20:43:44.617629+0000","last_unstale":"2023-08-18T20:43:45.713791+0000","last_undegraded":"2023-08-18T20:43:45.713791+0000","last_fullsized":"2023-08-18T20:43:45.713791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.825723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.618144+0000","last_change":"2023-08-18T20:43:44.625243+0000","last_active":"2023-08-18T20:43:45.618144+0000","last_peered":"2023-08-18T20:43:45.618144+0000","last_clean":"2023-08-18T20:43:45.618144+0000","last_became_active":"2023-08-18T20:43:44.624028+0000","last_became_peered":"2023-08-18T20:43:44.624028+0000","last_unstale":"2023-08-18T20:43:45.618144+0000","last_undegraded":"2023-08-18T20:43:45.618144+0000","last_fullsized":"2023-08-18T20:43:45.618144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:47.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-18T20:43:45.613366+0000","last_change":"2023-08-18T20:43:44.613989+0000","last_active":"2023-08-18T20:43:45.613366+0000","last_peered":"2023-08-18T20:43:45.613366+0000","last_clean":"2023-08-18T20:43:45.613366+0000","last_became_active":"2023-08-18T20:43:44.613732+0000","last_became_peered":"2023-08-18T20:43:44.613732+0000","last_unstale":"2023-08-18T20:43:45.613366+0000","last_undegraded":"2023-08-18T20:43:45.613366+0000","last_fullsized":"2023-08-18T20:43:45.613366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:43.586465+0000","last_clean_scrub_stamp":"2023-08-18T20:43:43.586465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:23:28.993537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":674442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":672614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":82828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":82246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0230000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.260999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":83914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:43:53.977 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-18T20:43:53.978 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-18T20:43:53.978 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-18T20:43:53.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-18T20:43:54.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.131+0000 7fc222186700 1 Processor -- start 2023-08-18T20:43:54.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.131+0000 7fc222186700 1 -- start start 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc222186700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc21c06a2a0 0x7fc21c154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc222186700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c157a40 0x7fc21c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc222186700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c155440 con 0x7fc21c0c4ef0 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc222186700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0c4aa0 con 0x7fc21c06a2a0 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc222186700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c157f40 con 0x7fc21c157a40 2023-08-18T20:43:54.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc21c06a2a0 0x7fc21c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc21c06a2a0 0x7fc21c154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40512/0 (socket says 172.21.15.121:40512) 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 -- 172.21.15.121:0/204502347 learned_addr learned my addr 172.21.15.121:0/204502347 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21affd700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c157a40 0x7fc21c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 -- 172.21.15.121:0/204502347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c157a40 msgr2=0x7fc21c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c157a40 0x7fc21c06a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 -- 172.21.15.121:0/204502347 >> v1:172.21.15.122:6789/0 conn(0x7fc21c0c4ef0 legacy=0x7fc21c0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 -- 172.21.15.121:0/204502347 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c158220 con 0x7fc21c06a2a0 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c06a2a0 0x7fc21c154400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098f0 tx=0x7fc210009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a85ba8eb95105d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.132+0000 7fc21a7fc700 1 -- 172.21.15.121:0/204502347 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210004230 con 0x7fc21c06a2a0 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc21a7fc700 1 -- 172.21.15.121:0/204502347 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc210004390 con 0x7fc21c06a2a0 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc21a7fc700 1 -- 172.21.15.121:0/204502347 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100036a0 con 0x7fc21c06a2a0 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 -- 172.21.15.121:0/204502347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c06a2a0 msgr2=0x7fc21c154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c06a2a0 0x7fc21c154400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098f0 tx=0x7fc210009c00 comp rx=0 tx=0).stop 2023-08-18T20:43:54.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 -- 172.21.15.121:0/204502347 shutdown_connections 2023-08-18T20:43:54.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c06a2a0 0x7fc21c154400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 --2- 172.21.15.121:0/204502347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c157a40 0x7fc21c06a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 -- 172.21.15.121:0/204502347 >> 172.21.15.121:0/204502347 conn(0x7fc21c0a8790 msgr2=0x7fc21c0a8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:54.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 -- 172.21.15.121:0/204502347 shutdown_connections 2023-08-18T20:43:54.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.133+0000 7fc222186700 1 -- 172.21.15.121:0/204502347 wait complete. 2023-08-18T20:43:54.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.134+0000 7fc222186700 1 Processor -- start 2023-08-18T20:43:54.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.134+0000 7fc222186700 1 -- start start 2023-08-18T20:43:54.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 0x7fc21c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 0x7fc21c1e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1ea460 con 0x7fc21c157a40 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0abed0 con 0x7fc21c06a2a0 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc222186700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ac1b0 con 0x7fc21c0c4ef0 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40522/0 (socket says 172.21.15.121:40522) 2023-08-18T20:43:54.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc21bfff700 1 -- 172.21.15.121:0/13260987 learned_addr learned my addr 172.21.15.121:0/13260987 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.135+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 0x7fc21c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 -- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 msgr2=0x7fc21c1e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21affd700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 0x7fc21c1e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 0x7fc21c1e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 -- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 msgr2=0x7fc21c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 0x7fc21c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 -- 172.21.15.121:0/13260987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009550 con 0x7fc21c157a40 2023-08-18T20:43:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 0x7fc21c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21affd700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 0x7fc21c1e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc21bfff700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc21400cb60 tx=0x7fc21400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400ab10 con 0x7fc21c157a40 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400ac70 con 0x7fc21c157a40 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214012420 con 0x7fc21c157a40 2023-08-18T20:43:54.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0ac490 con 0x7fc21c157a40 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.136+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c153ac0 con 0x7fc21c157a40 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.137+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c074730 con 0x7fc21c157a40 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.137+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc214012580 con 0x7fc21c157a40 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.137+0000 7fc203fff700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.138+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.138+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc214088800 con 0x7fc21c157a40 2023-08-18T20:43:54.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.138+0000 7fc21b7fe700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 0x7fc20806c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc210009c40 tx=0x7fc210008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.142+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc214053f80 con 0x7fc21c157a40 2023-08-18T20:43:54.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.374+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc21c0c6840 con 0x7fc21c157a40 2023-08-18T20:43:54.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.374+0000 7fc203fff700 1 -- 172.21.15.121:0/13260987 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc2140575a0 con 0x7fc21c157a40 2023-08-18T20:43:54.375 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:54.376 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-18T20:43:54.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 msgr2=0x7fc20806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 0x7fc20806c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc210009c40 tx=0x7fc210008030 comp rx=0 tx=0).stop 2023-08-18T20:43:54.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 msgr2=0x7fc21c1e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc21400cb60 tx=0x7fc21400cf20 comp rx=0 tx=0).stop 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 shutdown_connections 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc20806a0e0 0x7fc20806c5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc21c157a40 0x7fc21c1e9f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c06a2a0 0x7fc21c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 --2- 172.21.15.121:0/13260987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc21c0c4ef0 0x7fc21c1e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.376+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 >> 172.21.15.121:0/13260987 conn(0x7fc21c0a8790 msgr2=0x7fc21c0bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:54.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.377+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 shutdown_connections 2023-08-18T20:43:54.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.377+0000 7fc222186700 1 -- 172.21.15.121:0/13260987 wait complete. 2023-08-18T20:43:54.389 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-18T20:43:54.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:54.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.509+0000 7fb6587fe700 1 Processor -- start 2023-08-18T20:43:54.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.509+0000 7fb6587fe700 1 -- start start 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb6587fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb65014e950 0x7fb6500c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb6587fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb6500c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb6587fe700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6500c2260 con 0x7fb6500c19d0 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb6587fe700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500a6630 con 0x7fb65014e950 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb6587fe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb650151d90 con 0x7fb65014ed30 2023-08-18T20:43:54.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb656d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb6500c19d0 0x7fb6500c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47112/0 (socket says 172.21.15.121:47112) 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb656d9b700 1 -- 172.21.15.121:0/1831596413 learned_addr learned my addr 172.21.15.121:0/1831596413 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb65659a700 1 --2- 172.21.15.121:0/1831596413 >> v2:172.21.15.122:3300/0 conn(0x7fb65014e950 0x7fb6500c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb655d99700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb6500c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072472088 0 0) 0x7fb6500c2260 con 0x7fb6500c19d0 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.510+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c0035b0 con 0x7fb6500c19d0 2023-08-18T20:43:54.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586741217 0 0) 0x7fb63c0035b0 con 0x7fb6500c19d0 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 msgr2=0x7fb6500c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb6500c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 >> v2:172.21.15.122:3300/0 conn(0x7fb65014e950 msgr2=0x7fb6500c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 --2- 172.21.15.121:0/1831596413 >> v2:172.21.15.122:3300/0 conn(0x7fb65014e950 0x7fb6500c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650152070 con 0x7fb6500c19d0 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fb6480019f0 con 0x7fb6500c19d0 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 >> v1:172.21.15.121:6789/0 conn(0x7fb6500c19d0 legacy=0x7fb6500c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb63c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb63c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb63c004d90 0x7fb63c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500a6630 con 0x7fb63c003ff0 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650151d90 con 0x7fb63c004d90 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c00bac0 con 0x7fb65014ed30 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb63c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb65659a700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb63c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb656d9b700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb63c004d90 0x7fb63c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 -- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 msgr2=0x7fb63c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb65014ed30 0x7fb63c003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 -- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb63c004d90 msgr2=0x7fb63c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb63c004d90 0x7fb63c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 -- 172.21.15.121:0/1831596413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0035b0 con 0x7fb63c003ff0 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655d99700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb63c004850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009b30 tx=0x7fb63c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a481fede1417f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00e6c0 con 0x7fb63c003ff0 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00e820 con 0x7fb63c003ff0 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.511+0000 7fb655598700 1 -- 172.21.15.121:0/1831596413 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00eb90 con 0x7fb63c003ff0 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 -- 172.21.15.121:0/1831596413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 msgr2=0x7fb63c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 --2- 172.21.15.121:0/1831596413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb63c004850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009b30 tx=0x7fb63c005880 comp rx=0 tx=0).stop 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb656d9b700 1 -- 172.21.15.121:0/1831596413 reap_dead start 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 -- 172.21.15.121:0/1831596413 shutdown_connections 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 -- 172.21.15.121:0/1831596413 >> 172.21.15.121:0/1831596413 conn(0x7fb6500c6b10 msgr2=0x7fb6500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 -- 172.21.15.121:0/1831596413 shutdown_connections 2023-08-18T20:43:54.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.512+0000 7fb6587fe700 1 -- 172.21.15.121:0/1831596413 wait complete. 2023-08-18T20:43:54.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.513+0000 7fb6587fe700 1 Processor -- start 2023-08-18T20:43:54.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.513+0000 7fb6587fe700 1 -- start start 2023-08-18T20:43:54.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6500c37d0 0x7fb65014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65014bf60 0x7fb6500abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650149ca0 con 0x7fb63c003ff0 2023-08-18T20:43:54.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650149ef0 con 0x7fb65014bf60 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65014ac60 con 0x7fb6500c37d0 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40538/0 (socket says 172.21.15.121:40538) 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 -- 172.21.15.121:0/2620099540 learned_addr learned my addr 172.21.15.121:0/2620099540 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb656d9b700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65014bf60 0x7fb6500abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb655d99700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6500c37d0 0x7fb65014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 -- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6500c37d0 msgr2=0x7fb65014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6500c37d0 0x7fb65014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 -- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65014bf60 msgr2=0x7fb6500abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65014bf60 0x7fb6500abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 -- 172.21.15.121:0/2620099540 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65014af40 con 0x7fb63c003ff0 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb65659a700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb640011aa0 tx=0x7fb640011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000f940 con 0x7fb63c003ff0 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000faa0 con 0x7fb63c003ff0 2023-08-18T20:43:54.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65014b220 con 0x7fb63c003ff0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000fe50 con 0x7fb63c003ff0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.514+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6500c3c50 con 0x7fb63c003ff0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.515+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65014b740 con 0x7fb63c003ff0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.516+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb640014440 con 0x7fb63c003ff0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.516+0000 7fb646ffd700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.516+0000 7fb655d99700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.516+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb640088bf0 con 0x7fb63c003ff0 2023-08-18T20:43:54.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.517+0000 7fb655d99700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 0x7fb63406c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0090b0 tx=0x7fb64c01f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.521+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb65014b740 con 0x7fb63c003ff0 2023-08-18T20:43:54.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.714+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65014b740 con 0x7fb63c003ff0 2023-08-18T20:43:54.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.715+0000 7fb646ffd700 1 -- 172.21.15.121:0/2620099540 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fb65014b740 con 0x7fb63c003ff0 2023-08-18T20:43:54.716 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:54.717 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:54.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 msgr2=0x7fb63406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 0x7fb63406c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0090b0 tx=0x7fb64c01f040 comp rx=0 tx=0).stop 2023-08-18T20:43:54.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 msgr2=0x7fb65014d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb640011aa0 tx=0x7fb640011db0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 shutdown_connections 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65014bf60 0x7fb6500abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63c003ff0 0x7fb65014d430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 --2- 172.21.15.121:0/2620099540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6500c37d0 0x7fb65014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 >> 172.21.15.121:0/2620099540 conn(0x7fb6500c6b10 msgr2=0x7fb65014e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 shutdown_connections 2023-08-18T20:43:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.717+0000 7fb6587fe700 1 -- 172.21.15.121:0/2620099540 wait complete. 2023-08-18T20:43:54.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:43:54.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:43:54.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.852+0000 7f7928359700 1 Processor -- start 2023-08-18T20:43:54.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.852+0000 7f7928359700 1 -- start start 2023-08-18T20:43:54.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f7928359700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7920070950 0x7f79200c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f7928359700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79200c2260 con 0x7f792014e950 2023-08-18T20:43:54.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f7928359700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7920151d90 con 0x7f792014ed30 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f7928359700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79200a6630 con 0x7f7920070950 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f79260f5700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f792014e950 0x7f79200c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47128/0 (socket says 172.21.15.121:47128) 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f79260f5700 1 -- 172.21.15.121:0/1621375461 learned_addr learned my addr 172.21.15.121:0/1621375461 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f79268f6700 1 --2- 172.21.15.121:0/1621375461 >> v2:172.21.15.122:3300/0 conn(0x7f7920070950 0x7f79200c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784707285 0 0) 0x7f79200c2260 con 0x7f792014e950 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.853+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c0035b0 con 0x7f792014e950 2023-08-18T20:43:54.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79268f6700 1 -- 172.21.15.121:0/1621375461 >> v1:172.21.15.122:6789/0 conn(0x7f792014ed30 legacy=0x7f79200c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79268f6700 1 -- 172.21.15.121:0/1621375461 >> v1:172.21.15.121:6789/0 conn(0x7f792014e950 legacy=0x7f79200c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1211802055 0 0) 0x7f790c0035b0 con 0x7f792014e950 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79268f6700 1 -- 172.21.15.121:0/1621375461 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920152070 con 0x7f7920070950 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79268f6700 1 --2- 172.21.15.121:0/1621375461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200c2ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7918009d90 tx=0x7f791800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46db26e1a03ff0f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800e070 con 0x7f7920070950 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7918003a20 con 0x7f7920070950 2023-08-18T20:43:54.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.854+0000 7f79250f3700 1 -- 172.21.15.121:0/1621375461 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c001670 con 0x7f7920070950 2023-08-18T20:43:54.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 -- 172.21.15.121:0/1621375461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 msgr2=0x7f79200c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 --2- 172.21.15.121:0/1621375461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200c2ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7918009d90 tx=0x7f791800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:54.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 -- 172.21.15.121:0/1621375461 shutdown_connections 2023-08-18T20:43:54.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 --2- 172.21.15.121:0/1621375461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200c2ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 -- 172.21.15.121:0/1621375461 >> 172.21.15.121:0/1621375461 conn(0x7f79200c6b10 msgr2=0x7f79200c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:54.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 -- 172.21.15.121:0/1621375461 shutdown_connections 2023-08-18T20:43:54.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.855+0000 7f7928359700 1 -- 172.21.15.121:0/1621375461 wait complete. 2023-08-18T20:43:54.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.856+0000 7f7928359700 1 Processor -- start 2023-08-18T20:43:54.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.856+0000 7f7928359700 1 -- start start 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f792014e950 0x7f79200a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200aa990 con 0x7f792014ed30 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200aa060 con 0x7f7920070950 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f7928359700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200aa340 con 0x7f792014e950 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40556/0 (socket says 172.21.15.121:40556) 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 -- 172.21.15.121:0/588293909 learned_addr learned my addr 172.21.15.121:0/588293909 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79260f5700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79258f4700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f792014e950 0x7f79200a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 -- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f792014e950 msgr2=0x7f79200a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f792014e950 0x7f79200a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 -- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 msgr2=0x7f79200ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.857+0000 7f79268f6700 1 -- 172.21.15.121:0/588293909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009a70 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f79268f6700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79200c4690 tx=0x7f7918004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791801f070 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180043c0 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200aa620 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918004730 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.858+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200aba10 con 0x7f792014ed30 2023-08-18T20:43:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.859+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200aab00 con 0x7f792014ed30 2023-08-18T20:43:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.859+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7918019470 con 0x7f792014ed30 2023-08-18T20:43:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.859+0000 7f7916ffd700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 0x7f790406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.860+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f791808b560 con 0x7f792014ed30 2023-08-18T20:43:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.860+0000 7f79260f5700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 0x7f790406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.860+0000 7f79260f5700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 0x7f790406c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f791c0011e0 tx=0x7f791c001550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:54.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:54.869+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f791805a770 con 0x7f792014ed30 2023-08-18T20:43:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.059+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7920074730 con 0x7f792014ed30 2023-08-18T20:43:55.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.059+0000 7f7916ffd700 1 -- 172.21.15.121:0/588293909 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f791805a300 con 0x7f792014ed30 2023-08-18T20:43:55.060 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:43:55.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 msgr2=0x7f790406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 0x7f790406c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f791c0011e0 tx=0x7f791c001550 comp rx=0 tx=0).stop 2023-08-18T20:43:55.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 msgr2=0x7f79200a7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79200c4690 tx=0x7f7918004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 shutdown_connections 2023-08-18T20:43:55.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f790406a0e0 0x7f790406c5a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f792014ed30 0x7f79200a7370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7920070950 0x7f79200ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 --2- 172.21.15.121:0/588293909 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f792014e950 0x7f79200a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 >> 172.21.15.121:0/588293909 conn(0x7f79200c6b10 msgr2=0x7f792014dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 shutdown_connections 2023-08-18T20:43:55.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.061+0000 7f7928359700 1 -- 172.21.15.121:0/588293909 wait complete. 2023-08-18T20:43:55.073 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:43:55.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.195+0000 7f480a8ca700 1 Processor -- start 2023-08-18T20:43:55.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.195+0000 7f480a8ca700 1 -- start start 2023-08-18T20:43:55.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f48041518e0 0x7f4804066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48040c1030 0x7f480406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f480406b7f0 0x7f48040bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480406cc30 con 0x7f48041518e0 2023-08-18T20:43:55.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040c0b80 con 0x7f480406b7f0 2023-08-18T20:43:55.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f480a8ca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4804155260 con 0x7f48040c1030 2023-08-18T20:43:55.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f48041518e0 0x7f4804066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f48041518e0 0x7f4804066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40560/0 (socket says 172.21.15.121:40560) 2023-08-18T20:43:55.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 -- 172.21.15.121:0/3260200362 learned_addr learned my addr 172.21.15.121:0/3260200362 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:55.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4808e67700 1 --2- 172.21.15.121:0/3260200362 >> v2:172.21.15.122:3300/0 conn(0x7f480406b7f0 0x7f48040bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f48037fe700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48040c1030 0x7f480406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 -- 172.21.15.121:0/3260200362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48040c1030 msgr2=0x7f480406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:55.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48040c1030 0x7f480406b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 -- 172.21.15.121:0/3260200362 >> v2:172.21.15.122:3300/0 conn(0x7f480406b7f0 msgr2=0x7f48040bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:55.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 --2- 172.21.15.121:0/3260200362 >> v2:172.21.15.122:3300/0 conn(0x7f480406b7f0 0x7f48040bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.196+0000 7f4803fff700 1 -- 172.21.15.121:0/3260200362 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480406ce80 con 0x7f48041518e0 2023-08-18T20:43:55.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f4803fff700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041518e0 0x7f4804066340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4804072820 tx=0x7f47f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a543f4878bd2396 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f4802ffd700 1 -- 172.21.15.121:0/3260200362 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f800b870 con 0x7f48041518e0 2023-08-18T20:43:55.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f4802ffd700 1 -- 172.21.15.121:0/3260200362 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f800b9d0 con 0x7f48041518e0 2023-08-18T20:43:55.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f4802ffd700 1 -- 172.21.15.121:0/3260200362 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f800bd60 con 0x7f48041518e0 2023-08-18T20:43:55.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 -- 172.21.15.121:0/3260200362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041518e0 msgr2=0x7f4804066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041518e0 0x7f4804066340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4804072820 tx=0x7f47f8009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 -- 172.21.15.121:0/3260200362 shutdown_connections 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 --2- 172.21.15.121:0/3260200362 >> v2:172.21.15.122:3300/0 conn(0x7f480406b7f0 0x7f48040bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041518e0 0x7f4804066340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 --2- 172.21.15.121:0/3260200362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48040c1030 0x7f480406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 -- 172.21.15.121:0/3260200362 >> 172.21.15.121:0/3260200362 conn(0x7f48040c2ca0 msgr2=0x7f48040c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 -- 172.21.15.121:0/3260200362 shutdown_connections 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.197+0000 7f480a8ca700 1 -- 172.21.15.121:0/3260200362 wait complete. 2023-08-18T20:43:55.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.198+0000 7f480a8ca700 1 Processor -- start 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 -- start start 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 0x7f48040c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 0x7f4804157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041ea940 con 0x7f48040c1030 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804155940 con 0x7f480406b7f0 2023-08-18T20:43:55.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f480a8ca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4804155c20 con 0x7f48041518e0 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f48037fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f48037fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40568/0 (socket says 172.21.15.121:40568) 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f48037fe700 1 -- 172.21.15.121:0/2943984157 learned_addr learned my addr 172.21.15.121:0/2943984157 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.199+0000 7f4803fff700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 0x7f48040c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4808e67700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 0x7f4804157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 -- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 msgr2=0x7f4804157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 0x7f4804157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 -- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 msgr2=0x7f48040c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 0x7f48040c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 -- 172.21.15.121:0/2943984157 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009550 con 0x7f48040c1030 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4803fff700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 0x7f48040c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4808e67700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 0x7f4804157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f48037fe700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e730 tx=0x7f47f400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4013610 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4013770 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4013b20 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48041ea380 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.200+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48040c5e40 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.201+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48040aa430 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.201+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47f4013c80 con 0x7f48040c1030 2023-08-18T20:43:55.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.202+0000 7f4800ff9700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.202+0000 7f4803fff700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.202+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47f4087e20 con 0x7f48040c1030 2023-08-18T20:43:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.202+0000 7f4803fff700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 0x7f47f006c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47f8014040 tx=0x7f47f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.206+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f47f4057030 con 0x7f48040c1030 2023-08-18T20:43:55.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.392+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f480406e460 con 0x7f48040c1030 2023-08-18T20:43:55.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.392+0000 7f4800ff9700 1 -- 172.21.15.121:0/2943984157 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47f40210a0 con 0x7f48040c1030 2023-08-18T20:43:55.394 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:43:55.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 msgr2=0x7f47f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 0x7f47f006c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47f8014040 tx=0x7f47f8008030 comp rx=0 tx=0).stop 2023-08-18T20:43:55.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 msgr2=0x7f4804157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e730 tx=0x7f47f400eaf0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 shutdown_connections 2023-08-18T20:43:55.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48041518e0 0x7f4804157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f480406b7f0 0x7f48040c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 --2- 172.21.15.121:0/2943984157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48040c1030 0x7f4804157600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 >> 172.21.15.121:0/2943984157 conn(0x7f48040c2ca0 msgr2=0x7f4804154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 shutdown_connections 2023-08-18T20:43:55.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.395+0000 7f480a8ca700 1 -- 172.21.15.121:0/2943984157 wait complete. 2023-08-18T20:43:55.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:43:55.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.529+0000 7f62cea2f700 1 Processor -- start 2023-08-18T20:43:55.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.529+0000 7f62cea2f700 1 -- start start 2023-08-18T20:43:55.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62cea2f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c80c1cf0 0x7f62c80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62cea2f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f62c8157c10 0x7f62c81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62cea2f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80c21f0 con 0x7f62c806a510 2023-08-18T20:43:55.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62cea2f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c80c2ba0 con 0x7f62c8157c10 2023-08-18T20:43:55.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62cea2f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c6300 con 0x7f62c80c1cf0 2023-08-18T20:43:55.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f62c8157c10 0x7f62c81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f62c8157c10 0x7f62c81580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40578/0 (socket says 172.21.15.121:40578) 2023-08-18T20:43:55.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 -- 172.21.15.121:0/4022590916 learned_addr learned my addr 172.21.15.121:0/4022590916 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:55.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62c77fe700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c80c1cf0 0x7f62c80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 -- 172.21.15.121:0/4022590916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c80c1cf0 msgr2=0x7f62c80c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:55.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c80c1cf0 0x7f62c80c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 -- 172.21.15.121:0/4022590916 >> v1:172.21.15.122:6789/0 conn(0x7f62c806a510 legacy=0x7f62c8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:55.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 -- 172.21.15.121:0/4022590916 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80c5b20 con 0x7f62c8157c10 2023-08-18T20:43:55.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62ccfcc700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c81580a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e50 tx=0x7f62c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f57d81942fb4ebd server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62c6ffd700 1 -- 172.21.15.121:0/4022590916 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000e070 con 0x7f62c8157c10 2023-08-18T20:43:55.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62c6ffd700 1 -- 172.21.15.121:0/4022590916 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000b9c0 con 0x7f62c8157c10 2023-08-18T20:43:55.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.530+0000 7f62c6ffd700 1 -- 172.21.15.121:0/4022590916 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000bd70 con 0x7f62c8157c10 2023-08-18T20:43:55.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 -- 172.21.15.121:0/4022590916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 msgr2=0x7f62c81580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c81580a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e50 tx=0x7f62c000b330 comp rx=0 tx=0).stop 2023-08-18T20:43:55.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 -- 172.21.15.121:0/4022590916 shutdown_connections 2023-08-18T20:43:55.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c81580a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 --2- 172.21.15.121:0/4022590916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c80c1cf0 0x7f62c80c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 -- 172.21.15.121:0/4022590916 >> 172.21.15.121:0/4022590916 conn(0x7f62c80c6b10 msgr2=0x7f62c80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 -- 172.21.15.121:0/4022590916 shutdown_connections 2023-08-18T20:43:55.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.531+0000 7f62cea2f700 1 -- 172.21.15.121:0/4022590916 wait complete. 2023-08-18T20:43:55.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.532+0000 7f62cea2f700 1 Processor -- start 2023-08-18T20:43:55.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.532+0000 7f62cea2f700 1 -- start start 2023-08-18T20:43:55.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 0x7f62c806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80c1cf0 0x7f62c814dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81ed960 con 0x7f62c8157c10 2023-08-18T20:43:55.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81ecce0 con 0x7f62c80c1cf0 2023-08-18T20:43:55.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81ecfc0 con 0x7f62c806a510 2023-08-18T20:43:55.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40584/0 (socket says 172.21.15.121:40584) 2023-08-18T20:43:55.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 -- 172.21.15.121:0/1737129617 learned_addr learned my addr 172.21.15.121:0/1737129617 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:55.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c77fe700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80c1cf0 0x7f62c814dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c7fff700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 0x7f62c806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 -- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 msgr2=0x7f62c806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 0x7f62c806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 -- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80c1cf0 msgr2=0x7f62c814dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80c1cf0 0x7f62c814dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 -- 172.21.15.121:0/1737129617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009b30 con 0x7f62c8157c10 2023-08-18T20:43:55.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c7fff700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 0x7f62c806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:55.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62ccfcc700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62c80c4690 tx=0x7f62c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0004960 con 0x7f62c8157c10 2023-08-18T20:43:55.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c00099b0 con 0x7f62c8157c10 2023-08-18T20:43:55.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c81ed2a0 con 0x7f62c8157c10 2023-08-18T20:43:55.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.533+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c001c680 con 0x7f62c8157c10 2023-08-18T20:43:55.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.534+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c814e780 con 0x7f62c8157c10 2023-08-18T20:43:55.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.535+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8074730 con 0x7f62c8157c10 2023-08-18T20:43:55.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.535+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f62c001c7e0 con 0x7f62c8157c10 2023-08-18T20:43:55.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.535+0000 7f62c4ff9700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 0x7f62b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.535+0000 7f62c7fff700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 0x7f62b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.535+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62c008a1e0 con 0x7f62c8157c10 2023-08-18T20:43:55.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.536+0000 7f62c7fff700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 0x7f62b406c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000f60 tx=0x7f62b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.540+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f62c0055960 con 0x7f62c8157c10 2023-08-18T20:43:55.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.729+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62c80c1390 con 0x7f62c8157c10 2023-08-18T20:43:55.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.730+0000 7f62c4ff9700 1 -- 172.21.15.121:0/1737129617 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62c0058f80 con 0x7f62c8157c10 2023-08-18T20:43:55.731 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:43:55.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 msgr2=0x7f62b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 0x7f62b406c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000f60 tx=0x7f62b8009040 comp rx=0 tx=0).stop 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 msgr2=0x7f62c814e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62c80c4690 tx=0x7f62c0004ad0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 shutdown_connections 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f62b406a0e0 0x7f62b406c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62c8157c10 0x7f62c814e240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62c806a510 0x7f62c806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 --2- 172.21.15.121:0/1737129617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80c1cf0 0x7f62c814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 >> 172.21.15.121:0/1737129617 conn(0x7f62c80c6b10 msgr2=0x7f62c8156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 shutdown_connections 2023-08-18T20:43:55.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.732+0000 7f62cea2f700 1 -- 172.21.15.121:0/1737129617 wait complete. 2023-08-18T20:43:55.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:43:55.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.868+0000 7f1030370700 1 Processor -- start 2023-08-18T20:43:55.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.868+0000 7f1030370700 1 -- start start 2023-08-18T20:43:55.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.869+0000 7f1030370700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 0x7f10280c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.869+0000 7f1030370700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280c2260 con 0x7f1028070950 2023-08-18T20:43:55.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.869+0000 7f1030370700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1028151d90 con 0x7f102814e950 2023-08-18T20:43:55.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.869+0000 7f1030370700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280a6630 con 0x7f102814ed30 2023-08-18T20:43:55.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102e90d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1028070950 0x7f10280c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47174/0 (socket says 172.21.15.121:47174) 2023-08-18T20:43:55.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102e90d700 1 -- 172.21.15.121:0/3671452837 learned_addr learned my addr 172.21.15.121:0/3671452837 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:55.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d90b700 1 --2- 172.21.15.121:0/3671452837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 0x7f10280c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287214503 0 0) 0x7f10280c2260 con 0x7f1028070950 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10140035b0 con 0x7f1028070950 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d90b700 1 -- 172.21.15.121:0/3671452837 >> v1:172.21.15.122:6789/0 conn(0x7f102814e950 legacy=0x7f10280c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782651172 0 0) 0x7f10140035b0 con 0x7f1028070950 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d90b700 1 -- 172.21.15.121:0/3671452837 >> v1:172.21.15.121:6789/0 conn(0x7f1028070950 legacy=0x7f10280c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d90b700 1 -- 172.21.15.121:0/3671452837 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028152070 con 0x7f102814ed30 2023-08-18T20:43:55.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.870+0000 7f102d90b700 1 --2- 172.21.15.121:0/3671452837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 0x7f10280c2ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1024009870 tx=0x7f1024009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a4ccb242664f27 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200019f0 con 0x7f102814ed30 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024004030 con 0x7f102814ed30 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f102d10a700 1 -- 172.21.15.121:0/3671452837 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240043a0 con 0x7f102814ed30 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 -- 172.21.15.121:0/3671452837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 msgr2=0x7f10280c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 --2- 172.21.15.121:0/3671452837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 0x7f10280c2ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1024009870 tx=0x7f1024009b80 comp rx=0 tx=0).stop 2023-08-18T20:43:55.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 -- 172.21.15.121:0/3671452837 shutdown_connections 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 --2- 172.21.15.121:0/3671452837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f102814ed30 0x7f10280c2ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 -- 172.21.15.121:0/3671452837 >> 172.21.15.121:0/3671452837 conn(0x7f10280c6b10 msgr2=0x7f10280c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 -- 172.21.15.121:0/3671452837 shutdown_connections 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.873+0000 7f1030370700 1 -- 172.21.15.121:0/3671452837 wait complete. 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.875+0000 7f1030370700 1 Processor -- start 2023-08-18T20:43:55.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.875+0000 7f1030370700 1 -- start start 2023-08-18T20:43:55.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 0x7f10280c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102814e950 0x7f10281ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280bbf80 con 0x7f102814ed30 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280710c0 con 0x7f102814e950 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102806e270 con 0x7f1028070950 2023-08-18T20:43:55.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40598/0 (socket says 172.21.15.121:40598) 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 -- 172.21.15.121:0/1199236142 learned_addr learned my addr 172.21.15.121:0/1199236142 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102d90b700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102814e950 0x7f10281ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e10c700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 0x7f10280c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 -- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 msgr2=0x7f10280c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 0x7f10280c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 -- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102814e950 msgr2=0x7f10281ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102814e950 0x7f10281ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 -- 172.21.15.121:0/1199236142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240094a0 con 0x7f102814ed30 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e10c700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 0x7f10280c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f102e90d700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f102000eeb0 tx=0x7f102000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000cd70 con 0x7f102814ed30 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10200070d0 con 0x7f102814ed30 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102806e530 con 0x7f102814ed30 2023-08-18T20:43:55.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.876+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020007480 con 0x7f102814ed30 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.877+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280bbc10 con 0x7f102814ed30 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.877+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102806ea50 con 0x7f102814ed30 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.878+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10200075e0 con 0x7f102814ed30 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.878+0000 7f101effd700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 0x7f100c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.878+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f102008b5f0 con 0x7f102814ed30 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.878+0000 7f102e10c700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 0x7f100c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.879+0000 7f102e10c700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 0x7f100c06c5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1018000f60 tx=0x7f1018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:55.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:55.882+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f102806ea50 con 0x7f102814ed30 2023-08-18T20:43:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.074+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10280bba70 con 0x7f102814ed30 2023-08-18T20:43:56.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.074+0000 7f101effd700 1 -- 172.21.15.121:0/1199236142 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10280bba70 con 0x7f102814ed30 2023-08-18T20:43:56.075 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:43:56.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 msgr2=0x7f100c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 0x7f100c06c5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1018000f60 tx=0x7f1018009040 comp rx=0 tx=0).stop 2023-08-18T20:43:56.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 msgr2=0x7f10280bc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f102000eeb0 tx=0x7f102000c550 comp rx=0 tx=0).stop 2023-08-18T20:43:56.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 shutdown_connections 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f100c06a110 0x7f100c06c5d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f102814ed30 0x7f10280bc410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1028070950 0x7f10280c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 --2- 172.21.15.121:0/1199236142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102814e950 0x7f10281ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 >> 172.21.15.121:0/1199236142 conn(0x7f10280c6b10 msgr2=0x7f10280c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.076+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 shutdown_connections 2023-08-18T20:43:56.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.077+0000 7f1030370700 1 -- 172.21.15.121:0/1199236142 wait complete. 2023-08-18T20:43:56.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:43:56.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.208+0000 7ff15400e700 1 Processor -- start 2023-08-18T20:43:56.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.208+0000 7ff15400e700 1 -- start start 2023-08-18T20:43:56.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff15400e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 0x7ff14c066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff15400e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff14c0bf550 0x7ff14c0bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff15400e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c06cc30 con 0x7ff14c1518e0 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff15400e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0c0b80 con 0x7ff14c0bf550 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff15400e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c155260 con 0x7ff14c0c1030 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff14c0bf550 0x7ff14c0bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff151daa700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff14c1518e0 0x7ff14c06b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47184/0 (socket says 172.21.15.121:47184) 2023-08-18T20:43:56.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff151daa700 1 -- 172.21.15.121:0/759835420 learned_addr learned my addr 172.21.15.121:0/759835420 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 -- 172.21.15.121:0/759835420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 msgr2=0x7ff14c066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1515a9700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 0x7ff14c066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff150da8700 1 -- 172.21.15.121:0/759835420 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688950144 0 0) 0x7ff14c06cc30 con 0x7ff14c1518e0 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 0x7ff14c066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 -- 172.21.15.121:0/759835420 >> v1:172.21.15.121:6789/0 conn(0x7ff14c1518e0 legacy=0x7ff14c06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 -- 172.21.15.121:0/759835420 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c06ce80 con 0x7ff14c0bf550 2023-08-18T20:43:56.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1515a9700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 0x7ff14c066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff1525ab700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0bf550 0x7ff14c0bf9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff144009d90 tx=0x7ff14400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb0e8865c22da25 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff150da8700 1 -- 172.21.15.121:0/759835420 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400e070 con 0x7ff14c0bf550 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff150da8700 1 -- 172.21.15.121:0/759835420 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400bbd0 con 0x7ff14c0bf550 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.209+0000 7ff150da8700 1 -- 172.21.15.121:0/759835420 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144012430 con 0x7ff14c0bf550 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 -- 172.21.15.121:0/759835420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0bf550 msgr2=0x7ff14c0bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0bf550 0x7ff14c0bf9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff144009d90 tx=0x7ff14400b330 comp rx=0 tx=0).stop 2023-08-18T20:43:56.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 -- 172.21.15.121:0/759835420 shutdown_connections 2023-08-18T20:43:56.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0bf550 0x7ff14c0bf9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 --2- 172.21.15.121:0/759835420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c0c1030 0x7ff14c066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 -- 172.21.15.121:0/759835420 >> 172.21.15.121:0/759835420 conn(0x7ff14c0c2ca0 msgr2=0x7ff14c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 -- 172.21.15.121:0/759835420 shutdown_connections 2023-08-18T20:43:56.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.210+0000 7ff15400e700 1 -- 172.21.15.121:0/759835420 wait complete. 2023-08-18T20:43:56.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.211+0000 7ff15400e700 1 Processor -- start 2023-08-18T20:43:56.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.211+0000 7ff15400e700 1 -- start start 2023-08-18T20:43:56.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff14c0bf550 0x7ff14c0aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 0x7ff14c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c157260 con 0x7ff14c0c1030 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1e9640 con 0x7ff14c0bf550 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1e98c0 con 0x7ff14c1518e0 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40610/0 (socket says 172.21.15.121:40610) 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 -- 172.21.15.121:0/3411692408 learned_addr learned my addr 172.21.15.121:0/3411692408 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff151daa700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff14c0bf550 0x7ff14c0aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1525ab700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 0x7ff14c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 -- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 msgr2=0x7ff14c14be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 0x7ff14c14be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 -- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff14c0bf550 msgr2=0x7ff14c0aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff14c0bf550 0x7ff14c0aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 -- 172.21.15.121:0/3411692408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144009a70 con 0x7ff14c0c1030 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1525ab700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 0x7ff14c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1515a9700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00c7f0 tx=0x7ff13c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c005c20 con 0x7ff14c0c1030 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c005d80 con 0x7ff14c0c1030 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c011820 con 0x7ff14c0c1030 2023-08-18T20:43:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c1e9ba0 con 0x7ff14c0c1030 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.212+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c1ea160 con 0x7ff14c0c1030 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.213+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c06e460 con 0x7ff14c0c1030 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.214+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff13c011980 con 0x7ff14c0c1030 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.214+0000 7ff1427fc700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 0x7ff13006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.214+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff13c0887e0 con 0x7ff14c0c1030 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.214+0000 7ff151daa700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 0x7ff13006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.215+0000 7ff151daa700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 0x7ff13006c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f60 tx=0x7ff148007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.219+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff13c053ee0 con 0x7ff14c0c1030 2023-08-18T20:43:56.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.451+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff14c1ea350 con 0x7ff14c0c1030 2023-08-18T20:43:56.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.451+0000 7ff1427fc700 1 -- 172.21.15.121:0/3411692408 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7ff13c057500 con 0x7ff14c0c1030 2023-08-18T20:43:56.452 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:56.452 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:43:56.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 msgr2=0x7ff13006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 0x7ff13006c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f60 tx=0x7ff148007e70 comp rx=0 tx=0).stop 2023-08-18T20:43:56.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 msgr2=0x7ff14c158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00c7f0 tx=0x7ff13c00cb00 comp rx=0 tx=0).stop 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 shutdown_connections 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14c1518e0 0x7ff14c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff14c0bf550 0x7ff14c0aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff13006a0e0 0x7ff13006c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 --2- 172.21.15.121:0/3411692408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff14c0c1030 0x7ff14c158070 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 >> 172.21.15.121:0/3411692408 conn(0x7ff14c0c2ca0 msgr2=0x7ff14c14f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 shutdown_connections 2023-08-18T20:43:56.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.453+0000 7ff15400e700 1 -- 172.21.15.121:0/3411692408 wait complete. 2023-08-18T20:43:56.456 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:43:56.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:56.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.585+0000 7f3d9bff2700 1 Processor -- start 2023-08-18T20:43:56.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.585+0000 7f3d9bff2700 1 -- start start 2023-08-18T20:43:56.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9bff2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d94156510 0x7f3d940c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9bff2700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d94155970 con 0x7f3d9414fb90 2023-08-18T20:43:56.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9bff2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9406e830 con 0x7f3d94152250 2023-08-18T20:43:56.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9bff2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9414ff70 con 0x7f3d94156510 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9a58f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d94156510 0x7f3d940c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d99d8e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3d9414fb90 0x7f3d9406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47198/0 (socket says 172.21.15.121:47198) 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9a58f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d94156510 0x7f3d940c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40620/0 (socket says 172.21.15.121:40620) 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d99d8e700 1 -- 172.21.15.121:0/4269660760 learned_addr learned my addr 172.21.15.121:0/4269660760 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9a58f700 1 -- 172.21.15.121:0/4269660760 >> v1:172.21.15.122:6789/0 conn(0x7f3d94152250 legacy=0x7f3d94155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9a58f700 1 -- 172.21.15.121:0/4269660760 >> v1:172.21.15.121:6789/0 conn(0x7f3d9414fb90 legacy=0x7f3d9406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.586+0000 7f3d9a58f700 1 -- 172.21.15.121:0/4269660760 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9406df90 con 0x7f3d94156510 2023-08-18T20:43:56.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9a58f700 1 --2- 172.21.15.121:0/4269660760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d94156510 0x7f3d940c5d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009d90 tx=0x7f3d8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ef738a475a1173 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d98d8c700 1 -- 172.21.15.121:0/4269660760 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00e070 con 0x7f3d94156510 2023-08-18T20:43:56.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d98d8c700 1 -- 172.21.15.121:0/4269660760 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00bb90 con 0x7f3d94156510 2023-08-18T20:43:56.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d98d8c700 1 -- 172.21.15.121:0/4269660760 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c003a20 con 0x7f3d94156510 2023-08-18T20:43:56.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 -- 172.21.15.121:0/4269660760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d94156510 msgr2=0x7f3d940c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/4269660760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d94156510 0x7f3d940c5d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009d90 tx=0x7f3d8c00b330 comp rx=0 tx=0).stop 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 -- 172.21.15.121:0/4269660760 shutdown_connections 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/4269660760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d94156510 0x7f3d940c5d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 -- 172.21.15.121:0/4269660760 >> 172.21.15.121:0/4269660760 conn(0x7f3d940c6b10 msgr2=0x7f3d940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 -- 172.21.15.121:0/4269660760 shutdown_connections 2023-08-18T20:43:56.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.587+0000 7f3d9bff2700 1 -- 172.21.15.121:0/4269660760 wait complete. 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.589+0000 7f3d9bff2700 1 Processor -- start 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.589+0000 7f3d9bff2700 1 -- start start 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d94152250 0x7f3d941e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d94156510 0x7f3d94153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94153c90 con 0x7f3d9414fb90 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94153f70 con 0x7f3d94156510 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94154250 con 0x7f3d94152250 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40622/0 (socket says 172.21.15.121:40622) 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 -- 172.21.15.121:0/549145422 learned_addr learned my addr 172.21.15.121:0/549145422 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9958d700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d94152250 0x7f3d941e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 -- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d94152250 msgr2=0x7f3d941e78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9a58f700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d94156510 0x7f3d94153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d94152250 0x7f3d941e78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 -- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d94156510 msgr2=0x7f3d94153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d94156510 0x7f3d94153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 -- 172.21.15.121:0/549145422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c009a70 con 0x7f3d9414fb90 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d99d8e700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c430 tx=0x7f3d8400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84005d70 con 0x7f3d9414fb90 2023-08-18T20:43:56.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840070d0 con 0x7f3d9414fb90 2023-08-18T20:43:56.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94154530 con 0x7f3d9414fb90 2023-08-18T20:43:56.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84007460 con 0x7f3d9414fb90 2023-08-18T20:43:56.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.590+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9414dbf0 con 0x7f3d9414fb90 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.591+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d94154a50 con 0x7f3d9414fb90 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.592+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d840075c0 con 0x7f3d9414fb90 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.592+0000 7f3d8a7fc700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.592+0000 7f3d9958d700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.592+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d84087920 con 0x7f3d9414fb90 2023-08-18T20:43:56.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.592+0000 7f3d9958d700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d9414d730 tx=0x7f3d90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.597+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3d94154a50 con 0x7f3d9414fb90 2023-08-18T20:43:56.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.787+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d94074730 con 0x7f3d9414fb90 2023-08-18T20:43:56.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.788+0000 7f3d8a7fc700 1 -- 172.21.15.121:0/549145422 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f3d84017090 con 0x7f3d9414fb90 2023-08-18T20:43:56.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:56.790 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:56.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 msgr2=0x7f3d7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d9414d730 tx=0x7f3d90009040 comp rx=0 tx=0).stop 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 msgr2=0x7f3d94154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c430 tx=0x7f3d8400c7f0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 shutdown_connections 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d94156510 0x7f3d94153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d9414fb90 0x7f3d94154d30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 --2- 172.21.15.121:0/549145422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d94152250 0x7f3d941e78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 >> 172.21.15.121:0/549145422 conn(0x7f3d940c6b10 msgr2=0x7f3d94150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 shutdown_connections 2023-08-18T20:43:56.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.791+0000 7f3d9bff2700 1 -- 172.21.15.121:0/549145422 wait complete. 2023-08-18T20:43:56.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:43:56.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:43:56.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.926+0000 7f3700438700 1 Processor -- start 2023-08-18T20:43:56.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.926+0000 7f3700438700 1 -- start start 2023-08-18T20:43:56.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f814fb90 0x7f36f80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36f8152250 0x7f36f806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 0x7f36f8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f814ff70 con 0x7f36f8152250 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f8155970 con 0x7f36f806a7e0 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.927+0000 7f3700438700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f806e830 con 0x7f36f814fb90 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36f8152250 0x7f36f806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36f8152250 0x7f36f806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40630/0 (socket says 172.21.15.121:40630) 2023-08-18T20:43:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 -- 172.21.15.121:0/3502576282 learned_addr learned my addr 172.21.15.121:0/3502576282 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fe9d5700 1 --2- 172.21.15.121:0/3502576282 >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 0x7f36f8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 -- 172.21.15.121:0/3502576282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f814fb90 msgr2=0x7f36f80c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fe1d4700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f814fb90 0x7f36f80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f814fb90 0x7f36f80c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 -- 172.21.15.121:0/3502576282 >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 msgr2=0x7f36f8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/3502576282 >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 0x7f36f8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 -- 172.21.15.121:0/3502576282 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f806df90 con 0x7f36f8152250 2023-08-18T20:43:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fe9d5700 1 --2- 172.21.15.121:0/3502576282 >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 0x7f36f8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f8152250 0x7f36f806a2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36f80708e0 tx=0x7f36f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de77e858aa92296a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd1d2700 1 -- 172.21.15.121:0/3502576282 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b870 con 0x7f36f8152250 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd1d2700 1 -- 172.21.15.121:0/3502576282 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b9d0 con 0x7f36f8152250 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.928+0000 7f36fd1d2700 1 -- 172.21.15.121:0/3502576282 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400bd60 con 0x7f36f8152250 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 -- 172.21.15.121:0/3502576282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f8152250 msgr2=0x7f36f806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f8152250 0x7f36f806a2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36f80708e0 tx=0x7f36f4009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 -- 172.21.15.121:0/3502576282 shutdown_connections 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 --2- 172.21.15.121:0/3502576282 >> v2:172.21.15.122:3300/0 conn(0x7f36f806a7e0 0x7f36f8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f814fb90 0x7f36f80c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 --2- 172.21.15.121:0/3502576282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f8152250 0x7f36f806a2a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 -- 172.21.15.121:0/3502576282 >> 172.21.15.121:0/3502576282 conn(0x7f36f80c6b10 msgr2=0x7f36f80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 -- 172.21.15.121:0/3502576282 shutdown_connections 2023-08-18T20:43:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.929+0000 7f3700438700 1 -- 172.21.15.121:0/3502576282 wait complete. 2023-08-18T20:43:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.930+0000 7f3700438700 1 Processor -- start 2023-08-18T20:43:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.930+0000 7f3700438700 1 -- start start 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36f806a7e0 0x7f36f81488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f8152250 0x7f36f8150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8071810 con 0x7f36f814fb90 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8070c00 con 0x7f36f806a7e0 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f3700438700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8070e70 con 0x7f36f8152250 2023-08-18T20:43:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fd9d3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fd9d3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40638/0 (socket says 172.21.15.121:40638) 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fd9d3700 1 -- 172.21.15.121:0/1731893151 learned_addr learned my addr 172.21.15.121:0/1731893151 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fe1d4700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36f806a7e0 0x7f36f81488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fe9d5700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f8152250 0x7f36f8150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fd9d3700 1 -- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f8152250 msgr2=0x7f36f8150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.931+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f8152250 0x7f36f8150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36fd9d3700 1 -- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36f806a7e0 msgr2=0x7f36f81488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36f806a7e0 0x7f36f81488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36fd9d3700 1 -- 172.21.15.121:0/1731893151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f4009550 con 0x7f36f814fb90 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36fd9d3700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c4690 tx=0x7f36f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4004250 con 0x7f36f814fb90 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f401f070 con 0x7f36f814fb90 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8071150 con 0x7f36f814fb90 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f40045d0 con 0x7f36f814fb90 2023-08-18T20:43:56.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.932+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8155640 con 0x7f36f814fb90 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.933+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8071950 con 0x7f36f814fb90 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.933+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36f4021030 con 0x7f36f814fb90 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.933+0000 7f36eeffd700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.934+0000 7f36fe1d4700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.934+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36f40898b0 con 0x7f36f814fb90 2023-08-18T20:43:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.934+0000 7f36fe1d4700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ab60 tx=0x7f36e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:56.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:56.938+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f36f8071950 con 0x7f36f814fb90 2023-08-18T20:43:57.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.128+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36f8071950 con 0x7f36f814fb90 2023-08-18T20:43:57.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.129+0000 7f36eeffd700 1 -- 172.21.15.121:0/1731893151 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36f8071950 con 0x7f36f814fb90 2023-08-18T20:43:57.130 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:43:57.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 msgr2=0x7f36dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ab60 tx=0x7f36e8008040 comp rx=0 tx=0).stop 2023-08-18T20:43:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 msgr2=0x7f36f814d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c4690 tx=0x7f36f4004750 comp rx=0 tx=0).stop 2023-08-18T20:43:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 shutdown_connections 2023-08-18T20:43:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36f8152250 0x7f36f8150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36f806a7e0 0x7f36f81488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 --2- 172.21.15.121:0/1731893151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f814fb90 0x7f36f814d370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 >> 172.21.15.121:0/1731893151 conn(0x7f36f80c6b10 msgr2=0x7f36f81500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 shutdown_connections 2023-08-18T20:43:57.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.131+0000 7f3700438700 1 -- 172.21.15.121:0/1731893151 wait complete. 2023-08-18T20:43:57.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:43:57.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.265+0000 7f2bf45c7700 1 Processor -- start 2023-08-18T20:43:57.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.265+0000 7f2bf45c7700 1 -- start start 2023-08-18T20:43:57.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf45c7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bec0af520 0x7f2bec154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf45c7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 0x7f2bec158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf45c7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec0ac1f0 con 0x7f2bec158680 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf45c7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec155450 con 0x7f2bec0af520 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf45c7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec0bd600 con 0x7f2bec0c7c50 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2363700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bec0af520 0x7f2bec154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2b64700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2bec158680 0x7f2bec0c46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47230/0 (socket says 172.21.15.121:47230) 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2b64700 1 -- 172.21.15.121:0/4113614396 learned_addr learned my addr 172.21.15.121:0/4113614396 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:57.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2363700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bec0af520 0x7f2bec154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40644/0 (socket says 172.21.15.121:40644) 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf1b62700 1 --2- 172.21.15.121:0/4113614396 >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 0x7f2bec158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2363700 1 -- 172.21.15.121:0/4113614396 >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 msgr2=0x7f2bec158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2363700 1 --2- 172.21.15.121:0/4113614396 >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 0x7f2bec158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf2363700 1 -- 172.21.15.121:0/4113614396 >> v1:172.21.15.121:6789/0 conn(0x7f2bec158680 legacy=0x7f2bec0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.266+0000 7f2bf1361700 1 -- 172.21.15.121:0/4113614396 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448206467 0 0) 0x7f2be4001490 con 0x7f2bec158680 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf2363700 1 -- 172.21.15.121:0/4113614396 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0ab950 con 0x7f2bec0af520 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf1b62700 1 --2- 172.21.15.121:0/4113614396 >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 0x7f2bec158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf2363700 1 --2- 172.21.15.121:0/4113614396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec154f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0c4380 tx=0x7f2bdc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23923f639eb6e50c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf1361700 1 -- 172.21.15.121:0/4113614396 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011830 con 0x7f2bec0af520 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf1361700 1 -- 172.21.15.121:0/4113614396 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc011990 con 0x7f2bec0af520 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf1361700 1 -- 172.21.15.121:0/4113614396 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011d20 con 0x7f2bec0af520 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 -- 172.21.15.121:0/4113614396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 msgr2=0x7f2bec154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/4113614396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec154f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0c4380 tx=0x7f2bdc009b20 comp rx=0 tx=0).stop 2023-08-18T20:43:57.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 -- 172.21.15.121:0/4113614396 shutdown_connections 2023-08-18T20:43:57.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/4113614396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec154f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/4113614396 >> v2:172.21.15.122:3300/0 conn(0x7f2bec0c7c50 0x7f2bec158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 -- 172.21.15.121:0/4113614396 >> 172.21.15.121:0/4113614396 conn(0x7f2bec0c9d50 msgr2=0x7f2bec0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 -- 172.21.15.121:0/4113614396 shutdown_connections 2023-08-18T20:43:57.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.267+0000 7f2bf45c7700 1 -- 172.21.15.121:0/4113614396 wait complete. 2023-08-18T20:43:57.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 Processor -- start 2023-08-18T20:43:57.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 -- start start 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2bec0c7c50 0x7f2bec147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2bec158680 0x7f2bec147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c17a0 con 0x7f2bec0af520 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c19f0 con 0x7f2bec0c7c50 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf45c7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0c0e30 con 0x7f2bec158680 2023-08-18T20:43:57.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf2363700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf2363700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40650/0 (socket says 172.21.15.121:40650) 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.269+0000 7f2bf2363700 1 -- 172.21.15.121:0/114430202 learned_addr learned my addr 172.21.15.121:0/114430202 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf1b62700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2bec0c7c50 0x7f2bec147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 -- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2bec158680 msgr2=0x7f2bec147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2bec158680 0x7f2bec147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 -- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2bec0c7c50 msgr2=0x7f2bec147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2bec0c7c50 0x7f2bec147410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 -- 172.21.15.121:0/114430202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0094a0 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf2363700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc014040 tx=0x7f2bdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0038a0 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc01e070 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec0c1110 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc003c40 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.270+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec0c13f0 con 0x7f2bec0af520 2023-08-18T20:43:57.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.271+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec074730 con 0x7f2bec0af520 2023-08-18T20:43:57.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.271+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2bdc02d450 con 0x7f2bec0af520 2023-08-18T20:43:57.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.272+0000 7f2be2ffd700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 0x7f2bd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.272+0000 7f2bf1b62700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 0x7f2bd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.272+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bdc0896a0 con 0x7f2bec0af520 2023-08-18T20:43:57.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.272+0000 7f2bf1b62700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 0x7f2bd006c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2be8006fd0 tx=0x7f2be8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.276+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2bdc054e20 con 0x7f2bec0af520 2023-08-18T20:43:57.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.463+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2bec0ac390 con 0x7f2bec0af520 2023-08-18T20:43:57.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.464+0000 7f2be2ffd700 1 -- 172.21.15.121:0/114430202 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bdc020020 con 0x7f2bec0af520 2023-08-18T20:43:57.464 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:43:57.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 msgr2=0x7f2bd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 0x7f2bd006c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2be8006fd0 tx=0x7f2be8008040 comp rx=0 tx=0).stop 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 msgr2=0x7f2bec0c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc014040 tx=0x7f2bdc004750 comp rx=0 tx=0).stop 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 shutdown_connections 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2bec158680 0x7f2bec147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2bd006a0e0 0x7f2bd006c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bec0af520 0x7f2bec0c3590 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 --2- 172.21.15.121:0/114430202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2bec0c7c50 0x7f2bec147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 >> 172.21.15.121:0/114430202 conn(0x7f2bec0c9d50 msgr2=0x7f2bec0a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 shutdown_connections 2023-08-18T20:43:57.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.466+0000 7f2bf45c7700 1 -- 172.21.15.121:0/114430202 wait complete. 2023-08-18T20:43:57.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:43:57.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.600+0000 7f9380bda700 1 Processor -- start 2023-08-18T20:43:57.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.600+0000 7f9380bda700 1 -- start start 2023-08-18T20:43:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f9380bda700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f9380bda700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c155970 con 0x7f937c155e00 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f9380bda700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c06e830 con 0x7f937c152250 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f9380bda700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c14ff70 con 0x7f937c14fb90 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937ad9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f937c155e00 0x7f937c15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47244/0 (socket says 172.21.15.121:47244) 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937ad9d700 1 -- 172.21.15.121:0/3968125224 learned_addr learned my addr 172.21.15.121:0/3968125224 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937a59c700 1 --2- 172.21.15.121:0/3968125224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820770043 0 0) 0x7f937c155970 con 0x7f937c155e00 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93640035b0 con 0x7f937c155e00 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067120669 0 0) 0x7f937c06e830 con 0x7f937c152250 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f937c155970 con 0x7f937c152250 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937a59c700 1 -- 172.21.15.121:0/3968125224 >> v1:172.21.15.122:6789/0 conn(0x7f937c152250 legacy=0x7f937c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937a59c700 1 -- 172.21.15.121:0/3968125224 >> v1:172.21.15.121:6789/0 conn(0x7f937c155e00 legacy=0x7f937c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937a59c700 1 -- 172.21.15.121:0/3968125224 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c06df90 con 0x7f937c14fb90 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.601+0000 7f937a59c700 1 --2- 172.21.15.121:0/3968125224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c0c5d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f936c009870 tx=0x7f936c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ecae53dda0d074 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c011830 con 0x7f937c14fb90 2023-08-18T20:43:57.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c011990 con 0x7f937c14fb90 2023-08-18T20:43:57.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f937959a700 1 -- 172.21.15.121:0/3968125224 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c011d00 con 0x7f937c14fb90 2023-08-18T20:43:57.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 -- 172.21.15.121:0/3968125224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 msgr2=0x7f937c0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 --2- 172.21.15.121:0/3968125224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c0c5d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f936c009870 tx=0x7f936c009b80 comp rx=0 tx=0).stop 2023-08-18T20:43:57.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 -- 172.21.15.121:0/3968125224 shutdown_connections 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 --2- 172.21.15.121:0/3968125224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c0c5d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 -- 172.21.15.121:0/3968125224 >> 172.21.15.121:0/3968125224 conn(0x7f937c0c6b10 msgr2=0x7f937c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 -- 172.21.15.121:0/3968125224 shutdown_connections 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.602+0000 7f9380bda700 1 -- 172.21.15.121:0/3968125224 wait complete. 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.603+0000 7f9380bda700 1 Processor -- start 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.603+0000 7f9380bda700 1 -- start start 2023-08-18T20:43:57.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f937c152250 0x7f937c146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0ab610 con 0x7f937c155e00 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0aaa20 con 0x7f937c152250 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9380bda700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0aac70 con 0x7f937c14fb90 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40668/0 (socket says 172.21.15.121:40668) 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 -- 172.21.15.121:0/2317349300 learned_addr learned my addr 172.21.15.121:0/2317349300 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f9379d9b700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f937c152250 0x7f937c146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937a59c700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 -- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 msgr2=0x7f937c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 -- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f937c152250 msgr2=0x7f937c146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.604+0000 7f937ad9d700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f937c152250 0x7f937c146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f937ad9d700 1 -- 172.21.15.121:0/2317349300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0094a0 con 0x7f937c155e00 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f937a59c700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f937ad9d700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f937400cba0 tx=0x7f937400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400aa70 con 0x7f937c155e00 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400abd0 con 0x7f937c155e00 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c0aaf50 con 0x7f937c155e00 2023-08-18T20:43:57.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374012400 con 0x7f937c155e00 2023-08-18T20:43:57.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.605+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c14ad20 con 0x7f937c155e00 2023-08-18T20:43:57.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.606+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c0ac630 con 0x7f937c155e00 2023-08-18T20:43:57.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.606+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f937401b3b0 con 0x7f937c155e00 2023-08-18T20:43:57.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.607+0000 7f936affd700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 0x7f935c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.607+0000 7f937a59c700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 0x7f935c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.607+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9374088260 con 0x7f937c155e00 2023-08-18T20:43:57.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.607+0000 7f937a59c700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 0x7f935c06c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097c0 tx=0x7f936c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.611+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f937c0ac630 con 0x7f937c155e00 2023-08-18T20:43:57.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.801+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f937c0ac630 con 0x7f937c155e00 2023-08-18T20:43:57.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.801+0000 7f936affd700 1 -- 172.21.15.121:0/2317349300 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f937c0ac630 con 0x7f937c155e00 2023-08-18T20:43:57.802 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:43:57.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.803+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 msgr2=0x7f935c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.803+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 0x7f935c06c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097c0 tx=0x7f936c01c040 comp rx=0 tx=0).stop 2023-08-18T20:43:57.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.803+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 msgr2=0x7f937c147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.803+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f937400cba0 tx=0x7f937400ceb0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 shutdown_connections 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f935c06a0e0 0x7f935c06c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f937c155e00 0x7f937c147260 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f937c14fb90 0x7f937c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 --2- 172.21.15.121:0/2317349300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f937c152250 0x7f937c146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 >> 172.21.15.121:0/2317349300 conn(0x7f937c0c6b10 msgr2=0x7f937c0c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 shutdown_connections 2023-08-18T20:43:57.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.804+0000 7f9380bda700 1 -- 172.21.15.121:0/2317349300 wait complete. 2023-08-18T20:43:57.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:43:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.938+0000 7f7755f4d700 1 Processor -- start 2023-08-18T20:43:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.938+0000 7f7755f4d700 1 -- start start 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f7755f4d700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f77500a6290 0x7f77500c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f7755f4d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77500c1b10 0x7f77500c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f7755f4d700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500c4f40 con 0x7f77500c0c50 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f7755f4d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500c5e50 con 0x7f77500c1b10 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f7755f4d700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500c6120 con 0x7f77500a6290 2023-08-18T20:43:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77500c1b10 0x7f77500c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f77500c0c50 0x7f775006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47254/0 (socket says 172.21.15.121:47254) 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77500c1b10 0x7f77500c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40676/0 (socket says 172.21.15.121:40676) 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774f7fe700 1 -- 172.21.15.121:0/4081527043 learned_addr learned my addr 172.21.15.121:0/4081527043 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774effd700 1 --2- 172.21.15.121:0/4081527043 >> v2:172.21.15.122:3300/0 conn(0x7f77500a6290 0x7f77500c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 -- 172.21.15.121:0/4081527043 >> v2:172.21.15.122:3300/0 conn(0x7f77500a6290 msgr2=0x7f77500c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 --2- 172.21.15.121:0/4081527043 >> v2:172.21.15.122:3300/0 conn(0x7f77500a6290 0x7f77500c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 -- 172.21.15.121:0/4081527043 >> v1:172.21.15.121:6789/0 conn(0x7f77500c0c50 legacy=0x7f775006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.939+0000 7f774ffff700 1 -- 172.21.15.121:0/4081527043 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77501551f0 con 0x7f77500c1b10 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f774ffff700 1 --2- 172.21.15.121:0/4081527043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c1b10 0x7f77500c5910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77500c45c0 tx=0x7f774800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593f05bf8c2a09ff server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f774e7fc700 1 -- 172.21.15.121:0/4081527043 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800e070 con 0x7f77500c1b10 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f774e7fc700 1 -- 172.21.15.121:0/4081527043 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800bbd0 con 0x7f77500c1b10 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f774e7fc700 1 -- 172.21.15.121:0/4081527043 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748012430 con 0x7f77500c1b10 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 -- 172.21.15.121:0/4081527043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c1b10 msgr2=0x7f77500c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 --2- 172.21.15.121:0/4081527043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c1b10 0x7f77500c5910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77500c45c0 tx=0x7f774800b330 comp rx=0 tx=0).stop 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 -- 172.21.15.121:0/4081527043 shutdown_connections 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 --2- 172.21.15.121:0/4081527043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c1b10 0x7f77500c5910 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 --2- 172.21.15.121:0/4081527043 >> v2:172.21.15.122:3300/0 conn(0x7f77500a6290 0x7f77500c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 -- 172.21.15.121:0/4081527043 >> 172.21.15.121:0/4081527043 conn(0x7f77500c6b10 msgr2=0x7f77500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 -- 172.21.15.121:0/4081527043 shutdown_connections 2023-08-18T20:43:57.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.940+0000 7f7755f4d700 1 -- 172.21.15.121:0/4081527043 wait complete. 2023-08-18T20:43:57.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.941+0000 7f7755f4d700 1 Processor -- start 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 -- start start 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 0x7f7750147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77500c1b10 0x7f77501ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501501f0 con 0x7f77500c0c50 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750147790 con 0x7f77500c1b10 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f7755f4d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77501ed820 con 0x7f77500a6290 2023-08-18T20:43:57.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f774effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f774effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40680/0 (socket says 172.21.15.121:40680) 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.942+0000 7f774effd700 1 -- 172.21.15.121:0/562061763 learned_addr learned my addr 172.21.15.121:0/562061763 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774ffff700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77500c1b10 0x7f77501ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774f7fe700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 0x7f7750147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 -- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 msgr2=0x7f7750147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 0x7f7750147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 -- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77500c1b10 msgr2=0x7f77501ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77500c1b10 0x7f77501ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 -- 172.21.15.121:0/562061763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748009a70 con 0x7f77500c0c50 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774f7fe700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 0x7f7750147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f774effd700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f774000d800 tx=0x7f774000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400125f0 con 0x7f77500c0c50 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740012750 con 0x7f77500c0c50 2023-08-18T20:43:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77500a9f00 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740012b00 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.943+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77500aa4c0 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.944+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7750152e40 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.944+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7740012c60 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.945+0000 7f7737fff700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 0x7f773c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.945+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7740088840 con 0x7f77500c0c50 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.945+0000 7f774f7fe700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 0x7f773c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:57.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.945+0000 7f774f7fe700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 0x7f773c06c570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7744005910 tx=0x7f7744009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:57.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:57.949+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7740053fc0 con 0x7f77500c0c50 2023-08-18T20:43:58.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.139+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77500673f0 con 0x7f77500c0c50 2023-08-18T20:43:58.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.139+0000 7f7737fff700 1 -- 172.21.15.121:0/562061763 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77400575e0 con 0x7f77500c0c50 2023-08-18T20:43:58.140 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:43:58.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.141+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 msgr2=0x7f773c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.141+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 0x7f773c06c570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7744005910 tx=0x7f7744009040 comp rx=0 tx=0).stop 2023-08-18T20:43:58.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 msgr2=0x7f77501ecce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f774000d800 tx=0x7f774000dbc0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 shutdown_connections 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77500c1b10 0x7f77501ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77500a6290 0x7f7750147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f773c06a0b0 0x7f773c06c570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 --2- 172.21.15.121:0/562061763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77500c0c50 0x7f77501ecce0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 >> 172.21.15.121:0/562061763 conn(0x7f77500c6b10 msgr2=0x7f77500a7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 shutdown_connections 2023-08-18T20:43:58.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.142+0000 7f7755f4d700 1 -- 172.21.15.121:0/562061763 wait complete. 2023-08-18T20:43:58.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:43:58.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.272+0000 7fb8f5655700 1 Processor -- start 2023-08-18T20:43:58.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.272+0000 7fb8f5655700 1 -- start start 2023-08-18T20:43:58.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8f5655700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb8f01520a0 0x7fb8f006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8f5655700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f0154b40 0x7fb8f0154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8f5655700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00b9730 con 0x7fb8f00c13a0 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8f5655700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f0152480 con 0x7fb8f01520a0 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8f5655700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00c19a0 con 0x7fb8f0154b40 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8eeffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb8f01520a0 0x7fb8f006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8ee7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb8f00c13a0 0x7fb8f00c4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47270/0 (socket says 172.21.15.121:47270) 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.273+0000 7fb8ee7fc700 1 -- 172.21.15.121:0/4373729 learned_addr learned my addr 172.21.15.121:0/4373729 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8eeffd700 1 -- 172.21.15.121:0/4373729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f0154b40 msgr2=0x7fb8f0154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:58.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8ef7fe700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f0154b40 0x7fb8f0154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8eeffd700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f0154b40 0x7fb8f0154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8eeffd700 1 -- 172.21.15.121:0/4373729 >> v1:172.21.15.121:6789/0 conn(0x7fb8f00c13a0 legacy=0x7fb8f00c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8edffb700 1 -- 172.21.15.121:0/4373729 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171652230 0 0) 0x7fb8f00b9730 con 0x7fb8f00c13a0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8eeffd700 1 -- 172.21.15.121:0/4373729 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f006c360 con 0x7fb8f01520a0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8eeffd700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f01520a0 0x7fb8f006be20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009840 tx=0x7fb8d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e437f4c29a7003f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8edffb700 1 -- 172.21.15.121:0/4373729 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011830 con 0x7fb8f01520a0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8edffb700 1 -- 172.21.15.121:0/4373729 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8011990 con 0x7fb8f01520a0 2023-08-18T20:43:58.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8edffb700 1 -- 172.21.15.121:0/4373729 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011d20 con 0x7fb8f01520a0 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8f5655700 1 -- 172.21.15.121:0/4373729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f01520a0 msgr2=0x7fb8f006be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8f5655700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f01520a0 0x7fb8f006be20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009840 tx=0x7fb8d8009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.274+0000 7fb8f5655700 1 -- 172.21.15.121:0/4373729 shutdown_connections 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.275+0000 7fb8f5655700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f0154b40 0x7fb8f0154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.275+0000 7fb8f5655700 1 --2- 172.21.15.121:0/4373729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f01520a0 0x7fb8f006be20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.275+0000 7fb8f5655700 1 -- 172.21.15.121:0/4373729 >> 172.21.15.121:0/4373729 conn(0x7fb8f00a7ae0 msgr2=0x7fb8f00a7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.275+0000 7fb8f5655700 1 -- 172.21.15.121:0/4373729 shutdown_connections 2023-08-18T20:43:58.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.275+0000 7fb8f5655700 1 -- 172.21.15.121:0/4373729 wait complete. 2023-08-18T20:43:58.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 Processor -- start 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 -- start start 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f01520a0 0x7fb8f00bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f0154b40 0x7fb8f00a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0099c90 con 0x7fb8f00c13a0 2023-08-18T20:43:58.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01e8160 con 0x7fb8f0154b40 2023-08-18T20:43:58.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.276+0000 7fb8f5655700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00a48c0 con 0x7fb8f01520a0 2023-08-18T20:43:58.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40692/0 (socket says 172.21.15.121:40692) 2023-08-18T20:43:58.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 -- 172.21.15.121:0/2383257728 learned_addr learned my addr 172.21.15.121:0/2383257728 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:58.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8ee7fc700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f01520a0 0x7fb8f00bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8ef7fe700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f0154b40 0x7fb8f00a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 -- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f01520a0 msgr2=0x7fb8f00bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f01520a0 0x7fb8f00bf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 -- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f0154b40 msgr2=0x7fb8f00a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f0154b40 0x7fb8f00a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 -- 172.21.15.121:0/2383257728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d80094a0 con 0x7fb8f00c13a0 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8eeffd700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8000c00 tx=0x7fb8d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80038a0 con 0x7fb8f00c13a0 2023-08-18T20:43:58.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d801e070 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f00a45e0 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8003c20 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.277+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f00bd200 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.278+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0074730 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.278+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8d802d450 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.279+0000 7fb8e77fe700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.279+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8d80896f0 con 0x7fb8f00c13a0 2023-08-18T20:43:58.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.279+0000 7fb8ee7fc700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.279+0000 7fb8ee7fc700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8f014ecd0 tx=0x7fb8e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.283+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb8d8054e70 con 0x7fb8f00c13a0 2023-08-18T20:43:58.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.514+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f00c1180 con 0x7fb8f00c13a0 2023-08-18T20:43:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.514+0000 7fb8e77fe700 1 -- 172.21.15.121:0/2383257728 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7fb8d80045b0 con 0x7fb8f00c13a0 2023-08-18T20:43:58.516 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:58.516 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:43:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 msgr2=0x7fb8d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8f014ecd0 tx=0x7fb8e0009040 comp rx=0 tx=0).stop 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 msgr2=0x7fb8f01e7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8000c00 tx=0x7fb8d8004750 comp rx=0 tx=0).stop 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 shutdown_connections 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f0154b40 0x7fb8f00a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8f00c13a0 0x7fb8f01e7c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 --2- 172.21.15.121:0/2383257728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8f01520a0 0x7fb8f00bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 >> 172.21.15.121:0/2383257728 conn(0x7fb8f00a7ae0 msgr2=0x7fb8f0154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 shutdown_connections 2023-08-18T20:43:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.517+0000 7fb8f5655700 1 -- 172.21.15.121:0/2383257728 wait complete. 2023-08-18T20:43:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:43:58.529 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:43:58.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.648+0000 7f270bbc8700 1 Processor -- start 2023-08-18T20:43:58.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.648+0000 7f270bbc8700 1 -- start start 2023-08-18T20:43:58.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f270bbc8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2704152fa0 0x7f27040c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f270bbc8700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f27040a71f0 0x7f27040c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f270bbc8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2704152200 con 0x7f27040c4170 2023-08-18T20:43:58.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f270bbc8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27040aa740 con 0x7f2704152fa0 2023-08-18T20:43:58.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f270bbc8700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27041565c0 con 0x7f27040a71f0 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f2709163700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2704152fa0 0x7f27040c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f2709163700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2704152fa0 0x7f27040c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40702/0 (socket says 172.21.15.121:40702) 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.649+0000 7f2709163700 1 -- 172.21.15.121:0/1769963876 learned_addr learned my addr 172.21.15.121:0/1769963876 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270a165700 1 --2- 172.21.15.121:0/1769963876 >> v2:172.21.15.122:3300/0 conn(0x7f27040a71f0 0x7f27040c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2709163700 1 -- 172.21.15.121:0/1769963876 >> v2:172.21.15.122:3300/0 conn(0x7f27040a71f0 msgr2=0x7f27040c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2709163700 1 --2- 172.21.15.121:0/1769963876 >> v2:172.21.15.122:3300/0 conn(0x7f27040a71f0 0x7f27040c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2709163700 1 -- 172.21.15.121:0/1769963876 >> v1:172.21.15.122:6789/0 conn(0x7f27040c4170 legacy=0x7f27040c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:58.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2709163700 1 -- 172.21.15.121:0/1769963876 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27041524c0 con 0x7f2704152fa0 2023-08-18T20:43:58.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2709163700 1 --2- 172.21.15.121:0/1769963876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2704152fa0 0x7f27040c4550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2704074280 tx=0x7f2700009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26da4457ec117497 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2708962700 1 -- 172.21.15.121:0/1769963876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700004230 con 0x7f2704152fa0 2023-08-18T20:43:58.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2708962700 1 -- 172.21.15.121:0/1769963876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700004390 con 0x7f2704152fa0 2023-08-18T20:43:58.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f2708962700 1 -- 172.21.15.121:0/1769963876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000036a0 con 0x7f2704152fa0 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 -- 172.21.15.121:0/1769963876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2704152fa0 msgr2=0x7f27040c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 --2- 172.21.15.121:0/1769963876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2704152fa0 0x7f27040c4550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2704074280 tx=0x7f2700009bd0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 -- 172.21.15.121:0/1769963876 shutdown_connections 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 --2- 172.21.15.121:0/1769963876 >> v2:172.21.15.122:3300/0 conn(0x7f27040a71f0 0x7f27040c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 --2- 172.21.15.121:0/1769963876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2704152fa0 0x7f27040c4550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.650+0000 7f270bbc8700 1 -- 172.21.15.121:0/1769963876 >> 172.21.15.121:0/1769963876 conn(0x7f27040a9a90 msgr2=0x7f27040a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.651+0000 7f270bbc8700 1 -- 172.21.15.121:0/1769963876 shutdown_connections 2023-08-18T20:43:58.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.651+0000 7f270bbc8700 1 -- 172.21.15.121:0/1769963876 wait complete. 2023-08-18T20:43:58.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 Processor -- start 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 -- start start 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27040a71f0 0x7f27040c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2704152fa0 0x7f270414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270414d190 con 0x7f27040c4170 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040a98a0 con 0x7f2704152fa0 2023-08-18T20:43:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270bbc8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040a9320 con 0x7f27040a71f0 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f2709163700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f2709163700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40708/0 (socket says 172.21.15.121:40708) 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f2709163700 1 -- 172.21.15.121:0/3879396112 learned_addr learned my addr 172.21.15.121:0/3879396112 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f2709964700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27040a71f0 0x7f27040c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.652+0000 7f270a165700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2704152fa0 0x7f270414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 -- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27040a71f0 msgr2=0x7f27040c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27040a71f0 0x7f27040c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 -- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2704152fa0 msgr2=0x7f270414c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2704152fa0 0x7f270414c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 -- 172.21.15.121:0/3879396112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009550 con 0x7f27040c4170 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f2709163700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f270406b340 tx=0x7f2700004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700003c90 con 0x7f27040c4170 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270001f070 con 0x7f27040c4170 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040a7b00 con 0x7f27040c4170 2023-08-18T20:43:58.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700011870 con 0x7f27040c4170 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.653+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27040a7da0 con 0x7f27040c4170 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.654+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040a7fc0 con 0x7f27040c4170 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.654+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2700021030 con 0x7f27040c4170 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.655+0000 7f26fa7fc700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.655+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27000899d0 con 0x7f27040c4170 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.655+0000 7f2709964700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.655+0000 7f2709964700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 0x7f26e806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f26f4007fd0 tx=0x7f26f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.659+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2700055150 con 0x7f27040c4170 2023-08-18T20:43:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.850+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f270404e620 con 0x7f27040c4170 2023-08-18T20:43:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.852+0000 7f26fa7fc700 1 -- 172.21.15.121:0/3879396112 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f2700058770 con 0x7f27040c4170 2023-08-18T20:43:58.852 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:58.853 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:43:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 msgr2=0x7f26e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 0x7f26e806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f26f4007fd0 tx=0x7f26f4009040 comp rx=0 tx=0).stop 2023-08-18T20:43:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 msgr2=0x7f27041eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f270406b340 tx=0x7f2700004750 comp rx=0 tx=0).stop 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 shutdown_connections 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2704152fa0 0x7f270414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27040a71f0 0x7f27040c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 --2- 172.21.15.121:0/3879396112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27040c4170 0x7f27041eb700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 >> 172.21.15.121:0/3879396112 conn(0x7f27040a9a90 msgr2=0x7f2704150800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 shutdown_connections 2023-08-18T20:43:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.854+0000 7f270bbc8700 1 -- 172.21.15.121:0/3879396112 wait complete. 2023-08-18T20:43:58.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:43:58.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.986+0000 7f97d3bf9700 1 Processor -- start 2023-08-18T20:43:58.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.986+0000 7f97d3bf9700 1 -- start start 2023-08-18T20:43:58.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d3bf9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 0x7f97cc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d3bf9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97cc157c10 0x7f97cc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d3bf9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc0c21f0 con 0x7f97cc06a510 2023-08-18T20:43:58.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d3bf9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc0c2ba0 con 0x7f97cc157c10 2023-08-18T20:43:58.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d3bf9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0c6300 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1995700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f97cc06a510 0x7f97cc151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47296/0 (socket says 172.21.15.121:47296) 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1995700 1 -- 172.21.15.121:0/3766330802 learned_addr learned my addr 172.21.15.121:0/3766330802 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1194700 1 --2- 172.21.15.121:0/3766330802 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 0x7f97cc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d2196700 1 --2- 172.21.15.121:0/3766330802 >> v2:172.21.15.122:3300/0 conn(0x7f97cc157c10 0x7f97cc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d0993700 1 -- 172.21.15.121:0/3766330802 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150915594 0 0) 0x7f97cc0c21f0 con 0x7f97cc06a510 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d0993700 1 -- 172.21.15.121:0/3766330802 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b80035b0 con 0x7f97cc06a510 2023-08-18T20:43:58.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1194700 1 -- 172.21.15.121:0/3766330802 >> v2:172.21.15.122:3300/0 conn(0x7f97cc157c10 msgr2=0x7f97cc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1194700 1 --2- 172.21.15.121:0/3766330802 >> v2:172.21.15.122:3300/0 conn(0x7f97cc157c10 0x7f97cc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1194700 1 -- 172.21.15.121:0/3766330802 >> v1:172.21.15.121:6789/0 conn(0x7f97cc06a510 legacy=0x7f97cc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.987+0000 7f97d1194700 1 -- 172.21.15.121:0/3766330802 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0c5b20 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d1194700 1 --2- 172.21.15.121:0/3766330802 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 0x7f97cc0c5490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009840 tx=0x7f97c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=290db07d5f45ea30 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d0993700 1 -- 172.21.15.121:0/3766330802 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8011830 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d0993700 1 -- 172.21.15.121:0/3766330802 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c8011990 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d0993700 1 -- 172.21.15.121:0/3766330802 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8011d20 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 -- 172.21.15.121:0/3766330802 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 msgr2=0x7f97cc0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/3766330802 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 0x7f97cc0c5490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009840 tx=0x7f97c8009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:58.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 -- 172.21.15.121:0/3766330802 shutdown_connections 2023-08-18T20:43:58.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/3766330802 >> v2:172.21.15.122:3300/0 conn(0x7f97cc157c10 0x7f97cc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/3766330802 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc0c1cf0 0x7f97cc0c5490 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 -- 172.21.15.121:0/3766330802 >> 172.21.15.121:0/3766330802 conn(0x7f97cc0c6b10 msgr2=0x7f97cc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:58.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 -- 172.21.15.121:0/3766330802 shutdown_connections 2023-08-18T20:43:58.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.988+0000 7f97d3bf9700 1 -- 172.21.15.121:0/3766330802 wait complete. 2023-08-18T20:43:58.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 Processor -- start 2023-08-18T20:43:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 -- start start 2023-08-18T20:43:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc06a510 0x7f97cc0ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 0x7f97cc154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a6ee0 con 0x7f97cc0c1cf0 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc1ea320 con 0x7f97cc06a510 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d3bf9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a7180 con 0x7f97cc157c10 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d1194700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d1194700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40722/0 (socket says 172.21.15.121:40722) 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d1194700 1 -- 172.21.15.121:0/1823322378 learned_addr learned my addr 172.21.15.121:0/1823322378 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.990+0000 7f97d1995700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc06a510 0x7f97cc0ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d2196700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 0x7f97cc154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:58.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 -- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 msgr2=0x7f97cc154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 0x7f97cc154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 -- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc06a510 msgr2=0x7f97cc0ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:58.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc06a510 0x7f97cc0ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:58.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 -- 172.21.15.121:0/1823322378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c80094a0 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d2196700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 0x7f97cc154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:59.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d1194700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97c80090b0 tx=0x7f97c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80036a0 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c801f070 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc1ea600 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8003a60 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.991+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc0abd60 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.992+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc0a7340 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.992+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f97c8003bc0 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.993+0000 7f97c27fc700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 0x7f97b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.993+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97c8021070 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.993+0000 7f97d1995700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 0x7f97b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.993+0000 7f97d1995700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 0x7f97b006c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:58.997+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f97c80553a0 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.231+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97cc0ac240 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.231+0000 7f97c27fc700 1 -- 172.21.15.121:0/1823322378 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7f97cc0ac240 con 0x7f97cc0c1cf0 2023-08-18T20:43:59.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:43:59.232 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:43:59.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.233+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 msgr2=0x7f97b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.233+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 0x7f97b006c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007dc0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.233+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 msgr2=0x7f97cc151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.233+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97c80090b0 tx=0x7f97c8004750 comp rx=0 tx=0).stop 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 shutdown_connections 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97cc157c10 0x7f97cc154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc06a510 0x7f97cc0ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f97b006a0e0 0x7f97b006c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 --2- 172.21.15.121:0/1823322378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97cc0c1cf0 0x7f97cc151c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 >> 172.21.15.121:0/1823322378 conn(0x7f97cc0c6b10 msgr2=0x7f97cc1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 shutdown_connections 2023-08-18T20:43:59.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.234+0000 7f97d3bf9700 1 -- 172.21.15.121:0/1823322378 wait complete. 2023-08-18T20:43:59.236 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:43:59.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-18T20:43:43.995422+0000', 'modified': '2023-08-18T20:43:47.615544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/2861878928', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2861878928}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2861878928}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-18T20:43:59.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-18T20:43:59.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-18T20:43:59.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.780+0000 7f39c1a15700 1 Processor -- start 2023-08-18T20:43:59.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.780+0000 7f39c1a15700 1 -- start start 2023-08-18T20:43:59.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39c1a15700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 0x7f39bc0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39c1a15700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 0x7f39bc151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39c1a15700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc150d80 con 0x7f39bc070150 2023-08-18T20:43:59.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39c1a15700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0c10c0 con 0x7f39bc0c37c0 2023-08-18T20:43:59.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39c1a15700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0c2510 con 0x7f39bc14a8c0 2023-08-18T20:43:59.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39ba7fc700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 0x7f39bc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39baffd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 0x7f39bc0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39bb7fe700 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f39bc070150 0x7f39bc06b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:56434/0 (socket says 172.21.15.121:56434) 2023-08-18T20:43:59.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.781+0000 7f39bb7fe700 1 -- 172.21.15.121:0/3263973269 learned_addr learned my addr 172.21.15.121:0/3263973269 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:43:59.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39baffd700 1 -- 172.21.15.121:0/3263973269 >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 msgr2=0x7f39bc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39baffd700 1 --2- 172.21.15.121:0/3263973269 >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 0x7f39bc151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39baffd700 1 -- 172.21.15.121:0/3263973269 >> v1:172.21.15.122:6789/0 conn(0x7f39bc070150 legacy=0x7f39bc06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39baffd700 1 -- 172.21.15.121:0/3263973269 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0c2a90 con 0x7f39bc14a8c0 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/3263973269 >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 0x7f39bc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39baffd700 1 --2- 172.21.15.121:0/3263973269 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 0x7f39bc0c0b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009840 tx=0x7f39ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab050b8d84617c04 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39b9ffb700 1 -- 172.21.15.121:0/3263973269 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011830 con 0x7f39bc14a8c0 2023-08-18T20:43:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39b9ffb700 1 -- 172.21.15.121:0/3263973269 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac011990 con 0x7f39bc14a8c0 2023-08-18T20:43:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39b9ffb700 1 -- 172.21.15.121:0/3263973269 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011d20 con 0x7f39bc14a8c0 2023-08-18T20:43:59.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39c1a15700 1 -- 172.21.15.121:0/3263973269 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 msgr2=0x7f39bc0c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.782+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3263973269 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 0x7f39bc0c0b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009840 tx=0x7f39ac009b50 comp rx=0 tx=0).stop 2023-08-18T20:43:59.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 -- 172.21.15.121:0/3263973269 shutdown_connections 2023-08-18T20:43:59.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3263973269 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc14a8c0 0x7f39bc0c0b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3263973269 >> v2:172.21.15.122:3300/0 conn(0x7f39bc0c37c0 0x7f39bc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 -- 172.21.15.121:0/3263973269 >> 172.21.15.121:0/3263973269 conn(0x7f39bc0c2ca0 msgr2=0x7f39bc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 -- 172.21.15.121:0/3263973269 shutdown_connections 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.783+0000 7f39c1a15700 1 -- 172.21.15.121:0/3263973269 wait complete. 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.784+0000 7f39c1a15700 1 Processor -- start 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.784+0000 7f39c1a15700 1 -- start start 2023-08-18T20:43:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc070150 0x7f39bc14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39bc14a8c0 0x7f39bc1e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc154da0 con 0x7f39bc0c37c0 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc14a160 con 0x7f39bc14a8c0 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39c1a15700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1e7650 con 0x7f39bc070150 2023-08-18T20:43:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40734/0 (socket says 172.21.15.121:40734) 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39ba7fc700 1 -- 172.21.15.121:0/3299178206 learned_addr learned my addr 172.21.15.121:0/3299178206 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39bc14a8c0 0x7f39bc1e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.785+0000 7f39baffd700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc070150 0x7f39bc14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 -- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc070150 msgr2=0x7f39bc14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc070150 0x7f39bc14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 -- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39bc14a8c0 msgr2=0x7f39bc1e7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39bc14a8c0 0x7f39bc1e7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 -- 172.21.15.121:0/3299178206 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009430 con 0x7f39bc0c37c0 2023-08-18T20:43:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f39b000ebe0 tx=0x7f39b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39a3fff700 1 -- 172.21.15.121:0/3299178206 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0005a20 con 0x7f39bc0c37c0 2023-08-18T20:43:59.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39a3fff700 1 -- 172.21.15.121:0/3299178206 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0005b80 con 0x7f39bc0c37c0 2023-08-18T20:43:59.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac0094a0 con 0x7f39bc0c37c0 2023-08-18T20:43:59.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39a3fff700 1 -- 172.21.15.121:0/3299178206 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000c850 con 0x7f39bc0c37c0 2023-08-18T20:43:59.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.786+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc1eb950 con 0x7f39bc0c37c0 2023-08-18T20:43:59.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.788+0000 7f39a3fff700 1 -- 172.21.15.121:0/3299178206 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39b000c9b0 con 0x7f39bc0c37c0 2023-08-18T20:43:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.788+0000 7f39a3fff700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 0x7f39a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.788+0000 7f39a3fff700 1 -- 172.21.15.121:0/3299178206 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39b00886d0 con 0x7f39bc0c37c0 2023-08-18T20:43:59.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.788+0000 7f39baffd700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 0x7f39a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.788+0000 7f39baffd700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 0x7f39a806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.790+0000 7f39cdbb0b80 1 Processor -- start 2023-08-18T20:43:59.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.790+0000 7f39cdbb0b80 1 -- start start 2023-08-18T20:43:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x5644187c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644186ed5e0 con 0x5644187d1ed0 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644186eaf00 con 0x5644187954d0 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644186e67f0 con 0x5644187958b0 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40744/0 (socket says 172.21.15.121:40744) 2023-08-18T20:43:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 -- 172.21.15.121:0/1170617875 learned_addr learned my addr 172.21.15.121:0/1170617875 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39baffd700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x5644187c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 -- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 msgr2=0x5644187da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 -- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 msgr2=0x5644187c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x5644187c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 -- 172.21.15.121:0/1170617875 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644185665e0 con 0x5644187d1ed0 2023-08-18T20:43:59.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39baffd700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x5644187c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:59.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:43:59.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39b005f2f0 tx=0x7f39b00574f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d50f1a2650c6032 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39a17fa700 1 -- 172.21.15.121:0/1170617875 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b005f820 con 0x5644187d1ed0 2023-08-18T20:43:59.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39a17fa700 1 -- 172.21.15.121:0/1170617875 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0055eb0 con 0x5644187d1ed0 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.791+0000 7f39a17fa700 1 -- 172.21.15.121:0/1170617875 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000ce80 con 0x5644187d1ed0 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/1170617875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 msgr2=0x5644187da220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39b005f2f0 tx=0x7f39b00574f0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/1170617875 shutdown_connections 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x5644187c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/1170617875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187da220 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/1170617875 >> 172.21.15.121:0/1170617875 conn(0x5644186c1900 msgr2=0x564418793010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/1170617875 shutdown_connections 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/1170617875 wait complete. 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.792+0000 7f39cdbb0b80 1 -- start start 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 Processor -- start 2023-08-18T20:43:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 0x5644187e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x564418684a70 con 0x5644187954d0 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564418684770 con 0x5644187d1ed0 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644185688d0 con 0x5644187958b0 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39baffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39cdbb0b80 10 client.0 _ll_register_callbacks cb 0x5644185cea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39baffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40748/0 (socket says 172.21.15.121:40748) 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39baffd700 1 -- 172.21.15.121:0/2256118215 learned_addr learned my addr 172.21.15.121:0/2256118215 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 0x5644187e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.793+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 -- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 msgr2=0x5644187d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 -- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 msgr2=0x5644187e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 0x5644187e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 -- 172.21.15.121:0/2256118215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc1eb950 con 0x5644187954d0 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 0x5644187e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39baffd700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0728a0 tx=0x7f39ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ad8965b979457a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac020070 con 0x5644187954d0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39ac004590 con 0x5644187954d0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564418787cb0 con 0x5644187954d0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ac003c90 con 0x5644187954d0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 10 client.4647 fetch_fsmap learned FSMap version 7 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564418512d90 con 0x5644187954d0 2023-08-18T20:43:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564418787cb0 con 0x5644187954d0 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39ac02f070 con 0x5644187954d0 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 10 client.4647 fetch_fsmap finished waiting for FSMap version 7 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 10 client.4647 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 20 client.4647 populate_metadata read hostname 'smithi121' 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187b6cb0 0x5644187cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 4 client.4647 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-18T20:43:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 --> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644186df7d0 con 0x5644187b6cb0 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.794+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187b6cb0 0x5644187cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f399a7fc700 10 client.4647 ms_handle_connect on v2:172.21.15.121:6834/2861878928 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187b6cb0 0x5644187cb860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada21db02610642b server_cookie=b510463d2aa84b8c in_seq=0 out_seq=0 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f399a7fc700 1 -- 172.21.15.121:0/2256118215 <== mds.0 v2:172.21.15.121:6834/2861878928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5644186df7d0 con 0x5644187b6cb0 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f399a7fc700 10 client.4647 handle_command_reply: tid=0 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 client.4647 shutdown 2023-08-18T20:43:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 msgr2=0x5644187e2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0728a0 tx=0x7f39ac0047c0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 shutdown_connections 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187d1ed0 0x5644187e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187b6cb0 0x5644187cb860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187954d0 0x5644187e2310 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2256118215 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f399a7fc700 0 client.4647 ms_handle_reset on v2:172.21.15.121:6834/2861878928 2023-08-18T20:43:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 >> 172.21.15.121:0/2256118215 conn(0x5644186c1900 msgr2=0x5644187b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 shutdown_connections 2023-08-18T20:43:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.795+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2256118215 wait complete. 2023-08-18T20:43:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.796+0000 7f39cdbb0b80 20 client.4647 trim_cache size 0 max 16384 2023-08-18T20:43:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.813+0000 7f39cdbb0b80 1 Processor -- start 2023-08-18T20:43:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.813+0000 7f39cdbb0b80 1 -- start start 2023-08-18T20:43:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x564418790980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187d1ed0 0x5644187cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644187c81c0 con 0x5644187958b0 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644187ca080 con 0x5644187954d0 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644187e3f70 con 0x5644187d1ed0 2023-08-18T20:43:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40758/0 (socket says 172.21.15.121:40758) 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 -- 172.21.15.121:0/475724144 learned_addr learned my addr 172.21.15.121:0/475724144 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39baffd700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x564418790980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187d1ed0 0x5644187cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 -- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187d1ed0 msgr2=0x5644187cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187d1ed0 0x5644187cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 -- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 msgr2=0x564418790980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x564418790980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 -- 172.21.15.121:0/475724144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564418791440 con 0x5644187958b0 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39baffd700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x564418790980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39b005f9e0 tx=0x7f39b0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2f3f78932718cb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.814+0000 7f39a1ffb700 1 -- 172.21.15.121:0/475724144 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b006eea0 con 0x5644187958b0 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39a1ffb700 1 -- 172.21.15.121:0/475724144 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000cc60 con 0x5644187958b0 2023-08-18T20:43:59.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39a1ffb700 1 -- 172.21.15.121:0/475724144 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0057000 con 0x5644187958b0 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/475724144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 msgr2=0x5644187b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39b005f9e0 tx=0x7f39b0059000 comp rx=0 tx=0).stop 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/475724144 shutdown_connections 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187d1ed0 0x5644187cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x564418790980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/475724144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187958b0 0x5644187b28b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/475724144 >> 172.21.15.121:0/475724144 conn(0x5644186c1900 msgr2=0x56441878b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/475724144 shutdown_connections 2023-08-18T20:43:59.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.815+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/475724144 wait complete. 2023-08-18T20:43:59.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 -- start start 2023-08-18T20:43:59.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 Processor -- start 2023-08-18T20:43:59.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x56441883d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644187c7e30 con 0x5644187d1ed0 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564418843a80 con 0x5644187954d0 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x564418790bf0 con 0x5644187958b0 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.816+0000 7f39cdbb0b80 10 client.0 _ll_register_callbacks cb 0x7f39ac011d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40766/0 (socket says 172.21.15.121:40766) 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 -- 172.21.15.121:0/2797373369 learned_addr learned my addr 172.21.15.121:0/2797373369 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:43:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39baffd700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x56441883d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39ba7fc700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 -- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 msgr2=0x5644187cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 -- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 msgr2=0x56441883d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:43:59.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x56441883d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 -- 172.21.15.121:0/2797373369 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644185665e0 con 0x5644187d1ed0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39bb7fe700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39b4014570 tx=0x7f39b4014880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c727f8de85eb2897 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4017460 con 0x5644187d1ed0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39b40175c0 con 0x5644187d1ed0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b0055eb0 con 0x5644187d1ed0 2023-08-18T20:43:59.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b4017780 con 0x5644187d1ed0 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 10 client.4653 fetch_fsmap learned FSMap version 7 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5644184fbc10 con 0x5644187d1ed0 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0055eb0 con 0x5644187d1ed0 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39b4017b30 con 0x5644187d1ed0 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-18T20:43:59.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 20 client.4653 populate_metadata read hostname 'smithi121' 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187d55a0 0x5644187c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 4 client.4653 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.817+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 --> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644186a0000 con 0x5644187d55a0 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39baffd700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187d55a0 0x5644187c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f399a7fc700 10 client.4653 ms_handle_connect on v2:172.21.15.121:6834/2861878928 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39baffd700 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187d55a0 0x5644187c8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9af721dd453624 server_cookie=b463f8fb4d51b32 in_seq=0 out_seq=0 2023-08-18T20:43:59.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f399a7fc700 1 -- 172.21.15.121:0/2797373369 <== mds.0 v2:172.21.15.121:6834/2861878928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5644186a0000 con 0x5644187d55a0 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f399a7fc700 10 client.4653 handle_command_reply: tid=0 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 client.4653 shutdown 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 msgr2=0x5644187d5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39b4014570 tx=0x7f39b4014880 comp rx=0 tx=0).stop 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 shutdown_connections 2023-08-18T20:43:59.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:6834/2861878928,v1:172.21.15.121:6835/2861878928] conn(0x5644187d55a0 0x5644187c8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5644187d1ed0 0x5644187d5060 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644187954d0 0x56441883d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f399a7fc700 0 client.4653 ms_handle_reset on v2:172.21.15.121:6834/2861878928 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 --2- 172.21.15.121:0/2797373369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5644187958b0 0x5644187cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 >> 172.21.15.121:0/2797373369 conn(0x5644186c1900 msgr2=0x56441878e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 shutdown_connections 2023-08-18T20:43:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 1 -- 172.21.15.121:0/2797373369 wait complete. 2023-08-18T20:43:59.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.818+0000 7f39cdbb0b80 20 client.4653 trim_cache size 0 max 16384 2023-08-18T20:43:59.832 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-08-18T20:43:59.832 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "4755cd5f-6734-4b3f-8f96-cd10dcf8d04c", 2023-08-18T20:43:59.832 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4270, 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 15.226848931999999, 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 7, 2023-08-18T20:43:59.833 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 22, 2023-08-18T20:43:59.834 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 22, 2023-08-18T20:43:59.834 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 21.160010807999999 2023-08-18T20:43:59.834 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-08-18T20:43:59.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 msgr2=0x7f39a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 0x7f39a806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac008030 comp rx=0 tx=0).stop 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 msgr2=0x7f39bc144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f39b000ebe0 tx=0x7f39b000eef0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 shutdown_connections 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39bc14a8c0 0x7f39bc1e7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39bc070150 0x7f39bc14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f39a806a0e0 0x7f39a806c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 --2- 172.21.15.121:0/3299178206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39bc0c37c0 0x7f39bc144590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:43:59.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 >> 172.21.15.121:0/3299178206 conn(0x7f39bc0c2ca0 msgr2=0x7f39bc1502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:43:59.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 shutdown_connections 2023-08-18T20:43:59.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:43:59.819+0000 7f39c1a15700 1 -- 172.21.15.121:0/3299178206 wait complete. 2023-08-18T20:43:59.837 INFO:teuthology.run_tasks:Running task kclient... 2023-08-18T20:43:59.873 INFO:tasks.kclient:Mounting kernel clients... 2023-08-18T20:43:59.873 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-08-18T20:43:59.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:43:59.874 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-08-18T20:43:59.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:43:59.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2023-08-18T20:43:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2023-08-18T20:43:59.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:43:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:43:59.963 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:43:59.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:43:59.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2023-08-18T20:44:00.057 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2023-08-18T20:44:00.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-18T20:44:00.059 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-18T20:44:00.060 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-18T20:44:00.060 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:00.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:44:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.181+0000 7f0f5ed85700 1 Processor -- start 2023-08-18T20:44:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.181+0000 7f0f5ed85700 1 -- start start 2023-08-18T20:44:00.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5ed85700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f5806a510 0x7f0f580c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5ed85700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f58151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5ed85700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580c21f0 con 0x7f0f58151ec0 2023-08-18T20:44:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5ed85700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580c2ba0 con 0x7f0f5806a510 2023-08-18T20:44:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5ed85700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580c6300 con 0x7f0f580c1cf0 2023-08-18T20:44:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f5806a510 0x7f0f580c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f5806a510 0x7f0f580c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40770/0 (socket says 172.21.15.121:40770) 2023-08-18T20:44:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1120665058 learned_addr learned my addr 172.21.15.121:0/1120665058 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1120665058 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 msgr2=0x7f0f58151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f57fff700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f58151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f58151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1120665058 >> v1:172.21.15.122:6789/0 conn(0x7f0f58151ec0 legacy=0x7f0f58157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1120665058 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580c5b20 con 0x7f0f5806a510 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f5cb21700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f580c5490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098f0 tx=0x7f0f4c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9f82e40619402a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f577fe700 1 -- 172.21.15.121:0/1120665058 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c004230 con 0x7f0f5806a510 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f577fe700 1 -- 172.21.15.121:0/1120665058 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c004390 con 0x7f0f5806a510 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.182+0000 7f0f577fe700 1 -- 172.21.15.121:0/1120665058 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0036a0 con 0x7f0f5806a510 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1120665058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 msgr2=0x7f0f580c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f580c5490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098f0 tx=0x7f0f4c009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1120665058 shutdown_connections 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f580c5490 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1120665058 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f58151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1120665058 >> 172.21.15.121:0/1120665058 conn(0x7f0f580c6b10 msgr2=0x7f0f580c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1120665058 shutdown_connections 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.183+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1120665058 wait complete. 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.184+0000 7f0f5ed85700 1 Processor -- start 2023-08-18T20:44:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.184+0000 7f0f5ed85700 1 -- start start 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f581ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 0x7f0f58070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581ea860 con 0x7f0f5806a510 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581ece10 con 0x7f0f58151ec0 2023-08-18T20:44:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5ed85700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5806e490 con 0x7f0f580c1cf0 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40776/0 (socket says 172.21.15.121:40776) 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1431839832 learned_addr learned my addr 172.21.15.121:0/1431839832 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5d322700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 0x7f0f58070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 msgr2=0x7f0f581ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f57fff700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f581ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f581ea320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 msgr2=0x7f0f58070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 0x7f0f58070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5cb21700 1 -- 172.21.15.121:0/1431839832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009550 con 0x7f0f5806a510 2023-08-18T20:44:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.185+0000 7f0f5d322700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 0x7f0f58070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f5cb21700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009130 tx=0x7f0f4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00b860 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b9c0 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5806e770 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00bd70 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.186+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f581ed390 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.187+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58074730 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.187+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f4c01b440 con 0x7f0f5806a510 2023-08-18T20:44:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.187+0000 7f0f557fa700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 0x7f0f3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.188+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f4c089e80 con 0x7f0f5806a510 2023-08-18T20:44:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.188+0000 7f0f57fff700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 0x7f0f3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.188+0000 7f0f57fff700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 0x7f0f3c06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f580aa470 tx=0x7f0f44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.192+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0f4c0556b0 con 0x7f0f5806a510 2023-08-18T20:44:00.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.425+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f580c18c0 con 0x7f0f5806a510 2023-08-18T20:44:00.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.425+0000 7f0f557fa700 1 -- 172.21.15.121:0/1431839832 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f4c01f070 con 0x7f0f5806a510 2023-08-18T20:44:00.426 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:44:00.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 msgr2=0x7f0f3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:00.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 0x7f0f3c06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f580aa470 tx=0x7f0f44008040 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 msgr2=0x7f0f581ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009130 tx=0x7f0f4c004750 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 shutdown_connections 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f58151ec0 0x7f0f58070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0f3c06a0e0 0x7f0f3c06c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5806a510 0x7f0f581ed8b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 --2- 172.21.15.121:0/1431839832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0f580c1cf0 0x7f0f581ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:00.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 >> 172.21.15.121:0/1431839832 conn(0x7f0f580c6b10 msgr2=0x7f0f58156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 shutdown_connections 2023-08-18T20:44:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:00.428+0000 7f0f5ed85700 1 -- 172.21.15.121:0/1431839832 wait complete. 2023-08-18T20:44:00.440 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-18T20:44:00.441 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:44:00.441 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-08-18T20:44:00.442 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-18T20:44:00.442 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:00.443 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-18T20:44:00.443 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-18T20:44:00.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:44:00.444 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:44:00.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:00.445 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-08-18T20:44:00.464 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:44:00.464 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:44:00.465 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:44:00.465 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:00.465 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-08-18T20:44:00.465 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:00.466 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:00.467 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:00.467 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:00.468 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:00.468 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:00.469 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:00.469 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:44:00.470 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:00.470 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:44:00.471 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 41805sec preferred_lft 41805sec 2023-08-18T20:44:00.471 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::163e:4bc7:1f2c:54ec/64 scope link noprefixroute 2023-08-18T20:44:00.471 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:00.472 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-18T20:44:00.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:00.473 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:00.474 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:00.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2023-08-18T20:44:00.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2023-08-18T20:44:00.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2023-08-18T20:44:00.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-18T20:44:00.476 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:00.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:00.685 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:44:00.712 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-08-18T20:44:00.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:00.714 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-08-18T20:44:00.791 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-08-18T20:44:00.792 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:44:00.792 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:44:00.792 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:44:00.792 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:44:00.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:00.793 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:00.793 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:00.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:44:00.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:44:00.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:44:00.794 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:01.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.072 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-08-18T20:44:01.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.090 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2023-08-18T20:44:01.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.147 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:01.148 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:01.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-18T20:44:01.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-18T20:44:01.148 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:01.242 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-18T20:44:01.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.242 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:01.243 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:01.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-18T20:44:01.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-18T20:44:01.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-18T20:44:01.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-18T20:44:01.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-18T20:44:01.244 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:01.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.453 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:01.453 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:01.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-08-18T20:44:01.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2023-08-18T20:44:01.454 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:01.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:01.555 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:01.575 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:44:01.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:01.576 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:01.633 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-18T20:44:01.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:01.725 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:01.726 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:01.858 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:01.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:01.885 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:01.886 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:01.886 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:01.886 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:44:01.886 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:44:01.886 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:44:01.888 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:44:01.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.889 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:01.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:01.922 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:02.004 INFO:teuthology.orchestra.run.smithi121.stdout:client4662 2023-08-18T20:44:02.004 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:44:02.004 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:02.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.062 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:02.142 INFO:teuthology.orchestra.run.smithi121.stdout:client4662 2023-08-18T20:44:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.143 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:02.223 INFO:teuthology.orchestra.run.smithi121.stdout:client4662 2023-08-18T20:44:02.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.224 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.client4662/status') 2023-08-18T20:44:02.315 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4662 (3)192.168.0.1:0/1608684861 2023-08-18T20:44:02.315 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2023-08-18T20:44:02.316 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2023-08-18T20:44:02.316 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2023-08-18T20:44:02.317 INFO:teuthology.orchestra.run.smithi121.stderr:69 bytes copied, 2.106e-05 s, 3.3 MB/s 2023-08-18T20:44:02.317 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-18T20:44:02.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-18T20:44:02.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:02.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:44:02.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.436+0000 7f195bfc1700 1 Processor -- start 2023-08-18T20:44:02.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.437+0000 7f195bfc1700 1 -- start start 2023-08-18T20:44:02.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.437+0000 7f195bfc1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1954158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.437+0000 7f195bfc1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540c21f0 con 0x7f195406a510 2023-08-18T20:44:02.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.437+0000 7f195bfc1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540c5b20 con 0x7f19540c1cf0 2023-08-18T20:44:02.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.437+0000 7f195bfc1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c2ba0 con 0x7f19540c5490 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1959d5d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f195406a510 0x7f1954151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47376/0 (socket says 172.21.15.121:47376) 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1959d5d700 1 -- 172.21.15.121:0/2433335196 learned_addr learned my addr 172.21.15.121:0/2433335196 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f195a55e700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1954158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461684320 0 0) 0x7f19540c21f0 con 0x7f195406a510 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19400035b0 con 0x7f195406a510 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144768559 0 0) 0x7f19400035b0 con 0x7f195406a510 2023-08-18T20:44:02.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 msgr2=0x7f1954158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1954158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 >> v1:172.21.15.122:6789/0 conn(0x7f19540c1cf0 legacy=0x7f1954157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540c6510 con 0x7f195406a510 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1944001670 con 0x7f195406a510 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 >> v1:172.21.15.121:6789/0 conn(0x7f195406a510 legacy=0x7f1954151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1940003aa0 0x7f1940003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1940004850 0x7f1940004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1940005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194000bae0 con 0x7f1940004850 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194000bc50 con 0x7f1940003aa0 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194000be10 con 0x7f19540c5490 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f195955c700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1940004850 0x7f1940004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f1959d5d700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1940003aa0 0x7f1940003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f195a55e700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1940005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f195955c700 1 -- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 msgr2=0x7f1940005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.438+0000 7f195955c700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f19540c5490 0x7f1940005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195955c700 1 -- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1940003aa0 msgr2=0x7f1940003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195955c700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1940003aa0 0x7f1940003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195955c700 1 -- 172.21.15.121:0/2433335196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400035b0 con 0x7f1940004850 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195955c700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1940004850 0x7f1940004cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19500017c0 tx=0x7f1940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3489287f6125d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500052d0 con 0x7f1940004850 2023-08-18T20:44:02.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1950005430 con 0x7f1940004850 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f1958d5b700 1 -- 172.21.15.121:0/2433335196 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500038c0 con 0x7f1940004850 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 -- 172.21.15.121:0/2433335196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1940004850 msgr2=0x7f1940004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2433335196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1940004850 0x7f1940004cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19500017c0 tx=0x7f1940005880 comp rx=0 tx=0).stop 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195a55e700 1 -- 172.21.15.121:0/2433335196 reap_dead start 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 -- 172.21.15.121:0/2433335196 shutdown_connections 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 -- 172.21.15.121:0/2433335196 >> 172.21.15.121:0/2433335196 conn(0x7f19540c6b10 msgr2=0x7f19540c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 -- 172.21.15.121:0/2433335196 shutdown_connections 2023-08-18T20:44:02.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.439+0000 7f195bfc1700 1 -- 172.21.15.121:0/2433335196 wait complete. 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 Processor -- start 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 -- start start 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1940004850 0x7f19540a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19541551f0 0x7f19541495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195414a170 con 0x7f195406e7d0 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19541ea020 con 0x7f19541551f0 2023-08-18T20:44:02.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195bfc1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195414a350 con 0x7f1940004850 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195a55e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195a55e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40806/0 (socket says 172.21.15.121:40806) 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195a55e700 1 -- 172.21.15.121:0/2584753878 learned_addr learned my addr 172.21.15.121:0/2584753878 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.441+0000 7f195955c700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19541551f0 0x7f19541495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f1959d5d700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1940004850 0x7f19540a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 -- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1940004850 msgr2=0x7f19540a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1940004850 0x7f19540a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 -- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19541551f0 msgr2=0x7f19541495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19541551f0 0x7f19541495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 -- 172.21.15.121:0/2584753878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540aa7f0 con 0x7f195406e7d0 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195a55e700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f19540707c0 tx=0x7f194c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00e040 con 0x7f195406e7d0 2023-08-18T20:44:02.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00f040 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00fe30 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19541e9cb0 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.442+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540aa2b0 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.443+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954074730 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.443+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f194c022460 con 0x7f195406e7d0 2023-08-18T20:44:02.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.444+0000 7f194a7fc700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 0x7f193806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:02.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.444+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f194c088a30 con 0x7f195406e7d0 2023-08-18T20:44:02.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.444+0000 7f1959d5d700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 0x7f193806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:02.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.444+0000 7f1959d5d700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 0x7f193806c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1944007e50 tx=0x7f1944001510 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:02.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.448+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f194c054120 con 0x7f195406e7d0 2023-08-18T20:44:02.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.684+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19540c18c0 con 0x7f195406e7d0 2023-08-18T20:44:02.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.684+0000 7f194a7fc700 1 -- 172.21.15.121:0/2584753878 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f194c057740 con 0x7f195406e7d0 2023-08-18T20:44:02.685 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:44:02.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 msgr2=0x7f193806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 0x7f193806c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1944007e50 tx=0x7f1944001510 comp rx=0 tx=0).stop 2023-08-18T20:44:02.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 msgr2=0x7f1954149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:02.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f19540707c0 tx=0x7f194c011f60 comp rx=0 tx=0).stop 2023-08-18T20:44:02.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 shutdown_connections 2023-08-18T20:44:02.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f193806a0e0 0x7f193806c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f195406e7d0 0x7f1954149b00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1940004850 0x7f19540a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 --2- 172.21.15.121:0/2584753878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19541551f0 0x7f19541495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:02.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 >> 172.21.15.121:0/2584753878 conn(0x7f19540c6b10 msgr2=0x7f1954156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 shutdown_connections 2023-08-18T20:44:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:02.686+0000 7f195bfc1700 1 -- 172.21.15.121:0/2584753878 wait complete. 2023-08-18T20:44:02.699 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-18T20:44:02.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:44:02.700 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-08-18T20:44:02.700 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-18T20:44:02.701 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:02.701 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-18T20:44:02.701 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-18T20:44:02.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:44:02.702 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:44:02.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.703 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-08-18T20:44:02.725 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:44:02.726 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:44:02.727 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:44:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-08-18T20:44:02.728 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:02.729 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:02.729 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:02.729 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:02.730 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:02.730 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:02.730 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:44:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:44:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42209sec preferred_lft 42209sec 2023-08-18T20:44:02.731 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc56:1d53:8eb3:4926/64 scope link noprefixroute 2023-08-18T20:44:02.732 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:02.732 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-18T20:44:02.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.733 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:02.734 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:02.734 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2023-08-18T20:44:02.734 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2023-08-18T20:44:02.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2023-08-18T20:44:02.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-18T20:44:02.735 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:02.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.904 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:44:02.931 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:44:02.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:02.933 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-08-18T20:44:03.052 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-08-18T20:44:03.053 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:44:03.053 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:44:03.053 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:44:03.053 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:44:03.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.054 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:03.054 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:03.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:44:03.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:44:03.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:44:03.055 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:03.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.294 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:44:03.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.311 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2023-08-18T20:44:03.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.367 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:03.367 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:03.367 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-18T20:44:03.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-18T20:44:03.368 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:03.459 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-18T20:44:03.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.459 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:03.460 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:03.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-18T20:44:03.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-18T20:44:03.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-18T20:44:03.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-18T20:44:03.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-18T20:44:03.461 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:03.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.684 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:03.684 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:03.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-08-18T20:44:03.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2023-08-18T20:44:03.686 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:03.791 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:03.791 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:03.813 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:44:03.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:03.814 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:03.870 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-18T20:44:03.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:03.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:03.967 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:03.968 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:04.077 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:04.078 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:04.078 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:44:04.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:44:04.154 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:44:04.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:04.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:04.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:04.182 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:04.254 INFO:teuthology.orchestra.run.smithi122.stdout:client4671 2023-08-18T20:44:04.255 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:04.255 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:04.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:04.312 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:04.383 INFO:teuthology.orchestra.run.smithi122.stdout:client4671 2023-08-18T20:44:04.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:04.384 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:04.455 INFO:teuthology.orchestra.run.smithi122.stdout:client4671 2023-08-18T20:44:04.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:04.456 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.client4671/status') 2023-08-18T20:44:04.535 INFO:teuthology.orchestra.run.smithi122.stdout:instance: client.4671 (3)172.21.15.122:0/4230775741 2023-08-18T20:44:04.536 INFO:teuthology.orchestra.run.smithi122.stdout:blocklisted: false 2023-08-18T20:44:04.536 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records in 2023-08-18T20:44:04.536 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records out 2023-08-18T20:44:04.536 INFO:teuthology.orchestra.run.smithi122.stderr:71 bytes copied, 3.4045e-05 s, 2.1 MB/s 2023-08-18T20:44:04.537 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-18T20:44:04.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:04.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.690+0000 7f6d7cb36700 1 Processor -- start 2023-08-18T20:44:04.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.690+0000 7f6d7cb36700 1 -- start start 2023-08-18T20:44:04.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7cb36700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6d78152450 0x7f6d7814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:04.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7cb36700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d781529a0 con 0x7f6d780c7440 2023-08-18T20:44:04.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7cb36700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d78152c80 con 0x7f6d7806fd30 2023-08-18T20:44:04.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7cb36700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d78152f60 con 0x7f6d78152450 2023-08-18T20:44:04.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d75d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6d780c7440 0x7f6d7814f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47402/0 (socket says 172.21.15.121:47402) 2023-08-18T20:44:04.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d75d9b700 1 -- 172.21.15.121:0/2280472929 learned_addr learned my addr 172.21.15.121:0/2280472929 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:04.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d76d9d700 1 --2- 172.21.15.121:0/2280472929 >> v2:172.21.15.122:3300/0 conn(0x7f6d78152450 0x7f6d7814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:04.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143594304 0 0) 0x7f6d781529a0 con 0x7f6d780c7440 2023-08-18T20:44:04.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d600035b0 con 0x7f6d780c7440 2023-08-18T20:44:04.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d76d9d700 1 -- 172.21.15.121:0/2280472929 >> v1:172.21.15.122:6789/0 conn(0x7f6d7806fd30 legacy=0x7f6d780c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117809145 0 0) 0x7f6d78152c80 con 0x7f6d7806fd30 2023-08-18T20:44:04.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d76d9d700 1 -- 172.21.15.121:0/2280472929 >> v1:172.21.15.121:6789/0 conn(0x7f6d780c7440 legacy=0x7f6d7814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.691+0000 7f6d76d9d700 1 -- 172.21.15.121:0/2280472929 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78153240 con 0x7f6d78152450 2023-08-18T20:44:04.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d76d9d700 1 --2- 172.21.15.121:0/2280472929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d78152450 0x7f6d7814fac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d90 tx=0x7f6d7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813a6d5ac0db3bc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:04.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000e070 con 0x7f6d78152450 2023-08-18T20:44:04.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7000bb20 con 0x7f6d78152450 2023-08-18T20:44:04.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7559a700 1 -- 172.21.15.121:0/2280472929 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000bed0 con 0x7f6d78152450 2023-08-18T20:44:04.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7cb36700 1 -- 172.21.15.121:0/2280472929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d78152450 msgr2=0x7f6d7814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/2280472929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d78152450 0x7f6d7814fac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d90 tx=0x7f6d7000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:04.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7cb36700 1 -- 172.21.15.121:0/2280472929 shutdown_connections 2023-08-18T20:44:04.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.692+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/2280472929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d78152450 0x7f6d7814fac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.693+0000 7f6d7cb36700 1 -- 172.21.15.121:0/2280472929 >> 172.21.15.121:0/2280472929 conn(0x7f6d780c7bf0 msgr2=0x7f6d780c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:04.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.693+0000 7f6d7cb36700 1 -- 172.21.15.121:0/2280472929 shutdown_connections 2023-08-18T20:44:04.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.693+0000 7f6d7cb36700 1 -- 172.21.15.121:0/2280472929 wait complete. 2023-08-18T20:44:04.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.694+0000 7f6d7cb36700 1 Processor -- start 2023-08-18T20:44:04.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.694+0000 7f6d7cb36700 1 -- start start 2023-08-18T20:44:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d7806fd30 0x7f6d7814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d78152450 0x7f6d781ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781eb330 con 0x7f6d780c7440 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781e8f50 con 0x7f6d7806fd30 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781e8620 con 0x7f6d78152450 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40826/0 (socket says 172.21.15.121:40826) 2023-08-18T20:44:04.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 -- 172.21.15.121:0/865474051 learned_addr learned my addr 172.21.15.121:0/865474051 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d76d9d700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d78152450 0x7f6d781ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7659c700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d7806fd30 0x7f6d7814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 -- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d78152450 msgr2=0x7f6d781ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d78152450 0x7f6d781ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 -- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d7806fd30 msgr2=0x7f6d7814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d7806fd30 0x7f6d7814dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 -- 172.21.15.121:0/865474051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009a70 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d75d9b700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c4d0 tx=0x7f6d6800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68005d70 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d680070d0 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d781e8900 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68007440 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.695+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780a7ef0 con 0x7f6d780c7440 2023-08-18T20:44:04.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.696+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d781e90c0 con 0x7f6d780c7440 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.697+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6d680075a0 con 0x7f6d780c7440 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.697+0000 7f6d66ffd700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 0x7f6d5806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.697+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d68087880 con 0x7f6d780c7440 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.697+0000 7f6d7659c700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 0x7f6d5806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.698+0000 7f6d7659c700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 0x7f6d5806c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c007fd0 tx=0x7f6d6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:04.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.702+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6d68052fa0 con 0x7f6d780c7440 2023-08-18T20:44:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.894+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d78074730 con 0x7f6d780c7440 2023-08-18T20:44:04.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.895+0000 7f6d66ffd700 1 -- 172.21.15.121:0/865474051 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f6d680565c0 con 0x7f6d780c7440 2023-08-18T20:44:04.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:04.896 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 msgr2=0x7f6d5806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 0x7f6d5806c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c007fd0 tx=0x7f6d6c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 msgr2=0x7f6d7814e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c4d0 tx=0x7f6d6800c7e0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 shutdown_connections 2023-08-18T20:44:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d78152450 0x7f6d781ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d7806fd30 0x7f6d7814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6d5806a110 0x7f6d5806c5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 --2- 172.21.15.121:0/865474051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d780c7440 0x7f6d7814e1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 >> 172.21.15.121:0/865474051 conn(0x7f6d780c7bf0 msgr2=0x7f6d781557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 shutdown_connections 2023-08-18T20:44:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:04.897+0000 7f6d7cb36700 1 -- 172.21.15.121:0/865474051 wait complete. 2023-08-18T20:44:04.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:04.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.037+0000 7fe5dd8f7700 1 Processor -- start 2023-08-18T20:44:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.037+0000 7fe5dd8f7700 1 -- start start 2023-08-18T20:44:05.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5dd8f7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe5d80c5a90 0x7fe5d80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5dd8f7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d81554d0 con 0x7fe5d8155070 2023-08-18T20:44:05.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5dd8f7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d806f920 con 0x7fe5d814e6c0 2023-08-18T20:44:05.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5dd8f7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d806e980 con 0x7fe5d80c5a90 2023-08-18T20:44:05.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5d67fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe5d8155070 0x7fe5d80c7b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47414/0 (socket says 172.21.15.121:47414) 2023-08-18T20:44:05.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5d67fc700 1 -- 172.21.15.121:0/2052311535 learned_addr learned my addr 172.21.15.121:0/2052311535 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.038+0000 7fe5d77fe700 1 --2- 172.21.15.121:0/2052311535 >> v2:172.21.15.122:3300/0 conn(0x7fe5d80c5a90 0x7fe5d80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759964315 0 0) 0x7fe5d81554d0 con 0x7fe5d8155070 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c00035b0 con 0x7fe5d8155070 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147745960 0 0) 0x7fe5c00035b0 con 0x7fe5d8155070 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d77fe700 1 -- 172.21.15.121:0/2052311535 >> v1:172.21.15.122:6789/0 conn(0x7fe5d814e6c0 legacy=0x7fe5d80a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d77fe700 1 -- 172.21.15.121:0/2052311535 >> v1:172.21.15.121:6789/0 conn(0x7fe5d8155070 legacy=0x7fe5d80c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d77fe700 1 -- 172.21.15.121:0/2052311535 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d806eb60 con 0x7fe5d80c5a90 2023-08-18T20:44:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d77fe700 1 --2- 172.21.15.121:0/2052311535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d80c5ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009d90 tx=0x7fe5d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d91a1a851d3bd41 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000e070 con 0x7fe5d80c5a90 2023-08-18T20:44:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0003a20 con 0x7fe5d80c5a90 2023-08-18T20:44:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.039+0000 7fe5d5ffb700 1 -- 172.21.15.121:0/2052311535 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8001670 con 0x7fe5d80c5a90 2023-08-18T20:44:05.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/2052311535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 msgr2=0x7fe5d80c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/2052311535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d80c5ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009d90 tx=0x7fe5d000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/2052311535 shutdown_connections 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/2052311535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d80c5ea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/2052311535 >> 172.21.15.121:0/2052311535 conn(0x7fe5d80a96a0 msgr2=0x7fe5d80a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/2052311535 shutdown_connections 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.040+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/2052311535 wait complete. 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.041+0000 7fe5dd8f7700 1 Processor -- start 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.041+0000 7fe5dd8f7700 1 -- start start 2023-08-18T20:44:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d81eb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5d814e6c0 0x7fe5d8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d806c740 con 0x7fe5d8155070 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d814edb0 con 0x7fe5d80c5a90 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5dd8f7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81512a0 con 0x7fe5d814e6c0 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40838/0 (socket says 172.21.15.121:40838) 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 -- 172.21.15.121:0/819140991 learned_addr learned my addr 172.21.15.121:0/819140991 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d67fc700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5d814e6c0 0x7fe5d8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d6ffd700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d81eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 -- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5d814e6c0 msgr2=0x7fe5d8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5d814e6c0 0x7fe5d8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 -- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 msgr2=0x7fe5d81eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d81eb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 -- 172.21.15.121:0/819140991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0009a70 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.042+0000 7fe5d77fe700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b370 tx=0x7fe5d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.043+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0009450 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.043+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0004560 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.043+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0004910 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.043+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d8151580 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.043+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d814eaa0 con 0x7fe5d8155070 2023-08-18T20:44:05.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.044+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d806c880 con 0x7fe5d8155070 2023-08-18T20:44:05.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.044+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5d0012450 con 0x7fe5d8155070 2023-08-18T20:44:05.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.044+0000 7fe5bffff700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 0x7fe5c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.044+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5d0089d40 con 0x7fe5d8155070 2023-08-18T20:44:05.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.044+0000 7fe5d6ffd700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 0x7fe5c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.045+0000 7fe5d6ffd700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 0x7fe5c406c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007fd0 tx=0x7fe5cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.049+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe5d806c880 con 0x7fe5d8155070 2023-08-18T20:44:05.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.237+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5d806c880 con 0x7fe5d8155070 2023-08-18T20:44:05.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.238+0000 7fe5bffff700 1 -- 172.21.15.121:0/819140991 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5d806c880 con 0x7fe5d8155070 2023-08-18T20:44:05.239 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:05.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 msgr2=0x7fe5c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 0x7fe5c406c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007fd0 tx=0x7fe5cc009040 comp rx=0 tx=0).stop 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 msgr2=0x7fe5d8157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b370 tx=0x7fe5d0004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 shutdown_connections 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe5c406a0e0 0x7fe5c406c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d8155070 0x7fe5d8157eb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d80c5a90 0x7fe5d81eb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 --2- 172.21.15.121:0/819140991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5d814e6c0 0x7fe5d8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 >> 172.21.15.121:0/819140991 conn(0x7fe5d80a96a0 msgr2=0x7fe5d814d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 shutdown_connections 2023-08-18T20:44:05.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.240+0000 7fe5dd8f7700 1 -- 172.21.15.121:0/819140991 wait complete. 2023-08-18T20:44:05.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.376+0000 7fa886462700 1 Processor -- start 2023-08-18T20:44:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.376+0000 7fa886462700 1 -- start start 2023-08-18T20:44:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa886462700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8800c7ca0 0x7fa8801543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa886462700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 0x7fa88015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa886462700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8800ca4a0 con 0x7fa880151b10 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa886462700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88006c0f0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa886462700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa880158540 con 0x7fa880154900 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa87f7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8800c7ca0 0x7fa8801543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa8849ff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 0x7fa88015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa87f7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8800c7ca0 0x7fa8801543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50686/0 (socket says 172.21.15.121:50686) 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa8849ff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 0x7fa88015ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37260/0 (socket says 172.21.15.121:37260) 2023-08-18T20:44:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.377+0000 7fa87f7fe700 1 -- 172.21.15.121:0/3187152593 learned_addr learned my addr 172.21.15.121:0/3187152593 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87f7fe700 1 -- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 msgr2=0x7fa88015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87f7fe700 1 --2- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 0x7fa88015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87f7fe700 1 -- 172.21.15.121:0/3187152593 >> v1:172.21.15.122:6789/0 conn(0x7fa880151b10 legacy=0x7fa8800c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87f7fe700 1 -- 172.21.15.121:0/3187152593 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880158820 con 0x7fa8800c7ca0 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87f7fe700 1 --2- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8800c7ca0 0x7fa8801543c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92cd569102a99b0a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87effd700 1 -- 172.21.15.121:0/3187152593 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011830 con 0x7fa8800c7ca0 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87effd700 1 -- 172.21.15.121:0/3187152593 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870011990 con 0x7fa8800c7ca0 2023-08-18T20:44:05.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.378+0000 7fa87effd700 1 -- 172.21.15.121:0/3187152593 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011d20 con 0x7fa8800c7ca0 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 -- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8800c7ca0 msgr2=0x7fa8801543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 --2- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8800c7ca0 0x7fa8801543c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 -- 172.21.15.121:0/3187152593 shutdown_connections 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 --2- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880154900 0x7fa88015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 --2- 172.21.15.121:0/3187152593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8800c7ca0 0x7fa8801543c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 -- 172.21.15.121:0/3187152593 >> 172.21.15.121:0/3187152593 conn(0x7fa880071bb0 msgr2=0x7fa880071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 -- 172.21.15.121:0/3187152593 shutdown_connections 2023-08-18T20:44:05.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.379+0000 7fa886462700 1 -- 172.21.15.121:0/3187152593 wait complete. 2023-08-18T20:44:05.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.380+0000 7fa886462700 1 Processor -- start 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.380+0000 7fa886462700 1 -- start start 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880151b10 0x7fa880156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa880154900 0x7fa88014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800bf250 con 0x7fa8800c7ca0 2023-08-18T20:44:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801e9940 con 0x7fa880154900 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88014ee50 con 0x7fa880151b10 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40852/0 (socket says 172.21.15.121:40852) 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 -- 172.21.15.121:0/3498816409 learned_addr learned my addr 172.21.15.121:0/3498816409 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87f7fe700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880151b10 0x7fa880156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa8849ff700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa880154900 0x7fa88014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 -- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880151b10 msgr2=0x7fa880156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880151b10 0x7fa880156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 -- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa880154900 msgr2=0x7fa88014bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa880154900 0x7fa88014bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 -- 172.21.15.121:0/3498816409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009550 con 0x7fa8800c7ca0 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87ffff700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c4e0 tx=0x7fa87400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740052d0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874005430 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8801ea1a0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740038c0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.381+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88014e890 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.382+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa880074730 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.383+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa874003a20 con 0x7fa8800c7ca0 2023-08-18T20:44:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.383+0000 7fa87cff9700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 0x7fa86c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.383+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa874087810 con 0x7fa8800c7ca0 2023-08-18T20:44:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.383+0000 7fa87f7fe700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 0x7fa86c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.384+0000 7fa87f7fe700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 0x7fa86c06c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8800c8100 tx=0x7fa870008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.388+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa874052f90 con 0x7fa8800c7ca0 2023-08-18T20:44:05.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.577+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa88006c2e0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.577+0000 7fa87cff9700 1 -- 172.21.15.121:0/3498816409 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8740565b0 con 0x7fa8800c7ca0 2023-08-18T20:44:05.578 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:05.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 msgr2=0x7fa86c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 0x7fa86c06c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8800c8100 tx=0x7fa870008030 comp rx=0 tx=0).stop 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 msgr2=0x7fa8800c0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c4e0 tx=0x7fa87400c7f0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 shutdown_connections 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa880154900 0x7fa88014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa86c06a110 0x7fa86c06c5d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8800c7ca0 0x7fa8800c0330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 --2- 172.21.15.121:0/3498816409 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa880151b10 0x7fa880156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 >> 172.21.15.121:0/3498816409 conn(0x7fa880071bb0 msgr2=0x7fa8800c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 shutdown_connections 2023-08-18T20:44:05.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.579+0000 7fa886462700 1 -- 172.21.15.121:0/3498816409 wait complete. 2023-08-18T20:44:05.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:05.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.714+0000 7f51be5d6700 1 Processor -- start 2023-08-18T20:44:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.714+0000 7f51be5d6700 1 -- start start 2023-08-18T20:44:05.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51be5d6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51b814fb90 0x7f51b80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51be5d6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51b8152250 0x7f51b806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51be5d6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b8155970 con 0x7f51b806a7e0 2023-08-18T20:44:05.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51be5d6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b814ff70 con 0x7f51b814fb90 2023-08-18T20:44:05.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51be5d6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b806e830 con 0x7f51b8152250 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51b814fb90 0x7f51b80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51bcb73700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f51b806a7e0 0x7f51b8155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47446/0 (socket says 172.21.15.121:47446) 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51bcb73700 1 -- 172.21.15.121:0/1830306587 learned_addr learned my addr 172.21.15.121:0/1830306587 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b77fe700 1 --2- 172.21.15.121:0/1830306587 >> v2:172.21.15.122:3300/0 conn(0x7f51b8152250 0x7f51b806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b6ffd700 1 -- 172.21.15.121:0/1830306587 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714389725 0 0) 0x7f51b8155970 con 0x7f51b806a7e0 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b6ffd700 1 -- 172.21.15.121:0/1830306587 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a00035b0 con 0x7f51b806a7e0 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 -- 172.21.15.121:0/1830306587 >> v2:172.21.15.122:3300/0 conn(0x7f51b8152250 msgr2=0x7f51b806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:05.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 --2- 172.21.15.121:0/1830306587 >> v2:172.21.15.122:3300/0 conn(0x7f51b8152250 0x7f51b806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 -- 172.21.15.121:0/1830306587 >> v1:172.21.15.121:6789/0 conn(0x7f51b806a7e0 legacy=0x7f51b8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 -- 172.21.15.121:0/1830306587 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b806df90 con 0x7f51b814fb90 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b7fff700 1 --2- 172.21.15.121:0/1830306587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b814fb90 0x7f51b80c5d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51b80acdc0 tx=0x7f51ac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330597719c1d92f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b6ffd700 1 -- 172.21.15.121:0/1830306587 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac011830 con 0x7f51b814fb90 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b6ffd700 1 -- 172.21.15.121:0/1830306587 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac011990 con 0x7f51b814fb90 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.715+0000 7f51b6ffd700 1 -- 172.21.15.121:0/1830306587 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac011d20 con 0x7f51b814fb90 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 -- 172.21.15.121:0/1830306587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b814fb90 msgr2=0x7f51b80c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 --2- 172.21.15.121:0/1830306587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b814fb90 0x7f51b80c5d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51b80acdc0 tx=0x7f51ac009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 -- 172.21.15.121:0/1830306587 shutdown_connections 2023-08-18T20:44:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 --2- 172.21.15.121:0/1830306587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b814fb90 0x7f51b80c5d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 --2- 172.21.15.121:0/1830306587 >> v2:172.21.15.122:3300/0 conn(0x7f51b8152250 0x7f51b806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 -- 172.21.15.121:0/1830306587 >> 172.21.15.121:0/1830306587 conn(0x7f51b80c6b10 msgr2=0x7f51b80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 -- 172.21.15.121:0/1830306587 shutdown_connections 2023-08-18T20:44:05.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.716+0000 7f51be5d6700 1 -- 172.21.15.121:0/1830306587 wait complete. 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.717+0000 7f51be5d6700 1 Processor -- start 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.717+0000 7f51be5d6700 1 -- start start 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51b806a7e0 0x7f51b814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51b814fb90 0x7f51b81e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b81edab0 con 0x7f51b8152250 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80bff20 con 0x7f51b814fb90 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51be5d6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80c0200 con 0x7f51b806a7e0 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40868/0 (socket says 172.21.15.121:40868) 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 -- 172.21.15.121:0/2258609016 learned_addr learned my addr 172.21.15.121:0/2258609016 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51b7fff700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51b806a7e0 0x7f51b814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51b77fe700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51b814fb90 0x7f51b81e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 -- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51b806a7e0 msgr2=0x7f51b814ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51b806a7e0 0x7f51b814ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 -- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51b814fb90 msgr2=0x7f51b81e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51b814fb90 0x7f51b81e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.718+0000 7f51bcb73700 1 -- 172.21.15.121:0/2258609016 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0094a0 con 0x7f51b8152250 2023-08-18T20:44:05.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51bcb73700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51b000caa0 tx=0x7f51b000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000a9e0 con 0x7f51b8152250 2023-08-18T20:44:05.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000ab40 con 0x7f51b8152250 2023-08-18T20:44:05.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b81e97b0 con 0x7f51b8152250 2023-08-18T20:44:05.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0012400 con 0x7f51b8152250 2023-08-18T20:44:05.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.719+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b80c04e0 con 0x7f51b8152250 2023-08-18T20:44:05.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.720+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b81e99f0 con 0x7f51b8152250 2023-08-18T20:44:05.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.720+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51b001b3b0 con 0x7f51b8152250 2023-08-18T20:44:05.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.720+0000 7f51b4ff9700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 0x7f51a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:05.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.720+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51b00881b0 con 0x7f51b8152250 2023-08-18T20:44:05.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.721+0000 7f51b7fff700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 0x7f51a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:05.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.721+0000 7f51b7fff700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 0x7f51a406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0090b0 tx=0x7f51ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:05.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.725+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f51b00538d0 con 0x7f51b8152250 2023-08-18T20:44:05.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.917+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51b8074730 con 0x7f51b8152250 2023-08-18T20:44:05.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.917+0000 7f51b4ff9700 1 -- 172.21.15.121:0/2258609016 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51b0056ef0 con 0x7f51b8152250 2023-08-18T20:44:05.918 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:05.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 msgr2=0x7f51a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 0x7f51a406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0090b0 tx=0x7f51ac008030 comp rx=0 tx=0).stop 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 msgr2=0x7f51b81ea210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51b000caa0 tx=0x7f51b000cdb0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 shutdown_connections 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f51a406a0e0 0x7f51a406c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b8152250 0x7f51b81ea210 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51b806a7e0 0x7f51b814ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 --2- 172.21.15.121:0/2258609016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51b814fb90 0x7f51b81e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:05.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.919+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 >> 172.21.15.121:0/2258609016 conn(0x7f51b80c6b10 msgr2=0x7f51b814e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:05.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.920+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 shutdown_connections 2023-08-18T20:44:05.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:05.920+0000 7f51be5d6700 1 -- 172.21.15.121:0/2258609016 wait complete. 2023-08-18T20:44:05.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:06.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.057+0000 7f81452f3700 1 Processor -- start 2023-08-18T20:44:06.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.057+0000 7f81452f3700 1 -- start start 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f81452f3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8140151b10 0x7f81400c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f81452f3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f81400c4c60 0x7f8140154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f81452f3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81400ca4a0 con 0x7f81400c7ca0 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f81452f3700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814006c0f0 con 0x7f81400c4c60 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f81452f3700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8140158540 con 0x7f8140151b10 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f81400c4c60 0x7f8140154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813e7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f81400c7ca0 0x7f81401543c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47456/0 (socket says 172.21.15.121:47456) 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813e7fc700 1 -- 172.21.15.121:0/2156227891 learned_addr learned my addr 172.21.15.121:0/2156227891 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 -- 172.21.15.121:0/2156227891 >> v2:172.21.15.122:3300/0 conn(0x7f8140151b10 msgr2=0x7f81400c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 --2- 172.21.15.121:0/2156227891 >> v2:172.21.15.122:3300/0 conn(0x7f8140151b10 0x7f81400c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 -- 172.21.15.121:0/2156227891 >> v1:172.21.15.121:6789/0 conn(0x7f81400c7ca0 legacy=0x7f81401543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 -- 172.21.15.121:0/2156227891 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140158820 con 0x7f81400c4c60 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813dffb700 1 -- 172.21.15.121:0/2156227891 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334794651 0 0) 0x7f81400ca4a0 con 0x7f81400c7ca0 2023-08-18T20:44:06.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813f7fe700 1 --2- 172.21.15.121:0/2156227891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c4c60 0x7f8140154ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f81400c8410 tx=0x7f813800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b97d09d29aab3d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.058+0000 7f813dffb700 1 -- 172.21.15.121:0/2156227891 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800e070 con 0x7f81400c4c60 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f813dffb700 1 -- 172.21.15.121:0/2156227891 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813800bbd0 con 0x7f81400c4c60 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f813dffb700 1 -- 172.21.15.121:0/2156227891 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138012430 con 0x7f81400c4c60 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 -- 172.21.15.121:0/2156227891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c4c60 msgr2=0x7f8140154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 --2- 172.21.15.121:0/2156227891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c4c60 0x7f8140154ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f81400c8410 tx=0x7f813800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 -- 172.21.15.121:0/2156227891 shutdown_connections 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 --2- 172.21.15.121:0/2156227891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c4c60 0x7f8140154ad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 --2- 172.21.15.121:0/2156227891 >> v2:172.21.15.122:3300/0 conn(0x7f8140151b10 0x7f81400c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 -- 172.21.15.121:0/2156227891 >> 172.21.15.121:0/2156227891 conn(0x7f8140071bb0 msgr2=0x7f8140071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 -- 172.21.15.121:0/2156227891 shutdown_connections 2023-08-18T20:44:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.059+0000 7f81452f3700 1 -- 172.21.15.121:0/2156227891 wait complete. 2023-08-18T20:44:06.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.060+0000 7f81452f3700 1 Processor -- start 2023-08-18T20:44:06.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.060+0000 7f81452f3700 1 -- start start 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81400c4c60 0x7f81401ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8140151b10 0x7f81401ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400ab950 con 0x7f81400c7ca0 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400abc30 con 0x7f81400c4c60 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f81452f3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400abf10 con 0x7f8140151b10 2023-08-18T20:44:06.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40882/0 (socket says 172.21.15.121:40882) 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 -- 172.21.15.121:0/2133124375 learned_addr learned my addr 172.21.15.121:0/2133124375 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 -- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8140151b10 msgr2=0x7f81401ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813effd700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81400c4c60 0x7f81401ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8140151b10 0x7f81401ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 -- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81400c4c60 msgr2=0x7f81401ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81400c4c60 0x7f81401ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.061+0000 7f813e7fc700 1 -- 172.21.15.121:0/2133124375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138009a70 con 0x7f81400c7ca0 2023-08-18T20:44:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f813e7fc700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f813000c520 tx=0x7f813000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130004c80 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130004de0 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81401ecf20 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300072d0 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.062+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400aab40 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.063+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8140066e90 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.063+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8130007430 con 0x7f81400c7ca0 2023-08-18T20:44:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.063+0000 7f81277fe700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 0x7f812c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.064+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81300882b0 con 0x7f81400c7ca0 2023-08-18T20:44:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.064+0000 7f813effd700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 0x7f812c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.064+0000 7f813effd700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 0x7f812c06c5d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8134006fd0 tx=0x7f8134008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.068+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f81300539a0 con 0x7f81400c7ca0 2023-08-18T20:44:06.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.256+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81400ca910 con 0x7f81400c7ca0 2023-08-18T20:44:06.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.257+0000 7f81277fe700 1 -- 172.21.15.121:0/2133124375 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81400ca910 con 0x7f81400c7ca0 2023-08-18T20:44:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 msgr2=0x7f812c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 0x7f812c06c5d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8134006fd0 tx=0x7f8134008040 comp rx=0 tx=0).stop 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 msgr2=0x7f81401544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f813000c520 tx=0x7f813000c8e0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 shutdown_connections 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8140151b10 0x7f81401ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81400c4c60 0x7f81401ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f812c06a110 0x7f812c06c5d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 --2- 172.21.15.121:0/2133124375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81400c7ca0 0x7f81401544b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 >> 172.21.15.121:0/2133124375 conn(0x7f8140071bb0 msgr2=0x7f814014ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 shutdown_connections 2023-08-18T20:44:06.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.259+0000 7f81452f3700 1 -- 172.21.15.121:0/2133124375 wait complete. 2023-08-18T20:44:06.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:06.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.391+0000 7fb73aed1700 1 Processor -- start 2023-08-18T20:44:06.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.391+0000 7fb73aed1700 1 -- start start 2023-08-18T20:44:06.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb73aed1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb734072200 0x7fb7341525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb73aed1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb7340c37c0 0x7fb73415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb73aed1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73414eb70 con 0x7fb73414e790 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb73aed1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb734070790 con 0x7fb734072200 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb73aed1700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb734154830 con 0x7fb7340c37c0 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb734072200 0x7fb7341525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb734072200 0x7fb7341525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40890/0 (socket says 172.21.15.121:40890) 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 -- 172.21.15.121:0/2555960269 learned_addr learned my addr 172.21.15.121:0/2555960269 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 -- 172.21.15.121:0/2555960269 >> v2:172.21.15.122:3300/0 conn(0x7fb7340c37c0 msgr2=0x7fb73415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 --2- 172.21.15.121:0/2555960269 >> v2:172.21.15.122:3300/0 conn(0x7fb7340c37c0 0x7fb73415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 -- 172.21.15.121:0/2555960269 >> v1:172.21.15.122:6789/0 conn(0x7fb73414e790 legacy=0x7fb73406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 -- 172.21.15.121:0/2555960269 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734154b10 con 0x7fb734072200 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb733fff700 1 --2- 172.21.15.121:0/2555960269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341525b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb73406ece0 tx=0x7fb72000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab84143a2a8a43e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.392+0000 7fb7337fe700 1 -- 172.21.15.121:0/2555960269 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720005e30 con 0x7fb734072200 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb7337fe700 1 -- 172.21.15.121:0/2555960269 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000d8b0 con 0x7fb734072200 2023-08-18T20:44:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb7337fe700 1 -- 172.21.15.121:0/2555960269 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000dc40 con 0x7fb734072200 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 -- 172.21.15.121:0/2555960269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 msgr2=0x7fb7341525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 --2- 172.21.15.121:0/2555960269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341525b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb73406ece0 tx=0x7fb72000be70 comp rx=0 tx=0).stop 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 -- 172.21.15.121:0/2555960269 shutdown_connections 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 --2- 172.21.15.121:0/2555960269 >> v2:172.21.15.122:3300/0 conn(0x7fb7340c37c0 0x7fb73415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 --2- 172.21.15.121:0/2555960269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341525b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 -- 172.21.15.121:0/2555960269 >> 172.21.15.121:0/2555960269 conn(0x7fb7340c2ca0 msgr2=0x7fb7340c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 -- 172.21.15.121:0/2555960269 shutdown_connections 2023-08-18T20:44:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.393+0000 7fb73aed1700 1 -- 172.21.15.121:0/2555960269 wait complete. 2023-08-18T20:44:06.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.394+0000 7fb73aed1700 1 Processor -- start 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.394+0000 7fb73aed1700 1 -- start start 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7340c37c0 0x7fb73406e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 0x7fb734145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734150170 con 0x7fb734072200 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340ab590 con 0x7fb73414e790 2023-08-18T20:44:06.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73aed1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73414fbe0 con 0x7fb7340c37c0 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40894/0 (socket says 172.21.15.121:40894) 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 -- 172.21.15.121:0/826481483 learned_addr learned my addr 172.21.15.121:0/826481483 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb733fff700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7340c37c0 0x7fb73406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73946e700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 0x7fb734145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 -- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7340c37c0 msgr2=0x7fb73406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7340c37c0 0x7fb73406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 -- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 msgr2=0x7fb734145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 0x7fb734145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb738c6d700 1 -- 172.21.15.121:0/826481483 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72000b7a0 con 0x7fb734072200 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.395+0000 7fb73946e700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 0x7fb734145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb738c6d700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b4a0 tx=0x7fb72800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728011830 con 0x7fb734072200 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280119b0 con 0x7fb734072200 2023-08-18T20:44:06.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7340aafd0 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728011d60 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.396+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73414f870 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.397+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73414f6d0 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.397+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb72801a400 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.397+0000 7fb7317fa700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 0x7fb71806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.398+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7280885c0 con 0x7fb734072200 2023-08-18T20:44:06.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.398+0000 7fb733fff700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 0x7fb71806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.398+0000 7fb733fff700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 0x7fb71806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb734072620 tx=0x7fb72001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.402+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb73414f6d0 con 0x7fb734072200 2023-08-18T20:44:06.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.592+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb73414f6d0 con 0x7fb734072200 2023-08-18T20:44:06.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.594+0000 7fb7317fa700 1 -- 172.21.15.121:0/826481483 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fb73414f6d0 con 0x7fb734072200 2023-08-18T20:44:06.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:06.594 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:06.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 msgr2=0x7fb71806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 0x7fb71806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb734072620 tx=0x7fb72001c040 comp rx=0 tx=0).stop 2023-08-18T20:44:06.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 msgr2=0x7fb7341ea080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b4a0 tx=0x7fb72800b860 comp rx=0 tx=0).stop 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 shutdown_connections 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73414e790 0x7fb734145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb71806a0e0 0x7fb71806c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb734072200 0x7fb7341ea080 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 --2- 172.21.15.121:0/826481483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7340c37c0 0x7fb73406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 >> 172.21.15.121:0/826481483 conn(0x7fb7340c2ca0 msgr2=0x7fb7340c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 shutdown_connections 2023-08-18T20:44:06.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.595+0000 7fb73aed1700 1 -- 172.21.15.121:0/826481483 wait complete. 2023-08-18T20:44:06.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:06.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.731+0000 7f538915c700 1 Processor -- start 2023-08-18T20:44:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.731+0000 7f538915c700 1 -- start start 2023-08-18T20:44:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538915c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538414ed30 0x7f53840c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538915c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840c2260 con 0x7f5384070950 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538915c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384151d90 con 0x7f538414e950 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538915c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a6630 con 0x7f538414ed30 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538359e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5384070950 0x7f53840c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47488/0 (socket says 172.21.15.121:47488) 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538359e700 1 -- 172.21.15.121:0/4042785088 learned_addr learned my addr 172.21.15.121:0/4042785088 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538414ed30 0x7f53840c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906038911 0 0) 0x7f53840c2260 con 0x7f5384070950 2023-08-18T20:44:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c0035b0 con 0x7f5384070950 2023-08-18T20:44:06.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281659553 0 0) 0x7f5384151d90 con 0x7f538414e950 2023-08-18T20:44:06.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53840c2260 con 0x7f538414e950 2023-08-18T20:44:06.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.732+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005816503 0 0) 0x7f536c0035b0 con 0x7f5384070950 2023-08-18T20:44:06.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538414ed30 msgr2=0x7f53840c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538414ed30 0x7f53840c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 >> v1:172.21.15.122:6789/0 conn(0x7f538414e950 legacy=0x7f53840c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384152070 con 0x7f5384070950 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f537c0019f0 con 0x7f5384070950 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 >> v1:172.21.15.121:6789/0 conn(0x7f5384070950 legacy=0x7f53840c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c003bc0 0x7f536c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c005210 0x7f536c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a6630 con 0x7f536c004850 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c00c080 con 0x7f536c003bc0 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c00c240 con 0x7f536c005210 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538414ed30 0x7f53840c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5382d9d700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c003bc0 0x7f536c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538359e700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c005210 0x7f536c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 -- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c005210 msgr2=0x7f536c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c005210 0x7f536c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 -- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c003bc0 msgr2=0x7f536c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c003bc0 0x7f536c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 -- 172.21.15.121:0/4042785088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0035b0 con 0x7f536c004850 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f538259c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f536c004cd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f538414f150 tx=0x7f536c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c07df7c81abd24 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374004030 con 0x7f536c004850 2023-08-18T20:44:06.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374004190 con 0x7f536c004850 2023-08-18T20:44:06.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.733+0000 7f5381d9b700 1 -- 172.21.15.121:0/4042785088 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374004540 con 0x7f536c004850 2023-08-18T20:44:06.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 -- 172.21.15.121:0/4042785088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 msgr2=0x7f536c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 --2- 172.21.15.121:0/4042785088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f536c004cd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f538414f150 tx=0x7f536c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538359e700 1 -- 172.21.15.121:0/4042785088 reap_dead start 2023-08-18T20:44:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 -- 172.21.15.121:0/4042785088 shutdown_connections 2023-08-18T20:44:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 -- 172.21.15.121:0/4042785088 >> 172.21.15.121:0/4042785088 conn(0x7f53840c6b10 msgr2=0x7f53840c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 -- 172.21.15.121:0/4042785088 shutdown_connections 2023-08-18T20:44:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.734+0000 7f538915c700 1 -- 172.21.15.121:0/4042785088 wait complete. 2023-08-18T20:44:06.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.735+0000 7f538915c700 1 Processor -- start 2023-08-18T20:44:06.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.735+0000 7f538915c700 1 -- start start 2023-08-18T20:44:06.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538406a480 0x7f538406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f538406a900 0x7f538406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53841ede60 con 0x7f536c004850 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538406d2d0 con 0x7f538406a900 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538915c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538406ccc0 con 0x7f538406a480 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f5382d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f5382d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40914/0 (socket says 172.21.15.121:40914) 2023-08-18T20:44:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f5382d9d700 1 -- 172.21.15.121:0/3638435390 learned_addr learned my addr 172.21.15.121:0/3638435390 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538359e700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f538406a900 0x7f538406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.736+0000 7f538259c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538406a480 0x7f538406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 -- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538406a480 msgr2=0x7f538406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538406a480 0x7f538406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 -- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f538406a900 msgr2=0x7f538406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f538406a900 0x7f538406dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 -- 172.21.15.121:0/3638435390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53841d8240 con 0x7f536c004850 2023-08-18T20:44:06.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f5382d9d700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f537800f810 tx=0x7f537800fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780052e0 con 0x7f536c004850 2023-08-18T20:44:06.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378005440 con 0x7f536c004850 2023-08-18T20:44:06.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538406cf60 con 0x7f536c004850 2023-08-18T20:44:06.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780038c0 con 0x7f536c004850 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.737+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53841d7e80 con 0x7f536c004850 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.738+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384074730 con 0x7f536c004850 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.738+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5378003a20 con 0x7f536c004850 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.739+0000 7f536b7fe700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 0x7f537006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.739+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53780882b0 con 0x7f536c004850 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.739+0000 7f538259c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 0x7f537006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:06.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.739+0000 7f538259c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 0x7f537006c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5374016040 tx=0x7f537401f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:06.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.743+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5378053a30 con 0x7f536c004850 2023-08-18T20:44:06.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.936+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53840c1ff0 con 0x7f536c004850 2023-08-18T20:44:06.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.937+0000 7f536b7fe700 1 -- 172.21.15.121:0/3638435390 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5378057050 con 0x7f536c004850 2023-08-18T20:44:06.937 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:06.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 msgr2=0x7f537006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 0x7f537006c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5374016040 tx=0x7f537401f040 comp rx=0 tx=0).stop 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 msgr2=0x7f53841ed920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f537800f810 tx=0x7f537800fb20 comp rx=0 tx=0).stop 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 shutdown_connections 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f538406a900 0x7f538406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f537006a0e0 0x7f537006c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f536c004850 0x7f53841ed920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 --2- 172.21.15.121:0/3638435390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f538406a480 0x7f538406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:06.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 >> 172.21.15.121:0/3638435390 conn(0x7f53840c6b10 msgr2=0x7f538414e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:06.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 shutdown_connections 2023-08-18T20:44:06.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:06.939+0000 7f538915c700 1 -- 172.21.15.121:0/3638435390 wait complete. 2023-08-18T20:44:06.951 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 Processor -- start 2023-08-18T20:44:07.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 -- start start 2023-08-18T20:44:07.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8dec152450 0x7f8dec0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8dec1559c0 0x7f8dec14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec1529a0 con 0x7f8dec1559c0 2023-08-18T20:44:07.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec152c80 con 0x7f8dec152450 2023-08-18T20:44:07.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.074+0000 7f8df2350700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec152f60 con 0x7f8dec06fd30 2023-08-18T20:44:07.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8dec1559c0 0x7f8dec14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8dec1559c0 0x7f8dec14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40926/0 (socket says 172.21.15.121:40926) 2023-08-18T20:44:07.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 -- 172.21.15.121:0/917217963 learned_addr learned my addr 172.21.15.121:0/917217963 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:07.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8debfff700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8deb7fe700 1 --2- 172.21.15.121:0/917217963 >> v2:172.21.15.122:3300/0 conn(0x7f8dec152450 0x7f8dec0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 -- 172.21.15.121:0/917217963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 msgr2=0x7f8dec0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 -- 172.21.15.121:0/917217963 >> v2:172.21.15.122:3300/0 conn(0x7f8dec152450 msgr2=0x7f8dec0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 --2- 172.21.15.121:0/917217963 >> v2:172.21.15.122:3300/0 conn(0x7f8dec152450 0x7f8dec0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 -- 172.21.15.121:0/917217963 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec153240 con 0x7f8dec1559c0 2023-08-18T20:44:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8df08ed700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec14f3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0aa7a0 tx=0x7f8de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd266fcdf889eb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8deaffd700 1 -- 172.21.15.121:0/917217963 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400e070 con 0x7f8dec1559c0 2023-08-18T20:44:07.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8deaffd700 1 -- 172.21.15.121:0/917217963 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de400b9c0 con 0x7f8dec1559c0 2023-08-18T20:44:07.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.075+0000 7f8deaffd700 1 -- 172.21.15.121:0/917217963 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400bd70 con 0x7f8dec1559c0 2023-08-18T20:44:07.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 -- 172.21.15.121:0/917217963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 msgr2=0x7f8dec14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec14f3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0aa7a0 tx=0x7f8de400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:07.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 -- 172.21.15.121:0/917217963 shutdown_connections 2023-08-18T20:44:07.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec14f3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 --2- 172.21.15.121:0/917217963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 --2- 172.21.15.121:0/917217963 >> v2:172.21.15.122:3300/0 conn(0x7f8dec152450 0x7f8dec0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 -- 172.21.15.121:0/917217963 >> 172.21.15.121:0/917217963 conn(0x7f8dec0c7bf0 msgr2=0x7f8dec0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 -- 172.21.15.121:0/917217963 shutdown_connections 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.076+0000 7f8df2350700 1 -- 172.21.15.121:0/917217963 wait complete. 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.077+0000 7f8df2350700 1 Processor -- start 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.077+0000 7f8df2350700 1 -- start start 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec152450 0x7f8dec1e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec1edf60 con 0x7f8dec1559c0 2023-08-18T20:44:07.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec1ed350 con 0x7f8dec152450 2023-08-18T20:44:07.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df2350700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec1ed630 con 0x7f8dec06fd30 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40932/0 (socket says 172.21.15.121:40932) 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 -- 172.21.15.121:0/4031283266 learned_addr learned my addr 172.21.15.121:0/4031283266 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8debfff700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8deb7fe700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec152450 0x7f8dec1e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 -- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 msgr2=0x7f8dec0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 -- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec152450 msgr2=0x7f8dec1e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec152450 0x7f8dec1e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 -- 172.21.15.121:0/4031283266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009b30 con 0x7f8dec1559c0 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8df08ed700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8de4012000 tx=0x7f8de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40099b0 con 0x7f8dec1559c0 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.078+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4004250 con 0x7f8dec1559c0 2023-08-18T20:44:07.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.079+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec1ed910 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.079+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4004600 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.079+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec0c1000 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.080+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec0c57c0 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.080+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8de4004760 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.080+0000 7f8de8ff9700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 0x7f8dd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.081+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8de40898d0 con 0x7f8dec1559c0 2023-08-18T20:44:07.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.081+0000 7f8debfff700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 0x7f8dd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.081+0000 7f8debfff700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 0x7f8dd806c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009950 tx=0x7f8ddc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.085+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8de4055050 con 0x7f8dec1559c0 2023-08-18T20:44:07.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.274+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dec04e620 con 0x7f8dec1559c0 2023-08-18T20:44:07.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.275+0000 7f8de8ff9700 1 -- 172.21.15.121:0/4031283266 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de402a020 con 0x7f8dec1559c0 2023-08-18T20:44:07.275 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:07.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 msgr2=0x7f8dd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 0x7f8dd806c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009950 tx=0x7f8ddc008040 comp rx=0 tx=0).stop 2023-08-18T20:44:07.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 msgr2=0x7f8dec1ea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8de4012000 tx=0x7f8de4004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 shutdown_connections 2023-08-18T20:44:07.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8dd806a0e0 0x7f8dd806c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8dec1559c0 0x7f8dec1ea310 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dec06fd30 0x7f8dec0c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 --2- 172.21.15.121:0/4031283266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec152450 0x7f8dec1e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 >> 172.21.15.121:0/4031283266 conn(0x7f8dec0c7bf0 msgr2=0x7f8dec151460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 shutdown_connections 2023-08-18T20:44:07.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.277+0000 7f8df2350700 1 -- 172.21.15.121:0/4031283266 wait complete. 2023-08-18T20:44:07.290 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:07.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.413+0000 7f1f7c8c7700 1 Processor -- start 2023-08-18T20:44:07.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.413+0000 7f1f7c8c7700 1 -- start start 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7c8c7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f7814e950 0x7f1f780c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7c8c7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f780c2260 con 0x7f1f7814ed30 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7c8c7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f78151d90 con 0x7f1f78070950 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7c8c7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f780a6630 con 0x7f1f7814e950 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f75d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1f7814ed30 0x7f1f780c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47518/0 (socket says 172.21.15.121:47518) 2023-08-18T20:44:07.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f75d9b700 1 -- 172.21.15.121:0/3787039207 learned_addr learned my addr 172.21.15.121:0/3787039207 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:07.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7659c700 1 --2- 172.21.15.121:0/3787039207 >> v2:172.21.15.122:3300/0 conn(0x7f1f7814e950 0x7f1f780c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041949457 0 0) 0x7f1f780c2260 con 0x7f1f7814ed30 2023-08-18T20:44:07.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.414+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f600035b0 con 0x7f1f7814ed30 2023-08-18T20:44:07.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677137600 0 0) 0x7f1f600035b0 con 0x7f1f7814ed30 2023-08-18T20:44:07.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 >> v2:172.21.15.122:3300/0 conn(0x7f1f7814e950 msgr2=0x7f1f780c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 --2- 172.21.15.121:0/3787039207 >> v2:172.21.15.122:3300/0 conn(0x7f1f7814e950 0x7f1f780c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 >> v1:172.21.15.122:6789/0 conn(0x7f1f78070950 legacy=0x7f1f780c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78152070 con 0x7f1f7814ed30 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1f68001670 con 0x7f1f7814ed30 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 >> v1:172.21.15.121:6789/0 conn(0x7f1f7814ed30 legacy=0x7f1f780c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60003a00 0x7f1f60003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f60004850 0x7f1f60004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 0x7f1f6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f780a6630 con 0x7f1f60005210 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6000c1b0 con 0x7f1f60003a00 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6000c370 con 0x7f1f60004850 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 0x7f1f6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7659c700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60003a00 0x7f1f60003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f75d9b700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f60004850 0x7f1f60004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 -- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f60004850 msgr2=0x7f1f60004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f60004850 0x7f1f60004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 -- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60003a00 msgr2=0x7f1f60003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60003a00 0x7f1f60003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 -- 172.21.15.121:0/3787039207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600035b0 con 0x7f1f60005210 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 -- 172.21.15.121:0/3787039207 reap_dead start 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 0x7f1f6000ba10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c190 tx=0x7f1f60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c037bf78171b1658 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70001db0 con 0x7f1f60005210 2023-08-18T20:44:07.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7000ccf0 con 0x7f1f60005210 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.415+0000 7f1f7559a700 1 -- 172.21.15.121:0/3787039207 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70003c40 con 0x7f1f60005210 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 msgr2=0x7f1f6000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 0x7f1f6000ba10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c190 tx=0x7f1f60005880 comp rx=0 tx=0).stop 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/3787039207 shutdown_connections 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/3787039207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f60005210 0x7f1f6000ba10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/3787039207 >> 172.21.15.121:0/3787039207 conn(0x7f1f780c6b10 msgr2=0x7f1f780c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/3787039207 shutdown_connections 2023-08-18T20:44:07.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.416+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/3787039207 wait complete. 2023-08-18T20:44:07.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.417+0000 7f1f7c8c7700 1 Processor -- start 2023-08-18T20:44:07.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.417+0000 7f1f7c8c7700 1 -- start start 2023-08-18T20:44:07.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 0x7f1f781ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f7806d4a0 0x7f1f7814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7806dd20 con 0x7f1f7814e1d0 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7814e660 con 0x7f1f60005210 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7c8c7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7806ea50 con 0x7f1f7806d4a0 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40950/0 (socket says 172.21.15.121:40950) 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 -- 172.21.15.121:0/2465390350 learned_addr learned my addr 172.21.15.121:0/2465390350 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:07.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7659c700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 0x7f1f781ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f75d9b700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f7806d4a0 0x7f1f7814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 -- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f7806d4a0 msgr2=0x7f1f7814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f7806d4a0 0x7f1f7814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 -- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 msgr2=0x7f1f781ddea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 0x7f1f781ddea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f76d9d700 1 -- 172.21.15.121:0/2465390350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7806cca0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.418+0000 7f1f7659c700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 0x7f1f781ddea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f76d9d700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f780c1110 tx=0x7f1f700014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70005070 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700051d0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70005560 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f781daf20 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.419+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7806cef0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.420+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f781db0b0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.420+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f700056c0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.420+0000 7f1f66ffd700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 0x7f1f5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.421+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f70089af0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.421+0000 7f1f7659c700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 0x7f1f5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.421+0000 7f1f7659c700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 0x7f1f5806c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1f781daaa0 tx=0x7f1f6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.425+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1f700551d0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.615+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f78074730 con 0x7f1f7814e1d0 2023-08-18T20:44:07.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.615+0000 7f1f66ffd700 1 -- 172.21.15.121:0/2465390350 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f700587f0 con 0x7f1f7814e1d0 2023-08-18T20:44:07.616 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:07.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 msgr2=0x7f1f5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 0x7f1f5806c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1f781daaa0 tx=0x7f1f6c008040 comp rx=0 tx=0).stop 2023-08-18T20:44:07.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 msgr2=0x7f1f781e9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f780c1110 tx=0x7f1f700014a0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 shutdown_connections 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1f5806a0e0 0x7f1f5806c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7814e1d0 0x7f1f781e9440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f60005210 0x7f1f781ddea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.617+0000 7f1f7c8c7700 1 --2- 172.21.15.121:0/2465390350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f7806d4a0 0x7f1f7814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.618+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 >> 172.21.15.121:0/2465390350 conn(0x7f1f780c6b10 msgr2=0x7f1f780c1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.618+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 shutdown_connections 2023-08-18T20:44:07.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.618+0000 7f1f7c8c7700 1 -- 172.21.15.121:0/2465390350 wait complete. 2023-08-18T20:44:07.630 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:07.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.754+0000 7f2777dd9700 1 Processor -- start 2023-08-18T20:44:07.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.754+0000 7f2777dd9700 1 -- start start 2023-08-18T20:44:07.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2777dd9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f277015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2777dd9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277014eb70 con 0x7f2770072200 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2777dd9700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2770070790 con 0x7f277014e790 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2777dd9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2770154830 con 0x7f27700c37c0 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2770072200 0x7f27701525b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47544/0 (socket says 172.21.15.121:47544) 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 -- 172.21.15.121:0/2985436761 learned_addr learned my addr 172.21.15.121:0/2985436761 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2776376700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f277015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693844466 0 0) 0x7f277014eb70 con 0x7f2770072200 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f275c0035b0 con 0x7f2770072200 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518996909 0 0) 0x7f275c0035b0 con 0x7f2770072200 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 msgr2=0x7f277015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f277015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 >> v1:172.21.15.122:6789/0 conn(0x7f277014e790 legacy=0x7f277006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770154b10 con 0x7f2770072200 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f27600017f0 con 0x7f2770072200 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 >> v1:172.21.15.121:6789/0 conn(0x7f2770072200 legacy=0x7f27701525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c003a30 0x7f275c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0043e0 0x7f275c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f275c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770154830 con 0x7f275c0043e0 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c00ba40 con 0x7f275c003a30 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c00de10 con 0x7f27700c37c0 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0043e0 0x7f275c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775b75700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c003a30 0x7f275c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2776376700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f275c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 -- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 msgr2=0x7f275c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f275c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 -- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c003a30 msgr2=0x7f275c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c003a30 0x7f275c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 -- 172.21.15.121:0/2985436761 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0035b0 con 0x7f275c0043e0 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2776376700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27700c37c0 0x7f275c005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2775374700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0043e0 0x7f275c0048b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f276000c210 tx=0x7f275c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1544cd9e5b1be2c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000cdb0 con 0x7f275c0043e0 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760007ba0 con 0x7f275c0043e0 2023-08-18T20:44:07.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.755+0000 7f2774b73700 1 -- 172.21.15.121:0/2985436761 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760007310 con 0x7f275c0043e0 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 -- 172.21.15.121:0/2985436761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0043e0 msgr2=0x7f275c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 --2- 172.21.15.121:0/2985436761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0043e0 0x7f275c0048b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f276000c210 tx=0x7f275c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2776376700 1 -- 172.21.15.121:0/2985436761 reap_dead start 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 -- 172.21.15.121:0/2985436761 shutdown_connections 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 -- 172.21.15.121:0/2985436761 >> 172.21.15.121:0/2985436761 conn(0x7f27700c2ca0 msgr2=0x7f27700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 -- 172.21.15.121:0/2985436761 shutdown_connections 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.756+0000 7f2777dd9700 1 -- 172.21.15.121:0/2985436761 wait complete. 2023-08-18T20:44:07.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.757+0000 7f2777dd9700 1 Processor -- start 2023-08-18T20:44:07.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.757+0000 7f2777dd9700 1 -- start start 2023-08-18T20:44:07.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f275c0043e0 0x7f27701e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 0x7f2770145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770152af0 con 0x7f27700c5c90 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27701434b0 con 0x7f2770145a90 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27700c5830 con 0x7f275c0043e0 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40974/0 (socket says 172.21.15.121:40974) 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 -- 172.21.15.121:0/284000820 learned_addr learned my addr 172.21.15.121:0/284000820 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:07.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775b75700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f275c0043e0 0x7f27701e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2776376700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 0x7f2770145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 -- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f275c0043e0 msgr2=0x7f27701e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f275c0043e0 0x7f27701e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 -- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 msgr2=0x7f2770145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 0x7f2770145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 -- 172.21.15.121:0/284000820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770152d00 con 0x7f27700c5c90 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2776376700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 0x7f2770145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2775374700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f276000c800 tx=0x7f2760001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760005a30 con 0x7f27700c5c90 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760005bb0 con 0x7f27700c5c90 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700c54c0 con 0x7f27700c5c90 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760000f70 con 0x7f27700c5c90 2023-08-18T20:44:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277006dfa0 con 0x7f27700c5c90 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.759+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277014dbc0 con 0x7f27700c5c90 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.760+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2760019030 con 0x7f27700c5c90 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.760+0000 7f27667fc700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 0x7f275406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.760+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2760089b40 con 0x7f27700c5c90 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.760+0000 7f2775b75700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 0x7f275406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.760+0000 7f2775b75700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 0x7f275406c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f276c0011a0 tx=0x7f276c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.765+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f27600552c0 con 0x7f27700c5c90 2023-08-18T20:44:07.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.955+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2770074730 con 0x7f27700c5c90 2023-08-18T20:44:07.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.956+0000 7f27667fc700 1 -- 172.21.15.121:0/284000820 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27600170a0 con 0x7f27700c5c90 2023-08-18T20:44:07.957 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 msgr2=0x7f275406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 0x7f275406c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f276c0011a0 tx=0x7f276c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 msgr2=0x7f2770142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f276000c800 tx=0x7f2760001b80 comp rx=0 tx=0).stop 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 shutdown_connections 2023-08-18T20:44:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2770145a90 0x7f2770145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f275c0043e0 0x7f27701e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f275406a110 0x7f275406c5d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 --2- 172.21.15.121:0/284000820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27700c5c90 0x7f2770142f70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 >> 172.21.15.121:0/284000820 conn(0x7f27700c2ca0 msgr2=0x7f27700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 shutdown_connections 2023-08-18T20:44:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:07.959+0000 7f2777dd9700 1 -- 172.21.15.121:0/284000820 wait complete. 2023-08-18T20:44:07.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:08.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 Processor -- start 2023-08-18T20:44:08.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 -- start start 2023-08-18T20:44:08.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f013c0a6290 0x7f013c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0c4f40 con 0x7f013c0c1b10 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0c6120 con 0x7f013c0c0c50 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f0141ea8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c1551f0 con 0x7f013c0a6290 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013affd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f013c0a6290 0x7f013c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013bfff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f013c0c1b10 0x7f013c071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47566/0 (socket says 172.21.15.121:47566) 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013bfff700 1 -- 172.21.15.121:0/767303630 learned_addr learned my addr 172.21.15.121:0/767303630 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013affd700 1 -- 172.21.15.121:0/767303630 >> v1:172.21.15.122:6789/0 conn(0x7f013c0c0c50 legacy=0x7f013c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:08.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013affd700 1 -- 172.21.15.121:0/767303630 >> v1:172.21.15.121:6789/0 conn(0x7f013c0c1b10 legacy=0x7f013c071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013affd700 1 -- 172.21.15.121:0/767303630 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0c63a0 con 0x7f013c0a6290 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013affd700 1 --2- 172.21.15.121:0/767303630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0a6290 0x7f013c0c53d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0130009840 tx=0x7f0130009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6872b490e3c3a3b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013a7fc700 1 -- 172.21.15.121:0/767303630 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130004230 con 0x7f013c0a6290 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013a7fc700 1 -- 172.21.15.121:0/767303630 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130004390 con 0x7f013c0a6290 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.091+0000 7f013a7fc700 1 -- 172.21.15.121:0/767303630 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300036a0 con 0x7f013c0a6290 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 -- 172.21.15.121:0/767303630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0a6290 msgr2=0x7f013c0c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 --2- 172.21.15.121:0/767303630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0a6290 0x7f013c0c53d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0130009840 tx=0x7f0130009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:08.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 -- 172.21.15.121:0/767303630 shutdown_connections 2023-08-18T20:44:08.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 --2- 172.21.15.121:0/767303630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0a6290 0x7f013c0c53d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 -- 172.21.15.121:0/767303630 >> 172.21.15.121:0/767303630 conn(0x7f013c0c6b10 msgr2=0x7f013c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 -- 172.21.15.121:0/767303630 shutdown_connections 2023-08-18T20:44:08.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.092+0000 7f0141ea8700 1 -- 172.21.15.121:0/767303630 wait complete. 2023-08-18T20:44:08.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.093+0000 7f0141ea8700 1 Processor -- start 2023-08-18T20:44:08.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 -- start start 2023-08-18T20:44:08.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f013c0a6290 0x7f013c1eb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f013c0c1b10 0x7f013c1ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0a9b00 con 0x7f013c0c0c50 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0aa960 con 0x7f013c0a6290 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.094+0000 7f0141ea8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1eb5b0 con 0x7f013c0c1b10 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40988/0 (socket says 172.21.15.121:40988) 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 -- 172.21.15.121:0/3763868665 learned_addr learned my addr 172.21.15.121:0/3763868665 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:08.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 -- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f013c0c1b10 msgr2=0x7f013c1ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f013c0c1b10 0x7f013c1ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 -- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f013c0a6290 msgr2=0x7f013c1eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013b7fe700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f013c0a6290 0x7f013c1eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f013c0a6290 0x7f013c1eb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 -- 172.21.15.121:0/3763868665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300094a0 con 0x7f013c0c0c50 2023-08-18T20:44:08.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f013affd700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0130009f50 tx=0x7f0130004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011630 con 0x7f013c0c0c50 2023-08-18T20:44:08.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013001e070 con 0x7f013c0c0c50 2023-08-18T20:44:08.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c0a9d50 con 0x7f013c0c0c50 2023-08-18T20:44:08.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011990 con 0x7f013c0c0c50 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.095+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0aa310 con 0x7f013c0c0c50 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.096+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c0c7a40 con 0x7f013c0c0c50 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.097+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0130011af0 con 0x7f013c0c0c50 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.097+0000 7f0123fff700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 0x7f012806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.097+0000 7f013b7fe700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 0x7f012806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.097+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0130089830 con 0x7f013c0c0c50 2023-08-18T20:44:08.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.098+0000 7f013b7fe700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 0x7f012806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f012c001670 tx=0x7f012c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.101+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0130054fb0 con 0x7f013c0c0c50 2023-08-18T20:44:08.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.290+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f013c074730 con 0x7f013c0c0c50 2023-08-18T20:44:08.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.291+0000 7f0123fff700 1 -- 172.21.15.121:0/3763868665 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f0130020090 con 0x7f013c0c0c50 2023-08-18T20:44:08.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:08.292 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:08.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 msgr2=0x7f012806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 0x7f012806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f012c001670 tx=0x7f012c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:08.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 msgr2=0x7f013c0aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0130009f50 tx=0x7f0130004750 comp rx=0 tx=0).stop 2023-08-18T20:44:08.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 shutdown_connections 2023-08-18T20:44:08.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f013c0c1b10 0x7f013c1ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f013c0a6290 0x7f013c1eb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f012806a0e0 0x7f012806c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 --2- 172.21.15.121:0/3763868665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f013c0c0c50 0x7f013c0aadf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.293+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 >> 172.21.15.121:0/3763868665 conn(0x7f013c0c6b10 msgr2=0x7f013c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.294+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 shutdown_connections 2023-08-18T20:44:08.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.294+0000 7f0141ea8700 1 -- 172.21.15.121:0/3763868665 wait complete. 2023-08-18T20:44:08.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:08.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:08.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 Processor -- start 2023-08-18T20:44:08.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 -- start start 2023-08-18T20:44:08.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978158b10 con 0x7f29780c6d00 2023-08-18T20:44:08.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780a7390 con 0x7f2978154150 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.431+0000 7f297eda7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780c5b30 con 0x7f2978154830 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f2977fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f2977fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50834/0 (socket says 172.21.15.121:50834) 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37408/0 (socket says 172.21.15.121:37408) 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f2977fff700 1 -- 172.21.15.121:0/3701042748 learned_addr learned my addr 172.21.15.121:0/3701042748 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297cb43700 1 --1- 172.21.15.121:0/3701042748 >> v1:172.21.15.122:6789/0 conn(0x7f29780c6d00 0x7f2978153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.121:56698/0 (socket says 172.21.15.121:56698) 2023-08-18T20:44:08.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 -- 172.21.15.121:0/3701042748 >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 msgr2=0x7f29781585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 --2- 172.21.15.121:0/3701042748 >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 -- 172.21.15.121:0/3701042748 >> v1:172.21.15.122:6789/0 conn(0x7f29780c6d00 legacy=0x7f2978153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 -- 172.21.15.121:0/3701042748 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780c5e10 con 0x7f2978154830 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f2977fff700 1 --2- 172.21.15.121:0/3701042748 >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f297d344700 1 --2- 172.21.15.121:0/3701042748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2970009d90 tx=0x7f297000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e778a493a552b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.432+0000 7f29777fe700 1 -- 172.21.15.121:0/3701042748 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000e070 con 0x7f2978154830 2023-08-18T20:44:08.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f29777fe700 1 -- 172.21.15.121:0/3701042748 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000bb20 con 0x7f2978154830 2023-08-18T20:44:08.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f29777fe700 1 -- 172.21.15.121:0/3701042748 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970012430 con 0x7f2978154830 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 -- 172.21.15.121:0/3701042748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 msgr2=0x7f2978154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 --2- 172.21.15.121:0/3701042748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2970009d90 tx=0x7f297000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 -- 172.21.15.121:0/3701042748 shutdown_connections 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 --2- 172.21.15.121:0/3701042748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978154cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 --2- 172.21.15.121:0/3701042748 >> v2:172.21.15.122:3300/0 conn(0x7f2978154150 0x7f29781585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 -- 172.21.15.121:0/3701042748 >> 172.21.15.121:0/3701042748 conn(0x7f2978066610 msgr2=0x7f29780c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 -- 172.21.15.121:0/3701042748 shutdown_connections 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.433+0000 7f297eda7700 1 -- 172.21.15.121:0/3701042748 wait complete. 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.434+0000 7f297eda7700 1 Processor -- start 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.434+0000 7f297eda7700 1 -- start start 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29780c6d00 0x7f297806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781572d0 con 0x7f2978154150 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781554d0 con 0x7f29780c6d00 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297eda7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29781ed6e0 con 0x7f2978154830 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41002/0 (socket says 172.21.15.121:41002) 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 -- 172.21.15.121:0/1559183373 learned_addr learned my addr 172.21.15.121:0/1559183373 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297cb43700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29780c6d00 0x7f297806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f297d344700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 -- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 msgr2=0x7f2978151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 -- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29780c6d00 msgr2=0x7f297806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29780c6d00 0x7f297806c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.435+0000 7f2977fff700 1 -- 172.21.15.121:0/1559183373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009550 con 0x7f2978154150 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f2977fff700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f296400ebe0 tx=0x7f2964009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400c8b0 con 0x7f2978154150 2023-08-18T20:44:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970009a70 con 0x7f2978154150 2023-08-18T20:44:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296400ca10 con 0x7f2978154150 2023-08-18T20:44:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400cd80 con 0x7f2978154150 2023-08-18T20:44:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.436+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978155720 con 0x7f2978154150 2023-08-18T20:44:08.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.437+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29780a6cc0 con 0x7f2978154150 2023-08-18T20:44:08.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.437+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2964013470 con 0x7f2978154150 2023-08-18T20:44:08.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.437+0000 7f29757fa700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 0x7f295c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.437+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2964088730 con 0x7f2978154150 2023-08-18T20:44:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.437+0000 7f297cb43700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 0x7f295c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.438+0000 7f297cb43700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 0x7f295c06c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.442+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2964053da0 con 0x7f2978154150 2023-08-18T20:44:08.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.632+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2978074730 con 0x7f2978154150 2023-08-18T20:44:08.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.632+0000 7f29757fa700 1 -- 172.21.15.121:0/1559183373 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29640573c0 con 0x7f2978154150 2023-08-18T20:44:08.632 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 msgr2=0x7f295c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 0x7f295c06c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007d10 comp rx=0 tx=0).stop 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 msgr2=0x7f29781ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f296400ebe0 tx=0x7f2964009e70 comp rx=0 tx=0).stop 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 shutdown_connections 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2978154830 0x7f2978151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29780c6d00 0x7f297806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f295c06a110 0x7f295c06c5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 --2- 172.21.15.121:0/1559183373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2978154150 0x7f29781ed1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 >> 172.21.15.121:0/1559183373 conn(0x7f2978066610 msgr2=0x7f2978158310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 shutdown_connections 2023-08-18T20:44:08.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.634+0000 7f297eda7700 1 -- 172.21.15.121:0/1559183373 wait complete. 2023-08-18T20:44:08.646 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:08.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.769+0000 7f5f50277700 1 Processor -- start 2023-08-18T20:44:08.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.769+0000 7f5f50277700 1 -- start start 2023-08-18T20:44:08.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f50277700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f4806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f50277700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f4806a7e0 0x7f5f480c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f50277700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480c4f40 con 0x7f5f480a6290 2023-08-18T20:44:08.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f50277700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f480c6120 con 0x7f5f4806a7e0 2023-08-18T20:44:08.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f50277700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481551f0 con 0x7f5f480c0c50 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f4d812700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f4806a7e0 0x7f5f480c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f4d812700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f4806a7e0 0x7f5f480c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41016/0 (socket says 172.21.15.121:41016) 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f4d812700 1 -- 172.21.15.121:0/1215428968 learned_addr learned my addr 172.21.15.121:0/1215428968 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.770+0000 7f5f4e013700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f4806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d812700 1 -- 172.21.15.121:0/1215428968 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 msgr2=0x7f5f4806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d812700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f4806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d812700 1 -- 172.21.15.121:0/1215428968 >> v1:172.21.15.122:6789/0 conn(0x7f5f480a6290 legacy=0x7f5f48071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d812700 1 -- 172.21.15.121:0/1215428968 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480c63a0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d812700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480c53d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f440098f0 tx=0x7f5f44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a142febb65ba05a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d011700 1 -- 172.21.15.121:0/1215428968 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400b8a0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d011700 1 -- 172.21.15.121:0/1215428968 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400ba00 con 0x7f5f4806a7e0 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f4d011700 1 -- 172.21.15.121:0/1215428968 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400bd90 con 0x7f5f4806a7e0 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 -- 172.21.15.121:0/1215428968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 msgr2=0x7f5f480c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480c53d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f440098f0 tx=0x7f5f44009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:08.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 -- 172.21.15.121:0/1215428968 shutdown_connections 2023-08-18T20:44:08.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f4806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 --2- 172.21.15.121:0/1215428968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480c53d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 -- 172.21.15.121:0/1215428968 >> 172.21.15.121:0/1215428968 conn(0x7f5f480c6b10 msgr2=0x7f5f480c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.771+0000 7f5f50277700 1 -- 172.21.15.121:0/1215428968 shutdown_connections 2023-08-18T20:44:08.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.772+0000 7f5f50277700 1 -- 172.21.15.121:0/1215428968 wait complete. 2023-08-18T20:44:08.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 Processor -- start 2023-08-18T20:44:08.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 -- start start 2023-08-18T20:44:08.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f480a6290 0x7f5f480ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f481ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481565c0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481570d0 con 0x7f5f480a6290 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f50277700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481573b0 con 0x7f5f480c0c50 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f4e013700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f4e013700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41020/0 (socket says 172.21.15.121:41020) 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.773+0000 7f5f4e013700 1 -- 172.21.15.121:0/1415531435 learned_addr learned my addr 172.21.15.121:0/1415531435 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4d812700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f480a6290 0x7f5f480ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 -- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 msgr2=0x7f5f481ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f481ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 -- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f480a6290 msgr2=0x7f5f480ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f480a6290 0x7f5f480ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 -- 172.21.15.121:0/1415531435 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009550 con 0x7f5f4806a7e0 2023-08-18T20:44:08.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f4e013700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e810 tx=0x7f5f3800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38013610 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38013770 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f48157690 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38013b20 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.774+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f480c1390 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.775+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48074730 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.775+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5f38013c80 con 0x7f5f4806a7e0 2023-08-18T20:44:08.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.776+0000 7f5f3effd700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 0x7f5f2c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:08.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.776+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f380882d0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.776+0000 7f5f4d812700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 0x7f5f2c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:08.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.776+0000 7f5f4d812700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 0x7f5f2c06c570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f4814adf0 tx=0x7f5f44008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:08.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.780+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5f380539d0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.971+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f480c4a10 con 0x7f5f4806a7e0 2023-08-18T20:44:08.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.971+0000 7f5f3effd700 1 -- 172.21.15.121:0/1415531435 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f38056ff0 con 0x7f5f4806a7e0 2023-08-18T20:44:08.971 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:08.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 msgr2=0x7f5f2c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 0x7f5f2c06c570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f4814adf0 tx=0x7f5f44008030 comp rx=0 tx=0).stop 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 msgr2=0x7f5f480abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e810 tx=0x7f5f3800ebd0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 shutdown_connections 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5f480c0c50 0x7f5f481ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5f2c06a0b0 0x7f5f2c06c570 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f4806a7e0 0x7f5f480abd90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 --2- 172.21.15.121:0/1415531435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f480a6290 0x7f5f480ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:08.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 >> 172.21.15.121:0/1415531435 conn(0x7f5f480c6b10 msgr2=0x7f5f480c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:08.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 shutdown_connections 2023-08-18T20:44:08.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:08.973+0000 7f5f50277700 1 -- 172.21.15.121:0/1415531435 wait complete. 2023-08-18T20:44:08.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:09.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.107+0000 7f6f33b71700 1 Processor -- start 2023-08-18T20:44:09.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.108+0000 7f6f33b71700 1 -- start start 2023-08-18T20:44:09.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.108+0000 7f6f33b71700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f2c0c5490 0x7f6f2c158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.108+0000 7f6f33b71700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0c21f0 con 0x7f6f2c06a510 2023-08-18T20:44:09.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.108+0000 7f6f33b71700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0c5b20 con 0x7f6f2c0c1cf0 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.108+0000 7f6f33b71700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0c2ba0 con 0x7f6f2c0c5490 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3190d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6f2c06a510 0x7f6f2c151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47610/0 (socket says 172.21.15.121:47610) 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3190d700 1 -- 172.21.15.121:0/3598970503 learned_addr learned my addr 172.21.15.121:0/3598970503 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3210e700 1 --2- 172.21.15.121:0/3598970503 >> v2:172.21.15.122:3300/0 conn(0x7f6f2c0c5490 0x7f6f2c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953458175 0 0) 0x7f6f2c0c21f0 con 0x7f6f2c06a510 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f180035b0 con 0x7f6f2c06a510 2023-08-18T20:44:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133839725 0 0) 0x7f6f180035b0 con 0x7f6f2c06a510 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 >> v2:172.21.15.122:3300/0 conn(0x7f6f2c0c5490 msgr2=0x7f6f2c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 --2- 172.21.15.121:0/3598970503 >> v2:172.21.15.122:3300/0 conn(0x7f6f2c0c5490 0x7f6f2c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 >> v1:172.21.15.122:6789/0 conn(0x7f6f2c0c1cf0 legacy=0x7f6f2c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0c6510 con 0x7f6f2c06a510 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f6f20001670 con 0x7f6f2c06a510 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 >> v1:172.21.15.121:6789/0 conn(0x7f6f2c06a510 legacy=0x7f6f2c151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f18004850 0x7f6f18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f18005210 0x7f6f1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800c180 con 0x7f6f18003a00 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800c2f0 con 0x7f6f18005210 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800c4b0 con 0x7f6f18004850 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3110c700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f18004850 0x7f6f18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.109+0000 7f6f3210e700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f18005210 0x7f6f1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 -- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f18004850 msgr2=0x7f6f18004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f18004850 0x7f6f18004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 -- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f18005210 msgr2=0x7f6f1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f18005210 0x7f6f1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3210e700 1 -- 172.21.15.121:0/3598970503 reap_dead start 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 -- 172.21.15.121:0/3598970503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180035b0 con 0x7f6f18003a00 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f18003e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c240 tx=0x7f6f18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2470cca9c1568e2c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007c10 con 0x7f6f18003a00 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000cd80 con 0x7f6f18003a00 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f3090b700 1 -- 172.21.15.121:0/3598970503 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20005ba0 con 0x7f6f18003a00 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f33b71700 1 -- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 msgr2=0x7f6f18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f18003e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c240 tx=0x7f6f18005880 comp rx=0 tx=0).stop 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f33b71700 1 -- 172.21.15.121:0/3598970503 shutdown_connections 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3598970503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f18003e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.110+0000 7f6f33b71700 1 -- 172.21.15.121:0/3598970503 >> 172.21.15.121:0/3598970503 conn(0x7f6f2c0c6b10 msgr2=0x7f6f2c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.111+0000 7f6f33b71700 1 -- 172.21.15.121:0/3598970503 shutdown_connections 2023-08-18T20:44:09.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.111+0000 7f6f33b71700 1 -- 172.21.15.121:0/3598970503 wait complete. 2023-08-18T20:44:09.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 Processor -- start 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 -- start start 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c0acb40 0x7f6f2c1ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0a9b00 0x7f6f2c1ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c06e980 con 0x7f6f18003a00 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c06e6a0 con 0x7f6f2c0acb40 2023-08-18T20:44:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f33b71700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a8290 con 0x7f6f2c0a9b00 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f3190d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f3190d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41040/0 (socket says 172.21.15.121:41040) 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.112+0000 7f6f3190d700 1 -- 172.21.15.121:0/3151033915 learned_addr learned my addr 172.21.15.121:0/3151033915 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3210e700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0a9b00 0x7f6f2c1ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 -- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0a9b00 msgr2=0x7f6f2c1ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0a9b00 0x7f6f2c1ed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 -- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c0acb40 msgr2=0x7f6f2c1ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c0acb40 0x7f6f2c1ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 -- 172.21.15.121:0/3151033915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0a8570 con 0x7f6f18003a00 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f3190d700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c2c0 tx=0x7f6f20001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20004c80 con 0x7f6f18003a00 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20004de0 con 0x7f6f18003a00 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c1ea220 con 0x7f6f18003a00 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007310 con 0x7f6f18003a00 2023-08-18T20:44:09.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.113+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c06c550 con 0x7f6f18003a00 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.114+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c072a20 con 0x7f6f18003a00 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.114+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f20007470 con 0x7f6f18003a00 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.115+0000 7f6f1e7fc700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 0x7f6f1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.115+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f20088f10 con 0x7f6f18003a00 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.115+0000 7f6f3110c700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 0x7f6f1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.115+0000 7f6f3110c700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 0x7f6f1006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f28000c00 tx=0x7f6f28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.119+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6f2c072a20 con 0x7f6f18003a00 2023-08-18T20:44:09.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.308+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f2c072a20 con 0x7f6f18003a00 2023-08-18T20:44:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.308+0000 7f6f1e7fc700 1 -- 172.21.15.121:0/3151033915 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f2c072a20 con 0x7f6f18003a00 2023-08-18T20:44:09.308 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:09.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.310+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 msgr2=0x7f6f1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.310+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 0x7f6f1006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f28000c00 tx=0x7f6f28009040 comp rx=0 tx=0).stop 2023-08-18T20:44:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.310+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 msgr2=0x7f6f2c148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.310+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c2c0 tx=0x7f6f20001a00 comp rx=0 tx=0).stop 2023-08-18T20:44:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 shutdown_connections 2023-08-18T20:44:09.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0a9b00 0x7f6f2c1ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f1006a0e0 0x7f6f1006c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f18003a00 0x7f6f2c148fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 --2- 172.21.15.121:0/3151033915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c0acb40 0x7f6f2c1ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 >> 172.21.15.121:0/3151033915 conn(0x7f6f2c0c6b10 msgr2=0x7f6f2c156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 shutdown_connections 2023-08-18T20:44:09.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.311+0000 7f6f33b71700 1 -- 172.21.15.121:0/3151033915 wait complete. 2023-08-18T20:44:09.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:09.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.446+0000 7f065f01f700 1 Processor -- start 2023-08-18T20:44:09.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.446+0000 7f065f01f700 1 -- start start 2023-08-18T20:44:09.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f065814e950 0x7f06580c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f065814ed30 0x7f06580c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06580c19d0 0x7f06580c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580a6630 con 0x7f065814e950 2023-08-18T20:44:09.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580c2260 con 0x7f065814ed30 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065f01f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658151d90 con 0x7f06580c19d0 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f065814e950 0x7f06580c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f065814e950 0x7f06580c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41048/0 (socket says 172.21.15.121:41048) 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 -- 172.21.15.121:0/2478623097 learned_addr learned my addr 172.21.15.121:0/2478623097 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f0657fff700 1 --2- 172.21.15.121:0/2478623097 >> v2:172.21.15.122:3300/0 conn(0x7f065814ed30 0x7f06580c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065d5bc700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06580c19d0 0x7f06580c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 -- 172.21.15.121:0/2478623097 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06580c19d0 msgr2=0x7f06580c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06580c19d0 0x7f06580c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 -- 172.21.15.121:0/2478623097 >> v2:172.21.15.122:3300/0 conn(0x7f065814ed30 msgr2=0x7f06580c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 --2- 172.21.15.121:0/2478623097 >> v2:172.21.15.122:3300/0 conn(0x7f065814ed30 0x7f06580c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 -- 172.21.15.121:0/2478623097 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658152070 con 0x7f065814e950 2023-08-18T20:44:09.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f065cdbb700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f065814e950 0x7f06580c2ed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06580c7ba0 tx=0x7f064c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d14fcf8e5854cee server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f06577fe700 1 -- 172.21.15.121:0/2478623097 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00dd30 con 0x7f065814e950 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f06577fe700 1 -- 172.21.15.121:0/2478623097 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c00de90 con 0x7f065814e950 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.447+0000 7f06577fe700 1 -- 172.21.15.121:0/2478623097 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c010690 con 0x7f065814e950 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 -- 172.21.15.121:0/2478623097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f065814e950 msgr2=0x7f06580c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f065814e950 0x7f06580c2ed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06580c7ba0 tx=0x7f064c00be70 comp rx=0 tx=0).stop 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 -- 172.21.15.121:0/2478623097 shutdown_connections 2023-08-18T20:44:09.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06580c19d0 0x7f06580c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 --2- 172.21.15.121:0/2478623097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f065814e950 0x7f06580c2ed0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 --2- 172.21.15.121:0/2478623097 >> v2:172.21.15.122:3300/0 conn(0x7f065814ed30 0x7f06580c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 -- 172.21.15.121:0/2478623097 >> 172.21.15.121:0/2478623097 conn(0x7f06580c6b10 msgr2=0x7f06580c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 -- 172.21.15.121:0/2478623097 shutdown_connections 2023-08-18T20:44:09.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.448+0000 7f065f01f700 1 -- 172.21.15.121:0/2478623097 wait complete. 2023-08-18T20:44:09.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.449+0000 7f065f01f700 1 Processor -- start 2023-08-18T20:44:09.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.449+0000 7f065f01f700 1 -- start start 2023-08-18T20:44:09.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f065814e950 0x7f065814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f065814ed30 0x7f065814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580ab0c0 con 0x7f06580c19d0 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580ab3a0 con 0x7f065814e950 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065f01f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580ab680 con 0x7f065814ed30 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41054/0 (socket says 172.21.15.121:41054) 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 -- 172.21.15.121:0/1019316572 learned_addr learned my addr 172.21.15.121:0/1019316572 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f0657fff700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f065814e950 0x7f065814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065d5bc700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f065814ed30 0x7f065814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 -- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f065814ed30 msgr2=0x7f065814c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f065814ed30 0x7f065814c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 -- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f065814e950 msgr2=0x7f065814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f065814e950 0x7f065814bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 -- 172.21.15.121:0/1019316572 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c00b7f0 con 0x7f06580c19d0 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.450+0000 7f065cdbb700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f064c00beb0 tx=0x7f064c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c01f070 con 0x7f06580c19d0 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c003b20 con 0x7f06580c19d0 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06580ab960 con 0x7f06580c19d0 2023-08-18T20:44:09.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c010470 con 0x7f06580c19d0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065806dbc0 con 0x7f06580c19d0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.451+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06580abe80 con 0x7f06580c19d0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.452+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f064c019400 con 0x7f06580c19d0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.452+0000 7f06557fa700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.452+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f064c08b9b0 con 0x7f06580c19d0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.453+0000 7f0657fff700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.453+0000 7f0657fff700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 0x7f063c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f064400b930 tx=0x7f0644008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.457+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f06580abe80 con 0x7f06580c19d0 2023-08-18T20:44:09.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.646+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06580abe80 con 0x7f06580c19d0 2023-08-18T20:44:09.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.646+0000 7f06557fa700 1 -- 172.21.15.121:0/1019316572 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06580abe80 con 0x7f06580c19d0 2023-08-18T20:44:09.646 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:09.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 msgr2=0x7f063c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 0x7f063c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f064400b930 tx=0x7f0644008040 comp rx=0 tx=0).stop 2023-08-18T20:44:09.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 msgr2=0x7f065806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f064c00beb0 tx=0x7f064c004750 comp rx=0 tx=0).stop 2023-08-18T20:44:09.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 shutdown_connections 2023-08-18T20:44:09.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f065814ed30 0x7f065814c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06580c19d0 0x7f065806d680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 --2- 172.21.15.121:0/1019316572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f065814e950 0x7f065814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 >> 172.21.15.121:0/1019316572 conn(0x7f06580c6b10 msgr2=0x7f06580c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 shutdown_connections 2023-08-18T20:44:09.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.648+0000 7f065f01f700 1 -- 172.21.15.121:0/1019316572 wait complete. 2023-08-18T20:44:09.660 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:09.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.780+0000 7fc5a63f0700 1 Processor -- start 2023-08-18T20:44:09.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.780+0000 7fc5a63f0700 1 -- start start 2023-08-18T20:44:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc5a63f0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc5a63f0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc5a63f0700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a006cc30 con 0x7fc5a006b7f0 2023-08-18T20:44:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc5a63f0700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00c0b80 con 0x7fc5a01518e0 2023-08-18T20:44:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc5a63f0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0155260 con 0x7fc5a00c1030 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc59ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc59ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50900/0 (socket says 172.21.15.121:50900) 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37474/0 (socket says 172.21.15.121:37474) 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.781+0000 7fc59ffff700 1 -- 172.21.15.121:0/4294208734 learned_addr learned my addr 172.21.15.121:0/4294208734 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59f7fe700 1 -- 172.21.15.121:0/4294208734 >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 msgr2=0x7fc5a0066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:09.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59f7fe700 1 --2- 172.21.15.121:0/4294208734 >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59f7fe700 1 -- 172.21.15.121:0/4294208734 >> v1:172.21.15.122:6789/0 conn(0x7fc5a006b7f0 legacy=0x7fc5a00bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59f7fe700 1 -- 172.21.15.121:0/4294208734 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a006ce80 con 0x7fc5a00c1030 2023-08-18T20:44:09.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59ffff700 1 --2- 172.21.15.121:0/4294208734 >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:09.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59f7fe700 1 --2- 172.21.15.121:0/4294208734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc590009820 tx=0x7fc590009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577c515d6793bddd server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59effd700 1 -- 172.21.15.121:0/4294208734 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590005e30 con 0x7fc5a00c1030 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59effd700 1 -- 172.21.15.121:0/4294208734 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590006030 con 0x7fc5a00c1030 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.782+0000 7fc59effd700 1 -- 172.21.15.121:0/4294208734 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900063c0 con 0x7fc5a00c1030 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 -- 172.21.15.121:0/4294208734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 msgr2=0x7fc5a006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/4294208734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc590009820 tx=0x7fc590009b30 comp rx=0 tx=0).stop 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 -- 172.21.15.121:0/4294208734 shutdown_connections 2023-08-18T20:44:09.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/4294208734 >> v2:172.21.15.122:3300/0 conn(0x7fc5a01518e0 0x7fc5a0066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/4294208734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a00c1030 0x7fc5a006b2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 -- 172.21.15.121:0/4294208734 >> 172.21.15.121:0/4294208734 conn(0x7fc5a00c2ca0 msgr2=0x7fc5a00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 -- 172.21.15.121:0/4294208734 shutdown_connections 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.783+0000 7fc5a63f0700 1 -- 172.21.15.121:0/4294208734 wait complete. 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.784+0000 7fc5a63f0700 1 Processor -- start 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.784+0000 7fc5a63f0700 1 -- start start 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a006b7f0 0x7fc5a00c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5a01518e0 0x7fc5a014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c4000 con 0x7fc5a00c1030 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c4fe0 con 0x7fc5a01518e0 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a63f0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01eab30 con 0x7fc5a006b7f0 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41070/0 (socket says 172.21.15.121:41070) 2023-08-18T20:44:09.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a006b7f0 0x7fc5a00c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 -- 172.21.15.121:0/1043863697 learned_addr learned my addr 172.21.15.121:0/1043863697 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc5a498d700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5a01518e0 0x7fc5a014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 -- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a006b7f0 msgr2=0x7fc5a00c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a006b7f0 0x7fc5a00c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 -- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5a01518e0 msgr2=0x7fc5a014f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5a01518e0 0x7fc5a014f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 -- 172.21.15.121:0/1043863697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009550 con 0x7fc5a00c1030 2023-08-18T20:44:09.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59f7fe700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.785+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900061a0 con 0x7fc5a00c1030 2023-08-18T20:44:09.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.786+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590020070 con 0x7fc5a00c1030 2023-08-18T20:44:09.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.786+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc590009430 con 0x7fc5a00c1030 2023-08-18T20:44:09.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.786+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590006540 con 0x7fc5a00c1030 2023-08-18T20:44:09.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.786+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00c42a0 con 0x7fc5a00c1030 2023-08-18T20:44:09.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.786+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a006e460 con 0x7fc5a00c1030 2023-08-18T20:44:09.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.787+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc590022030 con 0x7fc5a00c1030 2023-08-18T20:44:09.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.787+0000 7fc59cff9700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 0x7fc58c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:09.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.787+0000 7fc59ffff700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 0x7fc58c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:09.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.788+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc590089930 con 0x7fc5a00c1030 2023-08-18T20:44:09.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.788+0000 7fc59ffff700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 0x7fc58c06c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc594006d30 tx=0x7fc5940092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:09.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.792+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc5900550b0 con 0x7fc5a00c1030 2023-08-18T20:44:09.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.985+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5a0074730 con 0x7fc5a00c1030 2023-08-18T20:44:09.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.986+0000 7fc59cff9700 1 -- 172.21.15.121:0/1043863697 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fc5900586d0 con 0x7fc5a00c1030 2023-08-18T20:44:09.986 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:09.986 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:09.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.988+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 msgr2=0x7fc58c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.988+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 0x7fc58c06c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc594006d30 tx=0x7fc5940092c0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.988+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 msgr2=0x7fc5a00a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:09.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.988+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590004750 comp rx=0 tx=0).stop 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 shutdown_connections 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5a01518e0 0x7fc5a014f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5a006b7f0 0x7fc5a00c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc58c06a0e0 0x7fc58c06c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 --2- 172.21.15.121:0/1043863697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5a00c1030 0x7fc5a00a9690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 >> 172.21.15.121:0/1043863697 conn(0x7fc5a00c2ca0 msgr2=0x7fc5a00c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:09.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 shutdown_connections 2023-08-18T20:44:09.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:09.989+0000 7fc5a63f0700 1 -- 172.21.15.121:0/1043863697 wait complete. 2023-08-18T20:44:10.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:10.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:10.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.125+0000 7f379b545700 1 Processor -- start 2023-08-18T20:44:10.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.125+0000 7f379b545700 1 -- start start 2023-08-18T20:44:10.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f379b545700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 0x7f37940c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f379b545700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f379b545700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37941529a0 con 0x7f3794152450 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f379b545700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3794152c80 con 0x7f379406fd30 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f379b545700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794152f60 con 0x7f37941559c0 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.126+0000 7f3799ae2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f37992e1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 0x7f37940c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37488/0 (socket says 172.21.15.121:37488) 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 -- 172.21.15.121:0/258679535 learned_addr learned my addr 172.21.15.121:0/258679535 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 -- 172.21.15.121:0/258679535 >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 msgr2=0x7f37940c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 --2- 172.21.15.121:0/258679535 >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 0x7f37940c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 -- 172.21.15.121:0/258679535 >> v1:172.21.15.122:6789/0 conn(0x7f3794152450 legacy=0x7f379414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 -- 172.21.15.121:0/258679535 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794153240 con 0x7f37941559c0 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f37992e1700 1 --2- 172.21.15.121:0/258679535 >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 0x7f37940c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:10.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f3799ae2700 1 --2- 172.21.15.121:0/258679535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f378c009e50 tx=0x7f378c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d737709b95e748 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f378bfff700 1 -- 172.21.15.121:0/258679535 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00e070 con 0x7f37941559c0 2023-08-18T20:44:10.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f378bfff700 1 -- 172.21.15.121:0/258679535 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00b910 con 0x7f37941559c0 2023-08-18T20:44:10.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.127+0000 7f378bfff700 1 -- 172.21.15.121:0/258679535 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00bcc0 con 0x7f37941559c0 2023-08-18T20:44:10.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 -- 172.21.15.121:0/258679535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 msgr2=0x7f37940c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 --2- 172.21.15.121:0/258679535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f378c009e50 tx=0x7f378c00b330 comp rx=0 tx=0).stop 2023-08-18T20:44:10.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 -- 172.21.15.121:0/258679535 shutdown_connections 2023-08-18T20:44:10.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 --2- 172.21.15.121:0/258679535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37941559c0 0x7f37940c7270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 --2- 172.21.15.121:0/258679535 >> v2:172.21.15.122:3300/0 conn(0x7f379406fd30 0x7f37940c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 -- 172.21.15.121:0/258679535 >> 172.21.15.121:0/258679535 conn(0x7f37940c7bf0 msgr2=0x7f37940c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 -- 172.21.15.121:0/258679535 shutdown_connections 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.128+0000 7f379b545700 1 -- 172.21.15.121:0/258679535 wait complete. 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.129+0000 7f379b545700 1 Processor -- start 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.129+0000 7f379b545700 1 -- start start 2023-08-18T20:44:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f379406fd30 0x7f37940bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37941559c0 0x7f379414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940aa640 con 0x7f3794152450 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941eb2c0 con 0x7f37941559c0 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37941eaa00 con 0x7f379406fd30 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41082/0 (socket says 172.21.15.121:41082) 2023-08-18T20:44:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 -- 172.21.15.121:0/1671329001 learned_addr learned my addr 172.21.15.121:0/1671329001 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f37992e1700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f379406fd30 0x7f37940bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3799ae2700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37941559c0 0x7f379414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 -- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f379406fd30 msgr2=0x7f37940bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f379406fd30 0x7f37940bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 -- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37941559c0 msgr2=0x7f379414ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37941559c0 0x7f379414ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 -- 172.21.15.121:0/1671329001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840094a0 con 0x7f3794152450 2023-08-18T20:44:10.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3798ae0700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f379000c540 tx=0x7f379000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900052d0 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790005430 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c009b30 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.130+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900038c0 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.131+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37941eaf50 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.131+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37941eb450 con 0x7f3794152450 2023-08-18T20:44:10.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.132+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3790003a20 con 0x7f3794152450 2023-08-18T20:44:10.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.132+0000 7f3789ffb700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 0x7f377806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.132+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37900878f0 con 0x7f3794152450 2023-08-18T20:44:10.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.132+0000 7f37992e1700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 0x7f377806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.133+0000 7f37992e1700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 0x7f377806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3784009d70 tx=0x7f3784009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.137+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3790052ff0 con 0x7f3794152450 2023-08-18T20:44:10.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.323+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3794074730 con 0x7f3794152450 2023-08-18T20:44:10.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.324+0000 7f3789ffb700 1 -- 172.21.15.121:0/1671329001 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3790056610 con 0x7f3794152450 2023-08-18T20:44:10.323 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:10.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 msgr2=0x7f377806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 0x7f377806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3784009d70 tx=0x7f3784009210 comp rx=0 tx=0).stop 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 msgr2=0x7f379414e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f379000c540 tx=0x7f379000c850 comp rx=0 tx=0).stop 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 shutdown_connections 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37941559c0 0x7f379414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f379406fd30 0x7f37940bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377806a0e0 0x7f377806c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 --2- 172.21.15.121:0/1671329001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3794152450 0x7f379414e8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 >> 172.21.15.121:0/1671329001 conn(0x7f37940c7bf0 msgr2=0x7f37940c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:10.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 shutdown_connections 2023-08-18T20:44:10.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.326+0000 7f379b545700 1 -- 172.21.15.121:0/1671329001 wait complete. 2023-08-18T20:44:10.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:10.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.461+0000 7fb1ac7f3700 1 Processor -- start 2023-08-18T20:44:10.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.461+0000 7fb1ac7f3700 1 -- start start 2023-08-18T20:44:10.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1ac7f3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 0x7fb1a40c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1ac7f3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40c21f0 con 0x7fb1a406a510 2023-08-18T20:44:10.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1ac7f3700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40c5b20 con 0x7fb1a4157c10 2023-08-18T20:44:10.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1ac7f3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40c2ba0 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1aa58f700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb1a406a510 0x7fb1a4151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47670/0 (socket says 172.21.15.121:47670) 2023-08-18T20:44:10.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1aa58f700 1 -- 172.21.15.121:0/4141294441 learned_addr learned my addr 172.21.15.121:0/4141294441 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:10.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a9d8e700 1 --2- 172.21.15.121:0/4141294441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 0x7fb1a40c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110484275 0 0) 0x7fb1a40c21f0 con 0x7fb1a406a510 2023-08-18T20:44:10.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1900035b0 con 0x7fb1a406a510 2023-08-18T20:44:10.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817267114 0 0) 0x7fb1a40c5b20 con 0x7fb1a4157c10 2023-08-18T20:44:10.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a40c21f0 con 0x7fb1a4157c10 2023-08-18T20:44:10.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/4141294441 >> v1:172.21.15.122:6789/0 conn(0x7fb1a4157c10 legacy=0x7fb1a41580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735026206 0 0) 0x7fb1900035b0 con 0x7fb1a406a510 2023-08-18T20:44:10.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/4141294441 >> v1:172.21.15.121:6789/0 conn(0x7fb1a406a510 legacy=0x7fb1a4151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/4141294441 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40c6510 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.462+0000 7fb1a9d8e700 1 --2- 172.21.15.121:0/4141294441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 0x7fb1a40c5490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c5d4ac7504c6c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194001670 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a0004030 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1a958d700 1 -- 172.21.15.121:0/4141294441 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00043c0 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/4141294441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 msgr2=0x7fb1a40c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/4141294441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 0x7fb1a40c5490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a0009b80 comp rx=0 tx=0).stop 2023-08-18T20:44:10.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/4141294441 shutdown_connections 2023-08-18T20:44:10.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/4141294441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a40c1cf0 0x7fb1a40c5490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/4141294441 >> 172.21.15.121:0/4141294441 conn(0x7fb1a40c6b10 msgr2=0x7fb1a40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:10.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/4141294441 shutdown_connections 2023-08-18T20:44:10.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.463+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/4141294441 wait complete. 2023-08-18T20:44:10.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.464+0000 7fb1ac7f3700 1 Processor -- start 2023-08-18T20:44:10.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.464+0000 7fb1ac7f3700 1 -- start start 2023-08-18T20:44:10.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a406a510 0x7fb1a4099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 0x7fb1a40a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40a5dd0 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a41ea4c0 con 0x7fb1a406a510 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1ac7f3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4153f40 con 0x7fb1a4157c10 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1a9d8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1a9d8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41094/0 (socket says 172.21.15.121:41094) 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/1756277654 learned_addr learned my addr 172.21.15.121:0/1756277654 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:10.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 msgr2=0x7fb1a40a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.465+0000 7fb1aad90700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 0x7fb1a40a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1aa58f700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a406a510 0x7fb1a4099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1a9d8e700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 0x7fb1a40a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a406a510 msgr2=0x7fb1a4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1a9d8e700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a406a510 0x7fb1a4099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1a9d8e700 1 -- 172.21.15.121:0/1756277654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00094a0 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1aad90700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 0x7fb1a40a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1a9d8e700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011630 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a001f070 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a4154220 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00119f0 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.466+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a41ea760 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.467+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a406b220 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.467+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1a0011b50 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.468+0000 7fb19affd700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 0x7fb18806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.468+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1a0021070 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.468+0000 7fb1aa58f700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 0x7fb18806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.468+0000 7fb1aa58f700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 0x7fb18806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1940017a0 tx=0x7fb194009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.472+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb1a0055600 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.661+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1a4072a20 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.661+0000 7fb19affd700 1 -- 172.21.15.121:0/1756277654 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1a4072a20 con 0x7fb1a40c1cf0 2023-08-18T20:44:10.661 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 msgr2=0x7fb18806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 0x7fb18806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1940017a0 tx=0x7fb194009040 comp rx=0 tx=0).stop 2023-08-18T20:44:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 msgr2=0x7fb1a40abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a0004750 comp rx=0 tx=0).stop 2023-08-18T20:44:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 shutdown_connections 2023-08-18T20:44:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1a4157c10 0x7fb1a40a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a406a510 0x7fb1a4099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb18806a0e0 0x7fb18806c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 --2- 172.21.15.121:0/1756277654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1a40c1cf0 0x7fb1a40abf40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.663+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 >> 172.21.15.121:0/1756277654 conn(0x7fb1a40c6b10 msgr2=0x7fb1a4071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.664+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 shutdown_connections 2023-08-18T20:44:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.664+0000 7fb1ac7f3700 1 -- 172.21.15.121:0/1756277654 wait complete. 2023-08-18T20:44:10.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:10.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.803+0000 7fa3f46d8700 1 Processor -- start 2023-08-18T20:44:10.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.803+0000 7fa3f46d8700 1 -- start start 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f46d8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3ec0c7380 0x7fa3ec1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f46d8700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3ec0a6ed0 0x7fa3ec06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f46d8700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec158ae0 con 0x7fa3ec06feb0 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f46d8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec155370 con 0x7fa3ec0c7380 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f46d8700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c7760 con 0x7fa3ec0a6ed0 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2474700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3ec0c7380 0x7fa3ec1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2c75700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa3ec06feb0 0x7fa3ec0c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47684/0 (socket says 172.21.15.121:47684) 2023-08-18T20:44:10.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2c75700 1 -- 172.21.15.121:0/2821130220 learned_addr learned my addr 172.21.15.121:0/2821130220 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:10.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f1c73700 1 --2- 172.21.15.121:0/2821130220 >> v2:172.21.15.122:3300/0 conn(0x7fa3ec0a6ed0 0x7fa3ec06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2474700 1 -- 172.21.15.121:0/2821130220 >> v2:172.21.15.122:3300/0 conn(0x7fa3ec0a6ed0 msgr2=0x7fa3ec06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:10.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2474700 1 --2- 172.21.15.121:0/2821130220 >> v2:172.21.15.122:3300/0 conn(0x7fa3ec0a6ed0 0x7fa3ec06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2474700 1 -- 172.21.15.121:0/2821130220 >> v1:172.21.15.121:6789/0 conn(0x7fa3ec06feb0 legacy=0x7fa3ec0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f2474700 1 -- 172.21.15.121:0/2821130220 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec154760 con 0x7fa3ec0c7380 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.804+0000 7fa3f1472700 1 -- 172.21.15.121:0/2821130220 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102959576 0 0) 0x7fa3e4001490 con 0x7fa3ec06feb0 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f2474700 1 --2- 172.21.15.121:0/2821130220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1585a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0c1ee0 tx=0x7fa3dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f5e341ea5fc884 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f1472700 1 -- 172.21.15.121:0/2821130220 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011830 con 0x7fa3ec0c7380 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f1472700 1 -- 172.21.15.121:0/2821130220 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc011990 con 0x7fa3ec0c7380 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f1472700 1 -- 172.21.15.121:0/2821130220 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011d20 con 0x7fa3ec0c7380 2023-08-18T20:44:10.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 -- 172.21.15.121:0/2821130220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec0c7380 msgr2=0x7fa3ec1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/2821130220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1585a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0c1ee0 tx=0x7fa3dc009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 -- 172.21.15.121:0/2821130220 shutdown_connections 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/2821130220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1585a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/2821130220 >> v2:172.21.15.122:3300/0 conn(0x7fa3ec0a6ed0 0x7fa3ec06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 -- 172.21.15.121:0/2821130220 >> 172.21.15.121:0/2821130220 conn(0x7fa3ec0c7bf0 msgr2=0x7fa3ec0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 -- 172.21.15.121:0/2821130220 shutdown_connections 2023-08-18T20:44:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.805+0000 7fa3f46d8700 1 -- 172.21.15.121:0/2821130220 wait complete. 2023-08-18T20:44:10.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.806+0000 7fa3f46d8700 1 Processor -- start 2023-08-18T20:44:10.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 -- start start 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3ec0a6ed0 0x7fa3ec0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec1ea380 con 0x7fa3ec06feb0 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec1ea0a0 con 0x7fa3ec0c7380 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f46d8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ab350 con 0x7fa3ec0a6ed0 2023-08-18T20:44:10.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f2474700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f2474700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41106/0 (socket says 172.21.15.121:41106) 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f2474700 1 -- 172.21.15.121:0/1176837622 learned_addr learned my addr 172.21.15.121:0/1176837622 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f2c75700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.807+0000 7fa3f1c73700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3ec0a6ed0 0x7fa3ec0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 -- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3ec0a6ed0 msgr2=0x7fa3ec0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3ec0a6ed0 0x7fa3ec0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 -- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 msgr2=0x7fa3ec1e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 -- 172.21.15.121:0/1176837622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0094a0 con 0x7fa3ec06feb0 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2c75700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f2474700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc014040 tx=0x7fa3dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0038a0 con 0x7fa3ec06feb0 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc01e070 con 0x7fa3ec06feb0 2023-08-18T20:44:10.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc003c20 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec0ab630 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.808+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec0c1b70 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.809+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec0abb50 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.809+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3dc02d450 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.809+0000 7fa3e2ffd700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 0x7fa3d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.810+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3dc0894e0 con 0x7fa3ec06feb0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.810+0000 7fa3f1c73700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 0x7fa3d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:10.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.810+0000 7fa3f1c73700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 0x7fa3d006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0ac370 tx=0x7fa3e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:10.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:10.814+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa3ec0abb50 con 0x7fa3ec06feb0 2023-08-18T20:44:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.004+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3ec0abb50 con 0x7fa3ec06feb0 2023-08-18T20:44:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.005+0000 7fa3e2ffd700 1 -- 172.21.15.121:0/1176837622 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3ec0abb50 con 0x7fa3ec06feb0 2023-08-18T20:44:11.005 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:11.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 msgr2=0x7fa3d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 0x7fa3d006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0ac370 tx=0x7fa3e8008040 comp rx=0 tx=0).stop 2023-08-18T20:44:11.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 msgr2=0x7fa3ec0abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc014040 tx=0x7fa3dc004750 comp rx=0 tx=0).stop 2023-08-18T20:44:11.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 shutdown_connections 2023-08-18T20:44:11.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3ec0c7380 0x7fa3ec1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa3d006a0e0 0x7fa3d006c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3ec06feb0 0x7fa3ec0abe30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 --2- 172.21.15.121:0/1176837622 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3ec0a6ed0 0x7fa3ec0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 >> 172.21.15.121:0/1176837622 conn(0x7fa3ec0c7bf0 msgr2=0x7fa3ec0a8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:11.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 shutdown_connections 2023-08-18T20:44:11.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.007+0000 7fa3f46d8700 1 -- 172.21.15.121:0/1176837622 wait complete. 2023-08-18T20:44:11.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:11.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.143+0000 7f2b9c2cd700 1 Processor -- start 2023-08-18T20:44:11.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.143+0000 7f2b9c2cd700 1 -- start start 2023-08-18T20:44:11.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9c2cd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b9414ed30 0x7f2b940c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9c2cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 0x7f2b940c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9c2cd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b940c2260 con 0x7f2b9414e950 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9c2cd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b940a6630 con 0x7f2b9414ed30 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9c2cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94151d90 con 0x7f2b94070950 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b99868700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b9414ed30 0x7f2b940c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9a069700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2b9414e950 0x7f2b940c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47694/0 (socket says 172.21.15.121:47694) 2023-08-18T20:44:11.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b99868700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b9414ed30 0x7f2b940c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41114/0 (socket says 172.21.15.121:41114) 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9a069700 1 -- 172.21.15.121:0/502176882 learned_addr learned my addr 172.21.15.121:0/502176882 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.144+0000 7f2b9a86a700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 0x7f2b940c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99868700 1 -- 172.21.15.121:0/502176882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 msgr2=0x7f2b940c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99868700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 0x7f2b940c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99868700 1 -- 172.21.15.121:0/502176882 >> v1:172.21.15.121:6789/0 conn(0x7f2b9414e950 legacy=0x7f2b940c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99868700 1 -- 172.21.15.121:0/502176882 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94152070 con 0x7f2b9414ed30 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99067700 1 -- 172.21.15.121:0/502176882 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317975696 0 0) 0x7f2b940c2260 con 0x7f2b9414e950 2023-08-18T20:44:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b9a86a700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 0x7f2b940c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:11.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99868700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b9414ed30 0x7f2b940c2ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009840 tx=0x7f2b90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f253b7a463300dc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99067700 1 -- 172.21.15.121:0/502176882 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90011830 con 0x7f2b9414ed30 2023-08-18T20:44:11.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99067700 1 -- 172.21.15.121:0/502176882 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90011990 con 0x7f2b9414ed30 2023-08-18T20:44:11.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b99067700 1 -- 172.21.15.121:0/502176882 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90011d20 con 0x7f2b9414ed30 2023-08-18T20:44:11.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/502176882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b9414ed30 msgr2=0x7f2b940c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.145+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b9414ed30 0x7f2b940c2ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009840 tx=0x7f2b90009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/502176882 shutdown_connections 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b94070950 0x7f2b940c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/502176882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b9414ed30 0x7f2b940c2ed0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/502176882 >> 172.21.15.121:0/502176882 conn(0x7f2b940c6b10 msgr2=0x7f2b940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/502176882 shutdown_connections 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.146+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/502176882 wait complete. 2023-08-18T20:44:11.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 Processor -- start 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 -- start start 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b9414e950 0x7f2b941e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b9414ed30 0x7f2b9406a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94150230 con 0x7f2b94070950 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941ecdc0 con 0x7f2b9414e950 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.147+0000 7f2b9c2cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b941eca90 con 0x7f2b9414ed30 2023-08-18T20:44:11.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41118/0 (socket says 172.21.15.121:41118) 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 -- 172.21.15.121:0/930440087 learned_addr learned my addr 172.21.15.121:0/930440087 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a86a700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b9414ed30 0x7f2b9406a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b99868700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b9414e950 0x7f2b941e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 -- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b9414ed30 msgr2=0x7f2b9406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b9414ed30 0x7f2b9406a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 -- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b9414e950 msgr2=0x7f2b941e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b9414e950 0x7f2b941e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 -- 172.21.15.121:0/930440087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900094a0 con 0x7f2b94070950 2023-08-18T20:44:11.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9a069700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b840011e0 tx=0x7f2b8400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84004c80 con 0x7f2b94070950 2023-08-18T20:44:11.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b84004e00 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9406ce40 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007310 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.148+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b941e9930 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.149+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b940c7690 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.149+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b84007470 con 0x7f2b94070950 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.150+0000 7f2b8affd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 0x7f2b7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.150+0000 7f2b99868700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 0x7f2b7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.150+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b840882e0 con 0x7f2b94070950 2023-08-18T20:44:11.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.150+0000 7f2b99868700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 0x7f2b7806c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b900090b0 tx=0x7f2b90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.154+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2b84053a60 con 0x7f2b94070950 2023-08-18T20:44:11.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.342+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b94074730 con 0x7f2b94070950 2023-08-18T20:44:11.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.342+0000 7f2b8affd700 1 -- 172.21.15.121:0/930440087 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b84057080 con 0x7f2b94070950 2023-08-18T20:44:11.342 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 msgr2=0x7f2b7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 0x7f2b7806c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b900090b0 tx=0x7f2b90008030 comp rx=0 tx=0).stop 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 msgr2=0x7f2b9414f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b840011e0 tx=0x7f2b8400cae0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 shutdown_connections 2023-08-18T20:44:11.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2b9414ed30 0x7f2b9406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2b7806a0e0 0x7f2b7806c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b94070950 0x7f2b9414f980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 --2- 172.21.15.121:0/930440087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b9414e950 0x7f2b941e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 >> 172.21.15.121:0/930440087 conn(0x7f2b940c6b10 msgr2=0x7f2b940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 shutdown_connections 2023-08-18T20:44:11.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.344+0000 7f2b9c2cd700 1 -- 172.21.15.121:0/930440087 wait complete. 2023-08-18T20:44:11.361 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-08-18T20:44:11.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-08-18T20:44:11.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.483+0000 7f57921c3700 1 Processor -- start 2023-08-18T20:44:11.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.483+0000 7f57921c3700 1 -- start start 2023-08-18T20:44:11.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f57921c3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 0x7f578c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f57921c3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f578c14ed30 0x7f578c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f57921c3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0c2260 con 0x7f578c0c19d0 2023-08-18T20:44:11.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f57921c3700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0a6630 con 0x7f578c14ed30 2023-08-18T20:44:11.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f57921c3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c151d90 con 0x7f578c14e950 2023-08-18T20:44:11.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578bfff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f578c0c19d0 0x7f578c0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47712/0 (socket says 172.21.15.121:47712) 2023-08-18T20:44:11.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578bfff700 1 -- 172.21.15.121:0/3895455338 learned_addr learned my addr 172.21.15.121:0/3895455338 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:11.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578affd700 1 --2- 172.21.15.121:0/3895455338 >> v2:172.21.15.122:3300/0 conn(0x7f578c14ed30 0x7f578c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3895455338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 0x7f578c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262940270 0 0) 0x7f578c0c2260 con 0x7f578c0c19d0 2023-08-18T20:44:11.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.484+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57740035b0 con 0x7f578c0c19d0 2023-08-18T20:44:11.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578b7fe700 1 -- 172.21.15.121:0/3895455338 >> v2:172.21.15.122:3300/0 conn(0x7f578c14ed30 msgr2=0x7f578c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:11.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3895455338 >> v2:172.21.15.122:3300/0 conn(0x7f578c14ed30 0x7f578c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578b7fe700 1 -- 172.21.15.121:0/3895455338 >> v1:172.21.15.121:6789/0 conn(0x7f578c0c19d0 legacy=0x7f578c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58274896 0 0) 0x7f57740035b0 con 0x7f578c0c19d0 2023-08-18T20:44:11.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578b7fe700 1 -- 172.21.15.121:0/3895455338 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c152070 con 0x7f578c14e950 2023-08-18T20:44:11.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3895455338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 0x7f578c0c2ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f5780009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a883a87715465171 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840019f0 con 0x7f578c14e950 2023-08-18T20:44:11.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780004030 con 0x7f578c14e950 2023-08-18T20:44:11.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f578a7fc700 1 -- 172.21.15.121:0/3895455338 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800043c0 con 0x7f578c14e950 2023-08-18T20:44:11.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 -- 172.21.15.121:0/3895455338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 msgr2=0x7f578c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 --2- 172.21.15.121:0/3895455338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 0x7f578c0c2ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f5780009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:11.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 -- 172.21.15.121:0/3895455338 shutdown_connections 2023-08-18T20:44:11.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 --2- 172.21.15.121:0/3895455338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c14e950 0x7f578c0c2ed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 --2- 172.21.15.121:0/3895455338 >> v2:172.21.15.122:3300/0 conn(0x7f578c14ed30 0x7f578c0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 -- 172.21.15.121:0/3895455338 >> 172.21.15.121:0/3895455338 conn(0x7f578c0c6b10 msgr2=0x7f578c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:11.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.485+0000 7f57921c3700 1 -- 172.21.15.121:0/3895455338 shutdown_connections 2023-08-18T20:44:11.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.486+0000 7f57921c3700 1 -- 172.21.15.121:0/3895455338 wait complete. 2023-08-18T20:44:11.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 Processor -- start 2023-08-18T20:44:11.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 -- start start 2023-08-18T20:44:11.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c0c19d0 0x7f578c1501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 0x7f578c14c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c06aa90 con 0x7f578c14ed30 2023-08-18T20:44:11.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c1507b0 con 0x7f578c14e950 2023-08-18T20:44:11.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.487+0000 7f57921c3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c06a440 con 0x7f578c0c19d0 2023-08-18T20:44:11.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41136/0 (socket says 172.21.15.121:41136) 2023-08-18T20:44:11.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 -- 172.21.15.121:0/3122856810 learned_addr learned my addr 172.21.15.121:0/3122856810 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:11.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c0c19d0 0x7f578c1501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578affd700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 0x7f578c14c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 -- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c0c19d0 msgr2=0x7f578c1501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c0c19d0 0x7f578c1501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 -- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 msgr2=0x7f578c14c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 0x7f578c14c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 -- 172.21.15.121:0/3122856810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800094a0 con 0x7f578c14ed30 2023-08-18T20:44:11.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578affd700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 0x7f578c14c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:11.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f578bfff700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f578400cca0 tx=0x7f578400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400cea0 con 0x7f578c14ed30 2023-08-18T20:44:11.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400ae00 con 0x7f578c14ed30 2023-08-18T20:44:11.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c06a720 con 0x7f578c14ed30 2023-08-18T20:44:11.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784007310 con 0x7f578c14ed30 2023-08-18T20:44:11.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.488+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c150be0 con 0x7f578c14ed30 2023-08-18T20:44:11.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.489+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c06a2a0 con 0x7f578c14ed30 2023-08-18T20:44:11.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.490+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5784007470 con 0x7f578c14ed30 2023-08-18T20:44:11.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.490+0000 7f5773fff700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 0x7f577806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:11.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.490+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5784088480 con 0x7f578c14ed30 2023-08-18T20:44:11.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.490+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 0x7f577806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:11.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.491+0000 7f578b7fe700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 0x7f577806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57800090b0 tx=0x7f5780008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:11.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.495+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f578c06a2a0 con 0x7f578c14ed30 2023-08-18T20:44:11.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.761+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f578c06a2a0 con 0x7f578c14ed30 2023-08-18T20:44:11.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.890+0000 7f5773fff700 1 -- 172.21.15.121:0/3122856810 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v45) v1 ==== 162+0+0 (secure 0 0 0) 0x7f578c06a2a0 con 0x7f578c14ed30 2023-08-18T20:44:11.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 msgr2=0x7f577806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 0x7f577806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57800090b0 tx=0x7f5780008030 comp rx=0 tx=0).stop 2023-08-18T20:44:11.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 msgr2=0x7f578c1db640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:11.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f578400cca0 tx=0x7f578400a340 comp rx=0 tx=0).stop 2023-08-18T20:44:11.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 shutdown_connections 2023-08-18T20:44:11.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f577806a0e0 0x7f577806c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f578c14ed30 0x7f578c1db640 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f578c0c19d0 0x7f578c1501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 --2- 172.21.15.121:0/3122856810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f578c14e950 0x7f578c14c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 >> 172.21.15.121:0/3122856810 conn(0x7f578c0c6b10 msgr2=0x7f578c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 shutdown_connections 2023-08-18T20:44:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:11.892+0000 7f57921c3700 1 -- 172.21.15.121:0/3122856810 wait complete. 2023-08-18T20:44:11.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:12.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 Processor -- start 2023-08-18T20:44:12.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 -- start start 2023-08-18T20:44:12.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1860155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186006f920 con 0x7f18600a6d40 2023-08-18T20:44:12.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186006eb60 con 0x7f18600c5a90 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.025+0000 7f1865747700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186006e980 con 0x7f186014e6c0 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185e7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f18600a6d40 0x7f18600c7b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47724/0 (socket says 172.21.15.121:47724) 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185e7fc700 1 -- 172.21.15.121:0/3464966628 learned_addr learned my addr 172.21.15.121:0/3464966628 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185effd700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1860155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584588320 0 0) 0x7f186006f920 con 0x7f18600a6d40 2023-08-18T20:44:12.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18480035b0 con 0x7f18600a6d40 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352966680 0 0) 0x7f186006eb60 con 0x7f18600c5a90 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f186006f920 con 0x7f18600c5a90 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474445294 0 0) 0x7f18480035b0 con 0x7f18600a6d40 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 msgr2=0x7f1860155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1860155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 >> v1:172.21.15.122:6789/0 conn(0x7f18600c5a90 legacy=0x7f18600c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186006ee40 con 0x7f18600a6d40 2023-08-18T20:44:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1854001670 con 0x7f18600a6d40 2023-08-18T20:44:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 >> v1:172.21.15.121:6789/0 conn(0x7f18600a6d40 legacy=0x7f18600c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1848003c30 0x7f1848004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1848004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1848004d90 0x7f1848005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186006e980 con 0x7f1848004d90 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184800bba0 con 0x7f1848003c30 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184800bd60 con 0x7f186014e6c0 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185f7fe700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1848004d90 0x7f1848005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185effd700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1848003c30 0x7f1848004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.026+0000 7f185e7fc700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1848004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 -- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 msgr2=0x7f1848004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f186014e6c0 0x7f1848004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 -- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1848003c30 msgr2=0x7f1848004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1848003c30 0x7f1848004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 -- 172.21.15.121:0/3464966628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480035b0 con 0x7f1848004d90 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1848004d90 0x7f1848005210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f185800c2f0 tx=0x7f1848005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd397ffd1f354ca server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858001f30 con 0x7f1848004d90 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800ce90 con 0x7f1848004d90 2023-08-18T20:44:12.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185dffb700 1 -- 172.21.15.121:0/3464966628 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858003c40 con 0x7f1848004d90 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 -- 172.21.15.121:0/3464966628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1848004d90 msgr2=0x7f1848005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 --2- 172.21.15.121:0/3464966628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1848004d90 0x7f1848005210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f185800c2f0 tx=0x7f1848005880 comp rx=0 tx=0).stop 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f185f7fe700 1 -- 172.21.15.121:0/3464966628 reap_dead start 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 -- 172.21.15.121:0/3464966628 shutdown_connections 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 -- 172.21.15.121:0/3464966628 >> 172.21.15.121:0/3464966628 conn(0x7f18600a96a0 msgr2=0x7f18600a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 -- 172.21.15.121:0/3464966628 shutdown_connections 2023-08-18T20:44:12.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.027+0000 7f1865747700 1 -- 172.21.15.121:0/3464966628 wait complete. 2023-08-18T20:44:12.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 Processor -- start 2023-08-18T20:44:12.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 -- start start 2023-08-18T20:44:12.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1860153c70 0x7f18601ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18600c7050 0x7f18601ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601ea280 con 0x7f18601eac10 2023-08-18T20:44:12.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601eb0c0 con 0x7f1860153c70 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.029+0000 7f1865747700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18601ee570 con 0x7f18600c7050 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41156/0 (socket says 172.21.15.121:41156) 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 -- 172.21.15.121:0/2219036291 learned_addr learned my addr 172.21.15.121:0/2219036291 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185e7fc700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18600c7050 0x7f18601ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185effd700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1860153c70 0x7f18601ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 -- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18600c7050 msgr2=0x7f18601ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18600c7050 0x7f18601ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 -- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1860153c70 msgr2=0x7f18601ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1860153c70 0x7f18601ee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 -- 172.21.15.121:0/2219036291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860150b40 con 0x7f18601eac10 2023-08-18T20:44:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f185f7fe700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1858004000 tx=0x7f1858001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858001400 con 0x7f18601eac10 2023-08-18T20:44:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580050d0 con 0x7f18601eac10 2023-08-18T20:44:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186014d700 con 0x7f18601eac10 2023-08-18T20:44:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858005460 con 0x7f18601eac10 2023-08-18T20:44:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.030+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186014b3e0 con 0x7f18601eac10 2023-08-18T20:44:12.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.031+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18601ea3f0 con 0x7f18601eac10 2023-08-18T20:44:12.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.032+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1858019040 con 0x7f18601eac10 2023-08-18T20:44:12.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.032+0000 7f18477fe700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 0x7f184c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.032+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18580892a0 con 0x7f18601eac10 2023-08-18T20:44:12.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.032+0000 7f185effd700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 0x7f184c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.032+0000 7f185effd700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 0x7f184c06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1850009c60 tx=0x7f1850009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.036+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f18601ea3f0 con 0x7f18601eac10 2023-08-18T20:44:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.228+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18600c7590 con 0x7f18601eac10 2023-08-18T20:44:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.229+0000 7f18477fe700 1 -- 172.21.15.121:0/2219036291 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f1858054ae0 con 0x7f18601eac10 2023-08-18T20:44:12.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:12.229 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:12.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 msgr2=0x7f184c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 0x7f184c06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1850009c60 tx=0x7f1850009210 comp rx=0 tx=0).stop 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 msgr2=0x7f1860157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1858004000 tx=0x7f1858001650 comp rx=0 tx=0).stop 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 shutdown_connections 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f184c06a0e0 0x7f184c06c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18601eac10 0x7f1860157f60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1860153c70 0x7f18601ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 --2- 172.21.15.121:0/2219036291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18600c7050 0x7f18601ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 >> 172.21.15.121:0/2219036291 conn(0x7f18600a96a0 msgr2=0x7f186014ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 shutdown_connections 2023-08-18T20:44:12.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.231+0000 7f1865747700 1 -- 172.21.15.121:0/2219036291 wait complete. 2023-08-18T20:44:12.243 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:12.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:12.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 Processor -- start 2023-08-18T20:44:12.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 -- start start 2023-08-18T20:44:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc02806fd30 0x7fc0280c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc028152450 0x7fc0280c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0281529a0 con 0x7fc0281559c0 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc028152c80 con 0x7fc02806fd30 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.368+0000 7fc02e66e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc028152f60 con 0x7fc028152450 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc02806fd30 0x7fc0280c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc0277fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc028152450 0x7fc0280c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc02806fd30 0x7fc0280c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:50998/0 (socket says 172.21.15.121:50998) 2023-08-18T20:44:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 -- 172.21.15.121:0/2347018800 learned_addr learned my addr 172.21.15.121:0/2347018800 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 -- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc028152450 msgr2=0x7fc0280c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 --2- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc028152450 0x7fc0280c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 -- 172.21.15.121:0/2347018800 >> v1:172.21.15.122:6789/0 conn(0x7fc0281559c0 legacy=0x7fc02814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 -- 172.21.15.121:0/2347018800 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028153240 con 0x7fc02806fd30 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc027fff700 1 --2- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc02806fd30 0x7fc0280c6d30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0098f0 tx=0x7fc01c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee2ca711b2811a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.369+0000 7fc026ffd700 1 -- 172.21.15.121:0/2347018800 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c011830 con 0x7fc02806fd30 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc026ffd700 1 -- 172.21.15.121:0/2347018800 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c011990 con 0x7fc02806fd30 2023-08-18T20:44:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc026ffd700 1 -- 172.21.15.121:0/2347018800 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c011d20 con 0x7fc02806fd30 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 -- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc02806fd30 msgr2=0x7fc0280c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 --2- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc02806fd30 0x7fc0280c6d30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0098f0 tx=0x7fc01c009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 -- 172.21.15.121:0/2347018800 shutdown_connections 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 --2- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc02806fd30 0x7fc0280c6d30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 --2- 172.21.15.121:0/2347018800 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc028152450 0x7fc0280c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 -- 172.21.15.121:0/2347018800 >> 172.21.15.121:0/2347018800 conn(0x7fc0280c7bf0 msgr2=0x7fc0280c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 -- 172.21.15.121:0/2347018800 shutdown_connections 2023-08-18T20:44:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.370+0000 7fc02e66e700 1 -- 172.21.15.121:0/2347018800 wait complete. 2023-08-18T20:44:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.371+0000 7fc02e66e700 1 Processor -- start 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.371+0000 7fc02e66e700 1 -- start start 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc02806fd30 0x7fc0280a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 0x7fc0281548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0281ed020 con 0x7fc0281559c0 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280c0a50 con 0x7fc028152450 2023-08-18T20:44:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02e66e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280bf030 con 0x7fc02806fd30 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41170/0 (socket says 172.21.15.121:41170) 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 -- 172.21.15.121:0/130115203 learned_addr learned my addr 172.21.15.121:0/130115203 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc027fff700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc02806fd30 0x7fc0280a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc0277fe700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 0x7fc0281548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 -- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc02806fd30 msgr2=0x7fc0280a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc02806fd30 0x7fc0280a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 -- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 msgr2=0x7fc0281548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.372+0000 7fc02cc0b700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 0x7fc0281548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc02cc0b700 1 -- 172.21.15.121:0/130115203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c009550 con 0x7fc0281559c0 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc0277fe700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 0x7fc0281548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc02cc0b700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc02000cb80 tx=0x7fc02000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020003c00 con 0x7fc0281559c0 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020003d60 con 0x7fc0281559c0 2023-08-18T20:44:12.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000abb0 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280bf310 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.373+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc028154e30 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.374+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc028074730 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.374+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc02000ad10 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.375+0000 7fc024ff9700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 0x7fc01406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.375+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc020088550 con 0x7fc0281559c0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.375+0000 7fc027fff700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 0x7fc01406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.375+0000 7fc027fff700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 0x7fc01406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009c40 tx=0x7fc01c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.379+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc020053cd0 con 0x7fc0281559c0 2023-08-18T20:44:12.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.568+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0280c5580 con 0x7fc0281559c0 2023-08-18T20:44:12.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.568+0000 7fc024ff9700 1 -- 172.21.15.121:0/130115203 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0200572f0 con 0x7fc0281559c0 2023-08-18T20:44:12.568 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 msgr2=0x7fc01406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 0x7fc01406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009c40 tx=0x7fc01c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 msgr2=0x7fc0281ed4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc02000cb80 tx=0x7fc02000cf40 comp rx=0 tx=0).stop 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 shutdown_connections 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc01406a0e0 0x7fc01406c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0281559c0 0x7fc0281ed4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc02806fd30 0x7fc0280a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 --2- 172.21.15.121:0/130115203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc028152450 0x7fc0281548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 >> 172.21.15.121:0/130115203 conn(0x7fc0280c7bf0 msgr2=0x7fc028153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 shutdown_connections 2023-08-18T20:44:12.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.570+0000 7fc02e66e700 1 -- 172.21.15.121:0/130115203 wait complete. 2023-08-18T20:44:12.582 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:12.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.706+0000 7fa2561b0700 1 Processor -- start 2023-08-18T20:44:12.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.706+0000 7fa2561b0700 1 -- start start 2023-08-18T20:44:12.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa2500c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 0x7fa250151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa250151ec0 0x7fa250157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500c2ba0 con 0x7fa250151ec0 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500c6300 con 0x7fa2500c1cf0 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa2561b0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa250072a20 con 0x7fa25006a510 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa250151ec0 0x7fa250157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa250151ec0 0x7fa250157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41178/0 (socket says 172.21.15.121:41178) 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 -- 172.21.15.121:0/3279465837 learned_addr learned my addr 172.21.15.121:0/3279465837 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa246ffd700 1 --2- 172.21.15.121:0/3279465837 >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 0x7fa250151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24f7fe700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa2500c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 -- 172.21.15.121:0/3279465837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 msgr2=0x7fa2500c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa2500c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 -- 172.21.15.121:0/3279465837 >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 msgr2=0x7fa250151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 --2- 172.21.15.121:0/3279465837 >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 0x7fa250151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 -- 172.21.15.121:0/3279465837 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500c21f0 con 0x7fa250151ec0 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa246ffd700 1 --2- 172.21.15.121:0/3279465837 >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 0x7fa250151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24ffff700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa250151ec0 0x7fa250157c10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2500675d0 tx=0x7fa24800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1bc02a335e6bfe server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.707+0000 7fa24effd700 1 -- 172.21.15.121:0/3279465837 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800e070 con 0x7fa250151ec0 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa24effd700 1 -- 172.21.15.121:0/3279465837 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800b980 con 0x7fa250151ec0 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa24effd700 1 -- 172.21.15.121:0/3279465837 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800bd30 con 0x7fa250151ec0 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 -- 172.21.15.121:0/3279465837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa250151ec0 msgr2=0x7fa250157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa250151ec0 0x7fa250157c10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2500675d0 tx=0x7fa24800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 -- 172.21.15.121:0/3279465837 shutdown_connections 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa250151ec0 0x7fa250157c10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3279465837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa2500c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3279465837 >> v2:172.21.15.122:3300/0 conn(0x7fa2500c1cf0 0x7fa250151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 -- 172.21.15.121:0/3279465837 >> 172.21.15.121:0/3279465837 conn(0x7fa2500c6b10 msgr2=0x7fa2500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 -- 172.21.15.121:0/3279465837 shutdown_connections 2023-08-18T20:44:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.708+0000 7fa2561b0700 1 -- 172.21.15.121:0/3279465837 wait complete. 2023-08-18T20:44:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.709+0000 7fa2561b0700 1 Processor -- start 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.709+0000 7fa2561b0700 1 -- start start 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa25014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 0x7fa2501ec910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a6240 con 0x7fa2500c1cf0 2023-08-18T20:44:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a9b00 con 0x7fa250151ec0 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa2561b0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a9d50 con 0x7fa25006a510 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41182/0 (socket says 172.21.15.121:41182) 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 -- 172.21.15.121:0/3525741765 learned_addr learned my addr 172.21.15.121:0/3525741765 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa24ffff700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 0x7fa2501ec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 -- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 msgr2=0x7fa25014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa24f7fe700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa25014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa25014dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 -- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 msgr2=0x7fa2501ec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 0x7fa2501ec910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa246ffd700 1 -- 172.21.15.121:0/3525741765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248009b30 con 0x7fa2500c1cf0 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa24ffff700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 0x7fa2501ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.710+0000 7fa24f7fe700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa25014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa246ffd700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e810 tx=0x7fa23800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238013610 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238013770 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500ac150 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238013b20 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.711+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2500aa030 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.712+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2500ac670 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.712+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa238013c80 con 0x7fa2500c1cf0 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.712+0000 7fa24cff9700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.712+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2380881d0 con 0x7fa2500c1cf0 2023-08-18T20:44:12.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.713+0000 7fa24f7fe700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:12.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.713+0000 7fa24f7fe700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 0x7fa23006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa2400099e0 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:12.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.717+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa2500ac670 con 0x7fa2500c1cf0 2023-08-18T20:44:12.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.906+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2500ac670 con 0x7fa2500c1cf0 2023-08-18T20:44:12.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.907+0000 7fa24cff9700 1 -- 172.21.15.121:0/3525741765 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2500ac670 con 0x7fa2500c1cf0 2023-08-18T20:44:12.907 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:12.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 msgr2=0x7fa23006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 0x7fa23006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa2400099e0 tx=0x7fa240008040 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 msgr2=0x7fa25014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e810 tx=0x7fa23800ebd0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 shutdown_connections 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa250151ec0 0x7fa2501ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa25006a510 0x7fa25014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 --2- 172.21.15.121:0/3525741765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2500c1cf0 0x7fa25014e240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 >> 172.21.15.121:0/3525741765 conn(0x7fa2500c6b10 msgr2=0x7fa250156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:12.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 shutdown_connections 2023-08-18T20:44:12.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:12.909+0000 7fa2561b0700 1 -- 172.21.15.121:0/3525741765 wait complete. 2023-08-18T20:44:12.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.044+0000 7ff39db4a700 1 Processor -- start 2023-08-18T20:44:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.044+0000 7ff39db4a700 1 -- start start 2023-08-18T20:44:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff39db4a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff3980c0c50 0x7ff39806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff39db4a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff39806a7e0 0x7ff3980c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff39db4a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980c4f40 con 0x7ff3980a6290 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff39db4a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3980c6120 con 0x7ff39806a7e0 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff39db4a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3981551f0 con 0x7ff3980c0c50 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff39806a7e0 0x7ff3980c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff397fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff3980a6290 0x7ff398071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47772/0 (socket says 172.21.15.121:47772) 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff397fff700 1 -- 172.21.15.121:0/3181722131 learned_addr learned my addr 172.21.15.121:0/3181722131 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff3977fe700 1 --2- 172.21.15.121:0/3181722131 >> v2:172.21.15.122:3300/0 conn(0x7ff3980c0c50 0x7ff39806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 -- 172.21.15.121:0/3181722131 >> v2:172.21.15.122:3300/0 conn(0x7ff3980c0c50 msgr2=0x7ff39806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 --2- 172.21.15.121:0/3181722131 >> v2:172.21.15.122:3300/0 conn(0x7ff3980c0c50 0x7ff39806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 -- 172.21.15.121:0/3181722131 >> v1:172.21.15.121:6789/0 conn(0x7ff3980a6290 legacy=0x7ff398071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 -- 172.21.15.121:0/3181722131 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980c63a0 con 0x7ff39806a7e0 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff3967fc700 1 -- 172.21.15.121:0/3181722131 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801427818 0 0) 0x7ff3980c4f40 con 0x7ff3980a6290 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff396ffd700 1 --2- 172.21.15.121:0/3181722131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff39806a7e0 0x7ff3980c53d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff398067fc0 tx=0x7ff388009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fc5edc4d820a91 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.045+0000 7ff3967fc700 1 -- 172.21.15.121:0/3181722131 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388011830 con 0x7ff39806a7e0 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff3967fc700 1 -- 172.21.15.121:0/3181722131 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388011990 con 0x7ff39806a7e0 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff3967fc700 1 -- 172.21.15.121:0/3181722131 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388011d20 con 0x7ff39806a7e0 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 -- 172.21.15.121:0/3181722131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff39806a7e0 msgr2=0x7ff3980c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 --2- 172.21.15.121:0/3181722131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff39806a7e0 0x7ff3980c53d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff398067fc0 tx=0x7ff388009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 -- 172.21.15.121:0/3181722131 shutdown_connections 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 --2- 172.21.15.121:0/3181722131 >> v2:172.21.15.122:3300/0 conn(0x7ff3980c0c50 0x7ff39806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 --2- 172.21.15.121:0/3181722131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff39806a7e0 0x7ff3980c53d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 -- 172.21.15.121:0/3181722131 >> 172.21.15.121:0/3181722131 conn(0x7ff3980c6b10 msgr2=0x7ff3980c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 -- 172.21.15.121:0/3181722131 shutdown_connections 2023-08-18T20:44:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.046+0000 7ff39db4a700 1 -- 172.21.15.121:0/3181722131 wait complete. 2023-08-18T20:44:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.047+0000 7ff39db4a700 1 Processor -- start 2023-08-18T20:44:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.047+0000 7ff39db4a700 1 -- start start 2023-08-18T20:44:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff39806a7e0 0x7ff39814bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3980a6290 0x7ff398157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398157de0 con 0x7ff3980c0c50 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398158310 con 0x7ff39806a7e0 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff39db4a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981ed980 con 0x7ff3980a6290 2023-08-18T20:44:13.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41198/0 (socket says 172.21.15.121:41198) 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 -- 172.21.15.121:0/1326423720 learned_addr learned my addr 172.21.15.121:0/1326423720 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 -- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3980a6290 msgr2=0x7ff398157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff396ffd700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3980a6290 0x7ff398157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff3977fe700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff39806a7e0 0x7ff39814bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3980a6290 0x7ff398157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 -- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff39806a7e0 msgr2=0x7ff39814bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff39806a7e0 0x7ff39814bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.048+0000 7ff397fff700 1 -- 172.21.15.121:0/1326423720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880094a0 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff397fff700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff390002230 tx=0x7ff39000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000ac20 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000ada0 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3981edc20 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390007310 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.049+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3981ed680 con 0x7ff3980c0c50 2023-08-18T20:44:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.050+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff398074730 con 0x7ff3980c0c50 2023-08-18T20:44:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.050+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff390007470 con 0x7ff3980c0c50 2023-08-18T20:44:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.051+0000 7ff37ffff700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 0x7ff38406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.051+0000 7ff3977fe700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 0x7ff38406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.051+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff390088490 con 0x7ff3980c0c50 2023-08-18T20:44:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.051+0000 7ff3977fe700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 0x7ff38406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff38c008850 tx=0x7ff38c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.055+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff390053b70 con 0x7ff3980c0c50 2023-08-18T20:44:13.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.246+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3980c4a10 con 0x7ff3980c0c50 2023-08-18T20:44:13.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.247+0000 7ff37ffff700 1 -- 172.21.15.121:0/1326423720 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff390057190 con 0x7ff3980c0c50 2023-08-18T20:44:13.246 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 msgr2=0x7ff38406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 0x7ff38406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff38c008850 tx=0x7ff38c008040 comp rx=0 tx=0).stop 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 msgr2=0x7ff3981ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff390002230 tx=0x7ff39000a060 comp rx=0 tx=0).stop 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 shutdown_connections 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff38406a0e0 0x7ff38406c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3980c0c50 0x7ff3981ed140 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff39806a7e0 0x7ff39814bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 --2- 172.21.15.121:0/1326423720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3980a6290 0x7ff398157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 >> 172.21.15.121:0/1326423720 conn(0x7ff3980c6b10 msgr2=0x7ff3980c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 shutdown_connections 2023-08-18T20:44:13.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.249+0000 7ff39db4a700 1 -- 172.21.15.121:0/1326423720 wait complete. 2023-08-18T20:44:13.260 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:13.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.383+0000 7efd1bff9700 1 Processor -- start 2023-08-18T20:44:13.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.383+0000 7efd1bff9700 1 -- start start 2023-08-18T20:44:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1bff9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd140c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1bff9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd14070950 0x7efd140c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1bff9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd140c2260 con 0x7efd1414ed30 2023-08-18T20:44:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1bff9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd140a6630 con 0x7efd14070950 2023-08-18T20:44:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1bff9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd14151d90 con 0x7efd1414e950 2023-08-18T20:44:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd19594700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efd1414ed30 0x7efd140c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47784/0 (socket says 172.21.15.121:47784) 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd19594700 1 -- 172.21.15.121:0/1303034725 learned_addr learned my addr 172.21.15.121:0/1303034725 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.384+0000 7efd1a596700 1 --2- 172.21.15.121:0/1303034725 >> v2:172.21.15.121:3300/0 conn(0x7efd14070950 0x7efd140c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd18d93700 1 -- 172.21.15.121:0/1303034725 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226877000 0 0) 0x7efd140c2260 con 0x7efd1414ed30 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd19d95700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd140c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd18d93700 1 -- 172.21.15.121:0/1303034725 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd000035b0 con 0x7efd1414ed30 2023-08-18T20:44:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1a596700 1 -- 172.21.15.121:0/1303034725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 msgr2=0x7efd140c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1a596700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd140c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1a596700 1 -- 172.21.15.121:0/1303034725 >> v1:172.21.15.121:6789/0 conn(0x7efd1414ed30 legacy=0x7efd140c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1a596700 1 -- 172.21.15.121:0/1303034725 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14152070 con 0x7efd14070950 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1a596700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd140c4b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009d90 tx=0x7efd0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96873b86b6b97cb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd18d93700 1 -- 172.21.15.121:0/1303034725 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00e070 con 0x7efd14070950 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd18d93700 1 -- 172.21.15.121:0/1303034725 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00bb20 con 0x7efd14070950 2023-08-18T20:44:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd18d93700 1 -- 172.21.15.121:0/1303034725 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c012430 con 0x7efd14070950 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.385+0000 7efd1bff9700 1 -- 172.21.15.121:0/1303034725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 msgr2=0x7efd140c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd140c4b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009d90 tx=0x7efd0c00b330 comp rx=0 tx=0).stop 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 -- 172.21.15.121:0/1303034725 shutdown_connections 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd140c4b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1303034725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd140c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 -- 172.21.15.121:0/1303034725 >> 172.21.15.121:0/1303034725 conn(0x7efd140c6b10 msgr2=0x7efd140c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 -- 172.21.15.121:0/1303034725 shutdown_connections 2023-08-18T20:44:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.386+0000 7efd1bff9700 1 -- 172.21.15.121:0/1303034725 wait complete. 2023-08-18T20:44:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 Processor -- start 2023-08-18T20:44:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 -- start start 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd141451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd1414ed30 0x7efd141456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140ac330 con 0x7efd14070950 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd141d96c0 con 0x7efd1414ed30 2023-08-18T20:44:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.387+0000 7efd1bff9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140ac960 con 0x7efd1414e950 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41208/0 (socket says 172.21.15.121:41208) 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 -- 172.21.15.121:0/1414951850 learned_addr learned my addr 172.21.15.121:0/1414951850 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19594700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd141451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 -- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 msgr2=0x7efd141451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd141451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 -- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd1414ed30 msgr2=0x7efd141456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd1a596700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd1414ed30 0x7efd141456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd1414ed30 0x7efd141456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 -- 172.21.15.121:0/1414951850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c009a70 con 0x7efd14070950 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd19d95700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd0400c7f0 tx=0x7efd0400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04011800 con 0x7efd14070950 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd04011960 con 0x7efd14070950 2023-08-18T20:44:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04011cf0 con 0x7efd14070950 2023-08-18T20:44:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd141d9920 con 0x7efd14070950 2023-08-18T20:44:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.388+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd140c0de0 con 0x7efd14070950 2023-08-18T20:44:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.389+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd14074730 con 0x7efd14070950 2023-08-18T20:44:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.390+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd04018360 con 0x7efd14070950 2023-08-18T20:44:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.390+0000 7efd0a7fc700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 0x7efcf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.390+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd04088570 con 0x7efd14070950 2023-08-18T20:44:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.390+0000 7efd19594700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 0x7efcf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.390+0000 7efd19594700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 0x7efcf806c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd140710f0 tx=0x7efd10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.394+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efd04057700 con 0x7efd14070950 2023-08-18T20:44:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.583+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd14150c40 con 0x7efd14070950 2023-08-18T20:44:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.584+0000 7efd0a7fc700 1 -- 172.21.15.121:0/1414951850 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd04057290 con 0x7efd14070950 2023-08-18T20:44:13.583 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 msgr2=0x7efcf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 0x7efcf806c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd140710f0 tx=0x7efd10009040 comp rx=0 tx=0).stop 2023-08-18T20:44:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 msgr2=0x7efd141dbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd0400c7f0 tx=0x7efd0400cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 shutdown_connections 2023-08-18T20:44:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd1414ed30 0x7efd141456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efcf806a0e0 0x7efcf806c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd14070950 0x7efd141dbb30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 --2- 172.21.15.121:0/1414951850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd1414e950 0x7efd141451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 >> 172.21.15.121:0/1414951850 conn(0x7efd140c6b10 msgr2=0x7efd140c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 shutdown_connections 2023-08-18T20:44:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.586+0000 7efd1bff9700 1 -- 172.21.15.121:0/1414951850 wait complete. 2023-08-18T20:44:13.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-18T20:44:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.721+0000 7fd47cf09700 1 Processor -- start 2023-08-18T20:44:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.721+0000 7fd47cf09700 1 -- start start 2023-08-18T20:44:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47cf09700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4780a6380 0x7fd47806a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47cf09700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 0x7fd478152300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47cf09700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd478155f40 con 0x7fd47806a2a0 2023-08-18T20:44:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47cf09700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47806dd20 con 0x7fd4780a6380 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47cf09700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4781529e0 con 0x7fd4780a5d30 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4780a6380 0x7fd47806a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4780a6380 0x7fd47806a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41218/0 (socket says 172.21.15.121:41218) 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 -- 172.21.15.121:0/2768637494 learned_addr learned my addr 172.21.15.121:0/2768637494 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd476d9d700 1 --2- 172.21.15.121:0/2768637494 >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 0x7fd478152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 -- 172.21.15.121:0/2768637494 >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 msgr2=0x7fd478152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 --2- 172.21.15.121:0/2768637494 >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 0x7fd478152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 -- 172.21.15.121:0/2768637494 >> v1:172.21.15.122:6789/0 conn(0x7fd47806a2a0 legacy=0x7fd4780c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 -- 172.21.15.121:0/2768637494 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780c2fa0 con 0x7fd4780a6380 2023-08-18T20:44:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd476d9d700 1 --2- 172.21.15.121:0/2768637494 >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 0x7fd478152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd475d9b700 1 --2- 172.21.15.121:0/2768637494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4780a6380 0x7fd47806a680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd47806d640 tx=0x7fd46c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285517edb3d81fd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47559a700 1 -- 172.21.15.121:0/2768637494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c004230 con 0x7fd4780a6380 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47559a700 1 -- 172.21.15.121:0/2768637494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c004390 con 0x7fd4780a6380 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.722+0000 7fd47559a700 1 -- 172.21.15.121:0/2768637494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0036a0 con 0x7fd4780a6380 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 -- 172.21.15.121:0/2768637494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4780a6380 msgr2=0x7fd47806a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 --2- 172.21.15.121:0/2768637494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4780a6380 0x7fd47806a680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd47806d640 tx=0x7fd46c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 -- 172.21.15.121:0/2768637494 shutdown_connections 2023-08-18T20:44:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 --2- 172.21.15.121:0/2768637494 >> v2:172.21.15.122:3300/0 conn(0x7fd4780a5d30 0x7fd478152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 --2- 172.21.15.121:0/2768637494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4780a6380 0x7fd47806a680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 -- 172.21.15.121:0/2768637494 >> 172.21.15.121:0/2768637494 conn(0x7fd4780a8800 msgr2=0x7fd4780a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 -- 172.21.15.121:0/2768637494 shutdown_connections 2023-08-18T20:44:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.723+0000 7fd47cf09700 1 -- 172.21.15.121:0/2768637494 wait complete. 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.724+0000 7fd47cf09700 1 Processor -- start 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.724+0000 7fd47cf09700 1 -- start start 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4780a5d30 0x7fd4780c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 0x7fd4781e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd478149390 con 0x7fd47806a2a0 2023-08-18T20:44:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd478151000 con 0x7fd478151ba0 2023-08-18T20:44:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47cf09700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4781ee090 con 0x7fd4780a5d30 2023-08-18T20:44:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41224/0 (socket says 172.21.15.121:41224) 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 -- 172.21.15.121:0/177430844 learned_addr learned my addr 172.21.15.121:0/177430844 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd475d9b700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4780a5d30 0x7fd4780c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd476d9d700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 0x7fd4781e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 -- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4780a5d30 msgr2=0x7fd4780c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4780a5d30 0x7fd4780c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 -- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 msgr2=0x7fd4781e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 0x7fd4781e6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd47659c700 1 -- 172.21.15.121:0/177430844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009550 con 0x7fd47806a2a0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.725+0000 7fd476d9d700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 0x7fd4781e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd47659c700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b4a0 tx=0x7fd46800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468011830 con 0x7fd47806a2a0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd468011990 con 0x7fd47806a2a0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468011d40 con 0x7fd47806a2a0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4781520a0 con 0x7fd47806a2a0 2023-08-18T20:44:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.726+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd478070f40 con 0x7fd47806a2a0 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.727+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4781525c0 con 0x7fd47806a2a0 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.727+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd46801a400 con 0x7fd47806a2a0 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.727+0000 7fd466ffd700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 0x7fd45806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.728+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd468088230 con 0x7fd47806a2a0 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.728+0000 7fd475d9b700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 0x7fd45806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.728+0000 7fd475d9b700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 0x7fd45806c5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009130 tx=0x7fd46c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.732+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd4781525c0 con 0x7fd47806a2a0 2023-08-18T20:44:13.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.923+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd478070da0 con 0x7fd47806a2a0 2023-08-18T20:44:13.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.926+0000 7fd466ffd700 1 -- 172.21.15.121:0/177430844 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd478070da0 con 0x7fd47806a2a0 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 msgr2=0x7fd45806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 0x7fd45806c5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009130 tx=0x7fd46c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 msgr2=0x7fd4781edb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b4a0 tx=0x7fd46800b7b0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 shutdown_connections 2023-08-18T20:44:13.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478151ba0 0x7fd4781e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd45806a110 0x7fd45806c5d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd47806a2a0 0x7fd4781edb50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 --2- 172.21.15.121:0/177430844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4780a5d30 0x7fd4780c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 >> 172.21.15.121:0/177430844 conn(0x7fd4780a8800 msgr2=0x7fd4780a7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 shutdown_connections 2023-08-18T20:44:13.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:13.928+0000 7fd47cf09700 1 -- 172.21.15.121:0/177430844 wait complete. 2023-08-18T20:44:13.940 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-18T20:44:13.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:44:13.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:44:14.032 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-18T20:44:14.032 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:44:14.033 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:14.051 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:44:14.051 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:14.108 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:44:14.108 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:14.165 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:14.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.325+0000 7f68f7409700 1 Processor -- start 2023-08-18T20:44:14.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.325+0000 7f68f7409700 1 -- start start 2023-08-18T20:44:14.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f7409700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68f00c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f7409700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f0152200 con 0x7f68f00a71f0 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f7409700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00c51a0 con 0x7f68f00c4170 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f7409700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00aa740 con 0x7f68f0152fa0 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f59a6700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f68f00a71f0 0x7f68f00c4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47816/0 (socket says 172.21.15.121:47816) 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f59a6700 1 -- 172.21.15.121:0/241155081 learned_addr learned my addr 172.21.15.121:0/241155081 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.326+0000 7f68f49a4700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68f00c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707857031 0 0) 0x7f68f0152200 con 0x7f68f00a71f0 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68dc0035b0 con 0x7f68f00a71f0 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731371985 0 0) 0x7f68f00c51a0 con 0x7f68f00c4170 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f0152200 con 0x7f68f00c4170 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4108080264 0 0) 0x7f68dc0035b0 con 0x7f68f00a71f0 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 msgr2=0x7f68f00c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68f00c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 >> v1:172.21.15.122:6789/0 conn(0x7f68f00c4170 legacy=0x7f68f00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f01565c0 con 0x7f68f00a71f0 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f68e80019f0 con 0x7f68f00a71f0 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 >> v1:172.21.15.121:6789/0 conn(0x7f68f00a71f0 legacy=0x7f68f00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68dc003c30 0x7f68dc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68dc004850 0x7f68dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68dc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00aa740 con 0x7f68dc003c30 2023-08-18T20:44:14.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00bba0 con 0x7f68dc004850 2023-08-18T20:44:14.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00bd60 con 0x7f68f0152fa0 2023-08-18T20:44:14.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68dc003c30 0x7f68dc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f59a6700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68dc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f49a4700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68dc004850 0x7f68dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 -- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 msgr2=0x7f68dc0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68f0152fa0 0x7f68dc0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 -- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68dc004850 msgr2=0x7f68dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68dc004850 0x7f68dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 -- 172.21.15.121:0/241155081 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0035b0 con 0x7f68dc003c30 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f49a4700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68dc004850 0x7f68dc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:14.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.327+0000 7f68f51a5700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68dc003c30 0x7f68dc004030 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001980 tx=0x7f68dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6f05e99c21e84b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec001470 con 0x7f68dc003c30 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0052d0 con 0x7f68dc003c30 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68e7fff700 1 -- 172.21.15.121:0/241155081 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec003680 con 0x7f68dc003c30 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 -- 172.21.15.121:0/241155081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68dc003c30 msgr2=0x7f68dc004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 --2- 172.21.15.121:0/241155081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68dc003c30 0x7f68dc004030 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001980 tx=0x7f68dc005880 comp rx=0 tx=0).stop 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f59a6700 1 -- 172.21.15.121:0/241155081 reap_dead start 2023-08-18T20:44:14.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 -- 172.21.15.121:0/241155081 shutdown_connections 2023-08-18T20:44:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 -- 172.21.15.121:0/241155081 >> 172.21.15.121:0/241155081 conn(0x7f68f00a9a90 msgr2=0x7f68f00a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 -- 172.21.15.121:0/241155081 shutdown_connections 2023-08-18T20:44:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.328+0000 7f68f7409700 1 -- 172.21.15.121:0/241155081 wait complete. 2023-08-18T20:44:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.329+0000 7f68f7409700 1 Processor -- start 2023-08-18T20:44:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.329+0000 7f68f7409700 1 -- start start 2023-08-18T20:44:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 0x7f68f00c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 0x7f68f01eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00ac630 con 0x7f68f00c1380 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00a6760 con 0x7f68f014f1d0 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f7409700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00a6a40 con 0x7f68dc003c30 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41244/0 (socket says 172.21.15.121:41244) 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 -- 172.21.15.121:0/2361157904 learned_addr learned my addr 172.21.15.121:0/2361157904 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f59a6700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 0x7f68f01eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f51a5700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 0x7f68f00c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 -- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 msgr2=0x7f68f00c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 0x7f68f00c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 -- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 msgr2=0x7f68f01eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 0x7f68f01eaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 -- 172.21.15.121:0/2361157904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00addc0 con 0x7f68f00c1380 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f51a5700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 0x7f68f00c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f59a6700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 0x7f68f01eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.330+0000 7f68f49a4700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68e0010930 tx=0x7f68e0010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.331+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0010ed0 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.331+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0004020 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.331+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00043d0 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.331+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f01e7fe0 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.331+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00c1f90 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.332+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f0074730 con 0x7f68f00c1380 2023-08-18T20:44:14.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.332+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68e000e870 con 0x7f68f00c1380 2023-08-18T20:44:14.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.333+0000 7f68e5ffb700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.333+0000 7f68f51a5700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.333+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68e0088930 con 0x7f68f00c1380 2023-08-18T20:44:14.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.333+0000 7f68f51a5700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 0x7f68d406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68ec015040 tx=0x7f68ec00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.337+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f68e0054020 con 0x7f68f00c1380 2023-08-18T20:44:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.527+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68f00a6b80 con 0x7f68f00c1380 2023-08-18T20:44:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.528+0000 7f68e5ffb700 1 -- 172.21.15.121:0/2361157904 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f68e0057640 con 0x7f68f00c1380 2023-08-18T20:44:14.529 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:14.529 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 msgr2=0x7f68d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 0x7f68d406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68ec015040 tx=0x7f68ec00a000 comp rx=0 tx=0).stop 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 msgr2=0x7f68f014ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68e0010930 tx=0x7f68e0010cf0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 shutdown_connections 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68f014f1d0 0x7f68f01eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68dc003c30 0x7f68f00c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 --2- 172.21.15.121:0/2361157904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f00c1380 0x7f68f014ec90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 >> 172.21.15.121:0/2361157904 conn(0x7f68f00a9a90 msgr2=0x7f68f00c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 shutdown_connections 2023-08-18T20:44:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.531+0000 7f68f7409700 1 -- 172.21.15.121:0/2361157904 wait complete. 2023-08-18T20:44:14.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:14.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.666+0000 7f70b6536700 1 Processor -- start 2023-08-18T20:44:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.666+0000 7f70b6536700 1 -- start start 2023-08-18T20:44:14.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70b6536700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70b00c0c50 0x7f70b006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70b6536700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70b006a7e0 0x7f70b00c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70b6536700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00c4f40 con 0x7f70b00a6290 2023-08-18T20:44:14.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70b6536700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b00c6120 con 0x7f70b00c0c50 2023-08-18T20:44:14.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70b6536700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b01551f0 con 0x7f70b006a7e0 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70b00c0c50 0x7f70b006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70b00c0c50 0x7f70b006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41250/0 (socket says 172.21.15.121:41250) 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 -- 172.21.15.121:0/3992519752 learned_addr learned my addr 172.21.15.121:0/3992519752 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70af7fe700 1 --2- 172.21.15.121:0/3992519752 >> v2:172.21.15.122:3300/0 conn(0x7f70b006a7e0 0x7f70b00c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 -- 172.21.15.121:0/3992519752 >> v2:172.21.15.122:3300/0 conn(0x7f70b006a7e0 msgr2=0x7f70b00c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 --2- 172.21.15.121:0/3992519752 >> v2:172.21.15.122:3300/0 conn(0x7f70b006a7e0 0x7f70b00c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 -- 172.21.15.121:0/3992519752 >> v1:172.21.15.122:6789/0 conn(0x7f70b00a6290 legacy=0x7f70b0071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.667+0000 7f70affff700 1 -- 172.21.15.121:0/3992519752 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00c63a0 con 0x7f70b00c0c50 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70affff700 1 --2- 172.21.15.121:0/3992519752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b00c0c50 0x7f70b006a2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c45c0 tx=0x7f70a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5474c8f62cc571e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70aeffd700 1 -- 172.21.15.121:0/3992519752 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4004230 con 0x7f70b00c0c50 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70aeffd700 1 -- 172.21.15.121:0/3992519752 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4004390 con 0x7f70b00c0c50 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70aeffd700 1 -- 172.21.15.121:0/3992519752 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40036a0 con 0x7f70b00c0c50 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 -- 172.21.15.121:0/3992519752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b00c0c50 msgr2=0x7f70b006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 --2- 172.21.15.121:0/3992519752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b00c0c50 0x7f70b006a2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c45c0 tx=0x7f70a4009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 -- 172.21.15.121:0/3992519752 shutdown_connections 2023-08-18T20:44:14.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 --2- 172.21.15.121:0/3992519752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b00c0c50 0x7f70b006a2a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 --2- 172.21.15.121:0/3992519752 >> v2:172.21.15.122:3300/0 conn(0x7f70b006a7e0 0x7f70b00c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 -- 172.21.15.121:0/3992519752 >> 172.21.15.121:0/3992519752 conn(0x7f70b00c6b10 msgr2=0x7f70b00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:14.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 -- 172.21.15.121:0/3992519752 shutdown_connections 2023-08-18T20:44:14.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.668+0000 7f70b6536700 1 -- 172.21.15.121:0/3992519752 wait complete. 2023-08-18T20:44:14.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 Processor -- start 2023-08-18T20:44:14.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 -- start start 2023-08-18T20:44:14.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 0x7f70b01ecb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b00c0c50 0x7f70b01ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00ac750 con 0x7f70b006a7e0 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0158780 con 0x7f70b00a6290 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70b6536700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b014cff0 con 0x7f70b00c0c50 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.670+0000 7f70affff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41256/0 (socket says 172.21.15.121:41256) 2023-08-18T20:44:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 -- 172.21.15.121:0/624395699 learned_addr learned my addr 172.21.15.121:0/624395699 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70af7fe700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 0x7f70b01ecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70b4ad3700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b00c0c50 0x7f70b01ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 -- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b00c0c50 msgr2=0x7f70b01ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b00c0c50 0x7f70b01ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 -- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 msgr2=0x7f70b01ecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 0x7f70b01ecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 -- 172.21.15.121:0/624395699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4009550 con 0x7f70b006a7e0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70af7fe700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 0x7f70b01ecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70affff700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c4690 tx=0x7f70a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4003dc0 con 0x7f70b006a7e0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a401f070 con 0x7f70b006a7e0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011870 con 0x7f70b006a7e0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b014d800 con 0x7f70b006a7e0 2023-08-18T20:44:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.671+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b014d240 con 0x7f70b006a7e0 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.672+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b0074730 con 0x7f70b006a7e0 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.672+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70a4021030 con 0x7f70b006a7e0 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.673+0000 7f70acff9700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 0x7f709c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.673+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70a4089c50 con 0x7f70b006a7e0 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.673+0000 7f70af7fe700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 0x7f709c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.673+0000 7f70af7fe700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 0x7f709c06c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c1a60 tx=0x7f70a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:14.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.677+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f70a408f020 con 0x7f70b006a7e0 2023-08-18T20:44:14.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.866+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70b00c4a10 con 0x7f70b006a7e0 2023-08-18T20:44:14.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.867+0000 7f70acff9700 1 -- 172.21.15.121:0/624395699 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f70a40290a0 con 0x7f70b006a7e0 2023-08-18T20:44:14.866 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:14.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 msgr2=0x7f709c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 0x7f709c06c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c1a60 tx=0x7f70a0008040 comp rx=0 tx=0).stop 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 msgr2=0x7f70b00ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c4690 tx=0x7f70a4004750 comp rx=0 tx=0).stop 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 shutdown_connections 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b00c0c50 0x7f70b01ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f709c06a0e0 0x7f709c06c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70b006a7e0 0x7f70b00ac210 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 --2- 172.21.15.121:0/624395699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b00a6290 0x7f70b01ecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:14.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 >> 172.21.15.121:0/624395699 conn(0x7f70b00c6b10 msgr2=0x7f70b00a6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:14.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 shutdown_connections 2023-08-18T20:44:14.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:14.869+0000 7f70b6536700 1 -- 172.21.15.121:0/624395699 wait complete. 2023-08-18T20:44:14.881 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:15.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.005+0000 7ffa19b91700 1 Processor -- start 2023-08-18T20:44:15.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.005+0000 7ffa19b91700 1 -- start start 2023-08-18T20:44:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa1406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa1406a7e0 0x7ffa140c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffa140a6290 0x7ffa140c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140c5e50 con 0x7ffa1406a7e0 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140c4f40 con 0x7ffa140a6290 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa19b91700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c6120 con 0x7ffa140c0c50 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa1406a7e0 0x7ffa140c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa1406a7e0 0x7ffa140c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41264/0 (socket says 172.21.15.121:41264) 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3572732350 learned_addr learned my addr 172.21.15.121:0/3572732350 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3572732350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 msgr2=0x7ffa1406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa137fe700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa1406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa13fff700 1 --2- 172.21.15.121:0/3572732350 >> v2:172.21.15.122:3300/0 conn(0x7ffa140a6290 0x7ffa140c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa1406a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3572732350 >> v2:172.21.15.122:3300/0 conn(0x7ffa140a6290 msgr2=0x7ffa140c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3572732350 >> v2:172.21.15.122:3300/0 conn(0x7ffa140a6290 0x7ffa140c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3572732350 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa141551f0 con 0x7ffa1406a7e0 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa1406a7e0 0x7ffa140c53d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa140708e0 tx=0x7ffa08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4157fbba69403b63 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa127fc700 1 -- 172.21.15.121:0/3572732350 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800b870 con 0x7ffa1406a7e0 2023-08-18T20:44:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa127fc700 1 -- 172.21.15.121:0/3572732350 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800b9d0 con 0x7ffa1406a7e0 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.006+0000 7ffa127fc700 1 -- 172.21.15.121:0/3572732350 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800bd60 con 0x7ffa1406a7e0 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 -- 172.21.15.121:0/3572732350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa1406a7e0 msgr2=0x7ffa140c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa1406a7e0 0x7ffa140c53d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa140708e0 tx=0x7ffa08009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 -- 172.21.15.121:0/3572732350 shutdown_connections 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3572732350 >> v2:172.21.15.122:3300/0 conn(0x7ffa140a6290 0x7ffa140c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa1406a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3572732350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa1406a7e0 0x7ffa140c53d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 -- 172.21.15.121:0/3572732350 >> 172.21.15.121:0/3572732350 conn(0x7ffa140c6b10 msgr2=0x7ffa140c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 -- 172.21.15.121:0/3572732350 shutdown_connections 2023-08-18T20:44:15.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.007+0000 7ffa19b91700 1 -- 172.21.15.121:0/3572732350 wait complete. 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.008+0000 7ffa19b91700 1 Processor -- start 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 -- start start 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 0x7ffa1414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa140ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14155bb0 con 0x7ffa140a6290 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14155840 con 0x7ffa1406a7e0 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.009+0000 7ffa19b91700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141ecf80 con 0x7ffa140c0c50 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41272/0 (socket says 172.21.15.121:41272) 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3432347733 learned_addr learned my addr 172.21.15.121:0/3432347733 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa13fff700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa140ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa137fe700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 0x7ffa1414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 msgr2=0x7ffa140ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa140ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 msgr2=0x7ffa1414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 0x7ffa1414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 -- 172.21.15.121:0/3432347733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa08009550 con 0x7ffa140a6290 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa137fe700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 0x7ffa1414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa13fff700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa140ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:15.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa12ffd700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c4690 tx=0x7ffa08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08004310 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0801f070 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa141edac0 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080036a0 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.010+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa141ed470 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.011+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa141edc50 con 0x7ffa140a6290 2023-08-18T20:44:15.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.012+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa08021030 con 0x7ffa140a6290 2023-08-18T20:44:15.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.012+0000 7ff9fbfff700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 0x7ffa0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.012+0000 7ffa137fe700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 0x7ffa0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.012+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa080899e0 con 0x7ffa140a6290 2023-08-18T20:44:15.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.013+0000 7ffa137fe700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 0x7ffa0006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400a9b0 tx=0x7ffa04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.017+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ffa08055280 con 0x7ffa140a6290 2023-08-18T20:44:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.209+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa140bfe80 con 0x7ffa140a6290 2023-08-18T20:44:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.209+0000 7ff9fbfff700 1 -- 172.21.15.121:0/3432347733 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa080588a0 con 0x7ffa140a6290 2023-08-18T20:44:15.209 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:15.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 msgr2=0x7ffa0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 0x7ffa0006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400a9b0 tx=0x7ffa04008040 comp rx=0 tx=0).stop 2023-08-18T20:44:15.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 msgr2=0x7ffa140ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c4690 tx=0x7ffa08004750 comp rx=0 tx=0).stop 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 shutdown_connections 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa140c0c50 0x7ffa140ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa1406a7e0 0x7ffa1414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffa0006a0e0 0x7ffa0006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 --2- 172.21.15.121:0/3432347733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa140a6290 0x7ffa140ac0e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 >> 172.21.15.121:0/3432347733 conn(0x7ffa140c6b10 msgr2=0x7ffa140a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 shutdown_connections 2023-08-18T20:44:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.212+0000 7ffa19b91700 1 -- 172.21.15.121:0/3432347733 wait complete. 2023-08-18T20:44:15.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 Processor -- start 2023-08-18T20:44:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 -- start start 2023-08-18T20:44:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff42414f7e0 0x7ff42406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff42406ca80 0x7ff4240aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff4240c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff424152eb0 con 0x7ff42414f7e0 2023-08-18T20:44:15.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff424153190 con 0x7ff42406ca80 2023-08-18T20:44:15.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.347+0000 7ff42b126700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240c3920 con 0x7ff4240ab160 2023-08-18T20:44:15.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff42414f7e0 0x7ff42406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff42414f7e0 0x7ff42406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41278/0 (socket says 172.21.15.121:41278) 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 -- 172.21.15.121:0/2721120390 learned_addr learned my addr 172.21.15.121:0/2721120390 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff423fff700 1 --2- 172.21.15.121:0/2721120390 >> v2:172.21.15.122:3300/0 conn(0x7ff42406ca80 0x7ff4240aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff4296c3700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff4240c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 -- 172.21.15.121:0/2721120390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 msgr2=0x7ff4240c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff4240c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 -- 172.21.15.121:0/2721120390 >> v2:172.21.15.122:3300/0 conn(0x7ff42406ca80 msgr2=0x7ff4240aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 --2- 172.21.15.121:0/2721120390 >> v2:172.21.15.122:3300/0 conn(0x7ff42406ca80 0x7ff4240aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 -- 172.21.15.121:0/2721120390 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240c3c00 con 0x7ff42414f7e0 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff428ec2700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42414f7e0 0x7ff42406d1e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff4240a89c0 tx=0x7ff418009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b86efcd01be82b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff4237fe700 1 -- 172.21.15.121:0/2721120390 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800b870 con 0x7ff42414f7e0 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff4237fe700 1 -- 172.21.15.121:0/2721120390 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800b9d0 con 0x7ff42414f7e0 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.348+0000 7ff4237fe700 1 -- 172.21.15.121:0/2721120390 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800bd60 con 0x7ff42414f7e0 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 -- 172.21.15.121:0/2721120390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42414f7e0 msgr2=0x7ff42406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42414f7e0 0x7ff42406d1e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff4240a89c0 tx=0x7ff418009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 -- 172.21.15.121:0/2721120390 shutdown_connections 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff4240c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 --2- 172.21.15.121:0/2721120390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42414f7e0 0x7ff42406d1e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 --2- 172.21.15.121:0/2721120390 >> v2:172.21.15.122:3300/0 conn(0x7ff42406ca80 0x7ff4240aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 -- 172.21.15.121:0/2721120390 >> 172.21.15.121:0/2721120390 conn(0x7ff4240a7610 msgr2=0x7ff4240a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 -- 172.21.15.121:0/2721120390 shutdown_connections 2023-08-18T20:44:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.349+0000 7ff42b126700 1 -- 172.21.15.121:0/2721120390 wait complete. 2023-08-18T20:44:15.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.350+0000 7ff42b126700 1 Processor -- start 2023-08-18T20:44:15.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.350+0000 7ff42b126700 1 -- start start 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff424070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42414f7e0 0x7ff4240a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424071090 con 0x7ff42406ca80 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42414d950 con 0x7ff42414f7e0 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240c2b40 con 0x7ff4240ab160 2023-08-18T20:44:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41284/0 (socket says 172.21.15.121:41284) 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 -- 172.21.15.121:0/3683268505 learned_addr learned my addr 172.21.15.121:0/3683268505 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff423fff700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff424070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff4296c3700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42414f7e0 0x7ff4240a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 -- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 msgr2=0x7ff424070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff424070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 -- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42414f7e0 msgr2=0x7ff4240a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42414f7e0 0x7ff4240a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 -- 172.21.15.121:0/3683268505 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009550 con 0x7ff42406ca80 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff428ec2700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff418004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418004480 con 0x7ff42406ca80 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180045e0 con 0x7ff42406ca80 2023-08-18T20:44:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180038e0 con 0x7ff42406ca80 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42414fd40 con 0x7ff42406ca80 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.351+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4240706d0 con 0x7ff42406ca80 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.352+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff424070900 con 0x7ff42406ca80 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.353+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff418021070 con 0x7ff42406ca80 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.353+0000 7ff4217fa700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 0x7ff40806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.353+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff418089af0 con 0x7ff42406ca80 2023-08-18T20:44:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.353+0000 7ff423fff700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 0x7ff40806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.353+0000 7ff423fff700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 0x7ff40806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4240a7fe0 tx=0x7ff410008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.357+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff418055270 con 0x7ff42406ca80 2023-08-18T20:44:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.545+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff424074730 con 0x7ff42406ca80 2023-08-18T20:44:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.546+0000 7ff4217fa700 1 -- 172.21.15.121:0/3683268505 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff418015020 con 0x7ff42406ca80 2023-08-18T20:44:15.546 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 msgr2=0x7ff40806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 0x7ff40806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4240a7fe0 tx=0x7ff410008040 comp rx=0 tx=0).stop 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 msgr2=0x7ff4240a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff418004750 comp rx=0 tx=0).stop 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 shutdown_connections 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42414f7e0 0x7ff4240a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff40806a0e0 0x7ff40806c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff42406ca80 0x7ff4240a4240 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 --2- 172.21.15.121:0/3683268505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4240ab160 0x7ff424070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 >> 172.21.15.121:0/3683268505 conn(0x7ff4240a7610 msgr2=0x7ff4240c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 shutdown_connections 2023-08-18T20:44:15.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.548+0000 7ff42b126700 1 -- 172.21.15.121:0/3683268505 wait complete. 2023-08-18T20:44:15.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:15.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.684+0000 7f6cfb4e2700 1 Processor -- start 2023-08-18T20:44:15.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.684+0000 7f6cfb4e2700 1 -- start start 2023-08-18T20:44:15.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cfb4e2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6cf4072360 0x7f6cf4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cfb4e2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6cf4155820 0x7f6cf4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cfb4e2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf4066380 con 0x7f6cf406b520 2023-08-18T20:44:15.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cfb4e2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf4066080 con 0x7f6cf4072360 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cfb4e2700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf406d0f0 con 0x7f6cf4155820 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6cf4072360 0x7f6cf4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6cf4072360 0x7f6cf4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41294/0 (socket says 172.21.15.121:41294) 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 -- 172.21.15.121:0/1639871713 learned_addr learned my addr 172.21.15.121:0/1639871713 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf9a7f700 1 --2- 172.21.15.121:0/1639871713 >> v2:172.21.15.122:3300/0 conn(0x7f6cf4155820 0x7f6cf4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 -- 172.21.15.121:0/1639871713 >> v2:172.21.15.122:3300/0 conn(0x7f6cf4155820 msgr2=0x7f6cf4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/1639871713 >> v2:172.21.15.122:3300/0 conn(0x7f6cf4155820 0x7f6cf4155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 -- 172.21.15.121:0/1639871713 >> v1:172.21.15.122:6789/0 conn(0x7f6cf406b520 legacy=0x7f6cf414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.685+0000 7f6cf8a7d700 1 -- 172.21.15.121:0/1639871713 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40c1db0 con 0x7f6cf4072360 2023-08-18T20:44:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/1639871713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf4072360 0x7f6cf4152d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40c3850 tx=0x7f6cf0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34d46789f697190 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cebfff700 1 -- 172.21.15.121:0/1639871713 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0005e30 con 0x7f6cf4072360 2023-08-18T20:44:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cebfff700 1 -- 172.21.15.121:0/1639871713 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf0006030 con 0x7f6cf4072360 2023-08-18T20:44:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cebfff700 1 -- 172.21.15.121:0/1639871713 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00063e0 con 0x7f6cf4072360 2023-08-18T20:44:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/1639871713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf4072360 msgr2=0x7f6cf4152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/1639871713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf4072360 0x7f6cf4152d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40c3850 tx=0x7f6cf0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/1639871713 shutdown_connections 2023-08-18T20:44:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/1639871713 >> v2:172.21.15.122:3300/0 conn(0x7f6cf4155820 0x7f6cf4155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/1639871713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf4072360 0x7f6cf4152d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/1639871713 >> 172.21.15.121:0/1639871713 conn(0x7f6cf40c2ca0 msgr2=0x7f6cf40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/1639871713 shutdown_connections 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.686+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/1639871713 wait complete. 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.687+0000 7f6cfb4e2700 1 Processor -- start 2023-08-18T20:44:15.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 -- start start 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 0x7f6cf4143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 0x7f6cf4144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4144a40 con 0x7f6cf406b520 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4154460 con 0x7f6cf4155820 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cfb4e2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf414ae70 con 0x7f6cf4072360 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cf927e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cf927e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41298/0 (socket says 172.21.15.121:41298) 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cf927e700 1 -- 172.21.15.121:0/3850588716 learned_addr learned my addr 172.21.15.121:0/3850588716 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.688+0000 7f6cf9a7f700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 0x7f6cf4144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 -- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 msgr2=0x7f6cf4143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 0x7f6cf4143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 0x7f6cf4143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 -- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 msgr2=0x7f6cf4144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 0x7f6cf4144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 -- 172.21.15.121:0/3850588716 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0009500 con 0x7f6cf406b520 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf9a7f700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 0x7f6cf4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 0x7f6cf4143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cf927e700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c4d0 tx=0x7f6ce400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40054e0 con 0x7f6cf406b520 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4003680 con 0x7f6cf406b520 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf414ab40 con 0x7f6cf406b520 2023-08-18T20:44:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4003a30 con 0x7f6cf406b520 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.689+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4073490 con 0x7f6cf406b520 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.690+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf40c2790 con 0x7f6cf406b520 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.690+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ce4003b90 con 0x7f6cf406b520 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.691+0000 7f6ce9ffb700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 0x7f6cd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.691+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 0x7f6cd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.691+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ce4087a40 con 0x7f6cf406b520 2023-08-18T20:44:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.691+0000 7f6cf8a7d700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 0x7f6cd806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40c3850 tx=0x7f6cf0008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.695+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6ce4089e60 con 0x7f6cf406b520 2023-08-18T20:44:15.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.884+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cf4074730 con 0x7f6cf406b520 2023-08-18T20:44:15.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.884+0000 7f6ce9ffb700 1 -- 172.21.15.121:0/3850588716 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ce40170a0 con 0x7f6cf406b520 2023-08-18T20:44:15.884 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:15.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 msgr2=0x7f6cd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 0x7f6cd806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40c3850 tx=0x7f6cf0008070 comp rx=0 tx=0).stop 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 msgr2=0x7f6cf40c1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c4d0 tx=0x7f6ce400c890 comp rx=0 tx=0).stop 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 shutdown_connections 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cf4155820 0x7f6cf4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6cd806a0e0 0x7f6cd806c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cf406b520 0x7f6cf40c1170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 --2- 172.21.15.121:0/3850588716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6cf4072360 0x7f6cf4143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:15.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 >> 172.21.15.121:0/3850588716 conn(0x7f6cf40c2ca0 msgr2=0x7f6cf4155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:15.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 shutdown_connections 2023-08-18T20:44:15.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:15.887+0000 7f6cfb4e2700 1 -- 172.21.15.121:0/3850588716 wait complete. 2023-08-18T20:44:15.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:44:16.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.021+0000 7fbbf9408700 1 Processor -- start 2023-08-18T20:44:16.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.021+0000 7fbbf9408700 1 -- start start 2023-08-18T20:44:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf9408700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbbf4154bb0 0x7fbbf40c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf9408700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf41588f0 con 0x7fbbf40c60c0 2023-08-18T20:44:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf9408700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4157b30 con 0x7fbbf40bd5a0 2023-08-18T20:44:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf9408700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4155040 con 0x7fbbf4154bb0 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf2ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbbf40c60c0 0x7fbbf406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47888/0 (socket says 172.21.15.121:47888) 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf2ffd700 1 -- 172.21.15.121:0/3000385837 learned_addr learned my addr 172.21.15.121:0/3000385837 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf37fe700 1 --2- 172.21.15.121:0/3000385837 >> v2:172.21.15.122:3300/0 conn(0x7fbbf4154bb0 0x7fbbf40c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192210459 0 0) 0x7fbbf41588f0 con 0x7fbbf40c60c0 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.022+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc0035b0 con 0x7fbbf40c60c0 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318759543 0 0) 0x7fbbdc0035b0 con 0x7fbbf40c60c0 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 >> v2:172.21.15.122:3300/0 conn(0x7fbbf4154bb0 msgr2=0x7fbbf40c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 --2- 172.21.15.121:0/3000385837 >> v2:172.21.15.122:3300/0 conn(0x7fbbf4154bb0 0x7fbbf40c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 >> v1:172.21.15.122:6789/0 conn(0x7fbbf40bd5a0 legacy=0x7fbbf41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4157e10 con 0x7fbbf40c60c0 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fbbe8001670 con 0x7fbbf40c60c0 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 >> v1:172.21.15.121:6789/0 conn(0x7fbbf40c60c0 legacy=0x7fbbf406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbdc003a70 0x7fbbdc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbdc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbdc005210 0x7fbbdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc00c110 con 0x7fbbdc004850 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc00c280 con 0x7fbbdc003a70 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc00c440 con 0x7fbbdc005210 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbdc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf2ffd700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbdc003a70 0x7fbbdc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf37fe700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbdc005210 0x7fbbdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 -- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbdc005210 msgr2=0x7fbbdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbdc005210 0x7fbbdc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 -- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbdc003a70 msgr2=0x7fbbdc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbdc003a70 0x7fbbdc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 -- 172.21.15.121:0/3000385837 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0035b0 con 0x7fbbdc004850 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf37fe700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbdc005210 0x7fbbdc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf37fe700 1 -- 172.21.15.121:0/3000385837 reap_dead start 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbdc004cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40017c0 tx=0x7fbbdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a960f81594fd71a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40052d0 con 0x7fbbdc004850 2023-08-18T20:44:16.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4005430 con 0x7fbbdc004850 2023-08-18T20:44:16.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.023+0000 7fbbf1ffb700 1 -- 172.21.15.121:0/3000385837 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40038c0 con 0x7fbbdc004850 2023-08-18T20:44:16.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 -- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 msgr2=0x7fbbdc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbdc004cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40017c0 tx=0x7fbbdc005880 comp rx=0 tx=0).stop 2023-08-18T20:44:16.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 -- 172.21.15.121:0/3000385837 shutdown_connections 2023-08-18T20:44:16.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 --2- 172.21.15.121:0/3000385837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbdc004cd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 -- 172.21.15.121:0/3000385837 >> 172.21.15.121:0/3000385837 conn(0x7fbbf40c35a0 msgr2=0x7fbbf40c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:16.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 -- 172.21.15.121:0/3000385837 shutdown_connections 2023-08-18T20:44:16.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.024+0000 7fbbf9408700 1 -- 172.21.15.121:0/3000385837 wait complete. 2023-08-18T20:44:16.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.025+0000 7fbbf9408700 1 Processor -- start 2023-08-18T20:44:16.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.025+0000 7fbbf9408700 1 -- start start 2023-08-18T20:44:16.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbf40ab8f0 0x7fbbf414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf40abd70 0x7fbbf414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41e96c0 con 0x7fbbdc004850 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41e98d0 con 0x7fbbf40abd70 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf9408700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41e9bb0 con 0x7fbbf40ab8f0 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41318/0 (socket says 172.21.15.121:41318) 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 -- 172.21.15.121:0/2262112375 learned_addr learned my addr 172.21.15.121:0/2262112375 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf37fe700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf40abd70 0x7fbbf414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbf40ab8f0 0x7fbbf414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 -- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbf40ab8f0 msgr2=0x7fbbf414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbf40ab8f0 0x7fbbf414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 -- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf40abd70 msgr2=0x7fbbf414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf40abd70 0x7fbbf414e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 -- 172.21.15.121:0/2262112375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf41e9e90 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.026+0000 7fbbf2ffd700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80072c0 tx=0x7fbbe8007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.027+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800f850 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.027+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe800f9d0 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.027+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf41ea170 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.027+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800fd80 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.027+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf406e3c0 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.028+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf41ea690 con 0x7fbbdc004850 2023-08-18T20:44:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.028+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbe801d460 con 0x7fbbdc004850 2023-08-18T20:44:16.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.028+0000 7fbbdb7fe700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 0x7fbbe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.029+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbe80884b0 con 0x7fbbdc004850 2023-08-18T20:44:16.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.029+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 0x7fbbe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.029+0000 7fbbf27fc700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 0x7fbbe006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000c00 tx=0x7fbbe4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.033+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbbf41ea690 con 0x7fbbdc004850 2023-08-18T20:44:16.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.236+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbf41ea690 con 0x7fbbdc004850 2023-08-18T20:44:16.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.236+0000 7fbbdb7fe700 1 -- 172.21.15.121:0/2262112375 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbf41ea690 con 0x7fbbdc004850 2023-08-18T20:44:16.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 msgr2=0x7fbbe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 0x7fbbe006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000c00 tx=0x7fbbe4009030 comp rx=0 tx=0).stop 2023-08-18T20:44:16.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 msgr2=0x7fbbf4156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80072c0 tx=0x7fbbe8007680 comp rx=0 tx=0).stop 2023-08-18T20:44:16.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 shutdown_connections 2023-08-18T20:44:16.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf40abd70 0x7fbbf414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbbe006a0e0 0x7fbbe006c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbdc004850 0x7fbbf4156a60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 --2- 172.21.15.121:0/2262112375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbbf40ab8f0 0x7fbbf414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 >> 172.21.15.121:0/2262112375 conn(0x7fbbf40c35a0 msgr2=0x7fbbf4154320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:16.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 shutdown_connections 2023-08-18T20:44:16.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.238+0000 7fbbf9408700 1 -- 172.21.15.121:0/2262112375 wait complete. 2023-08-18T20:44:16.242 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:44:16.250 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-18T20:44:16.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:16.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-18T20:44:16.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:44:16.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:16.300 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-18T20:44:16.321 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:16.322 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:16.343 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:16.343 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:16.403 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:16.403 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:16.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:16.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.583+0000 7fa4cde84700 1 Processor -- start 2023-08-18T20:44:16.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.583+0000 7fa4cde84700 1 -- start start 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4cde84700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4c80c78b0 0x7fa4c80c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4cde84700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa4c8158540 0x7fa4c806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4cde84700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c80c6470 con 0x7fa4c806f1e0 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4cde84700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c80c5240 con 0x7fa4c80c78b0 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4cde84700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c81589d0 con 0x7fa4c8158540 2023-08-18T20:44:16.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4c6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4c80c78b0 0x7fa4c80c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4c77fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa4c806f1e0 0x7fa4c80c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47908/0 (socket says 172.21.15.121:47908) 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.584+0000 7fa4c77fe700 1 -- 172.21.15.121:0/25122415 learned_addr learned my addr 172.21.15.121:0/25122415 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c7fff700 1 --2- 172.21.15.121:0/25122415 >> v2:172.21.15.122:3300/0 conn(0x7fa4c8158540 0x7fa4c806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c6ffd700 1 -- 172.21.15.121:0/25122415 >> v2:172.21.15.122:3300/0 conn(0x7fa4c8158540 msgr2=0x7fa4c806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/25122415 >> v2:172.21.15.122:3300/0 conn(0x7fa4c8158540 0x7fa4c806f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c6ffd700 1 -- 172.21.15.121:0/25122415 >> v1:172.21.15.121:6789/0 conn(0x7fa4c806f1e0 legacy=0x7fa4c80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c6ffd700 1 -- 172.21.15.121:0/25122415 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8157aa0 con 0x7fa4c80c78b0 2023-08-18T20:44:16.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/25122415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c80c78b0 0x7fa4c80c7280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80a7930 tx=0x7fa4b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebee705336a1d79 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c67fc700 1 -- 172.21.15.121:0/25122415 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0011830 con 0x7fa4c80c78b0 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c67fc700 1 -- 172.21.15.121:0/25122415 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0011990 con 0x7fa4c80c78b0 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4c67fc700 1 -- 172.21.15.121:0/25122415 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0011d20 con 0x7fa4c80c78b0 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 -- 172.21.15.121:0/25122415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c80c78b0 msgr2=0x7fa4c80c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 --2- 172.21.15.121:0/25122415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c80c78b0 0x7fa4c80c7280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80a7930 tx=0x7fa4b0009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 -- 172.21.15.121:0/25122415 shutdown_connections 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 --2- 172.21.15.121:0/25122415 >> v2:172.21.15.122:3300/0 conn(0x7fa4c8158540 0x7fa4c806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 --2- 172.21.15.121:0/25122415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c80c78b0 0x7fa4c80c7280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.585+0000 7fa4cde84700 1 -- 172.21.15.121:0/25122415 >> 172.21.15.121:0/25122415 conn(0x7fa4c80a9a90 msgr2=0x7fa4c80a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:16.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.586+0000 7fa4cde84700 1 -- 172.21.15.121:0/25122415 shutdown_connections 2023-08-18T20:44:16.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.586+0000 7fa4cde84700 1 -- 172.21.15.121:0/25122415 wait complete. 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 Processor -- start 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 -- start start 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 0x7fa4c81ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4c8158540 0x7fa4c81ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81eab40 con 0x7fa4c806f1e0 2023-08-18T20:44:16.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81e9a50 con 0x7fa4c80c78b0 2023-08-18T20:44:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.587+0000 7fa4cde84700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81eca20 con 0x7fa4c8158540 2023-08-18T20:44:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41328/0 (socket says 172.21.15.121:41328) 2023-08-18T20:44:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 -- 172.21.15.121:0/4132486792 learned_addr learned my addr 172.21.15.121:0/4132486792 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 0x7fa4c81ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c7fff700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4c8158540 0x7fa4c81ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 -- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4c8158540 msgr2=0x7fa4c81ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4c8158540 0x7fa4c81ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 -- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 msgr2=0x7fa4c81ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 0x7fa4c81ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 -- 172.21.15.121:0/4132486792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00094a0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 0x7fa4c81ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4c77fe700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000cba0 tx=0x7fa4c000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000ab80 con 0x7fa4c806f1e0 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000ace0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0012600 con 0x7fa4c806f1e0 2023-08-18T20:44:16.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c80aacb0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.588+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c80ab270 con 0x7fa4c806f1e0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.589+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c8074730 con 0x7fa4c806f1e0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.589+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4c001b3b0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.590+0000 7fa4bffff700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 0x7fa4a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.590+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4c0088190 con 0x7fa4c806f1e0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.590+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 0x7fa4a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.590+0000 7fa4c6ffd700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 0x7fa4a806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80a7930 tx=0x7fa4b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.594+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa4c00539c0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.790+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4c80c5020 con 0x7fa4c806f1e0 2023-08-18T20:44:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.792+0000 7fa4bffff700 1 -- 172.21.15.121:0/4132486792 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fa4c0056fe0 con 0x7fa4c806f1e0 2023-08-18T20:44:16.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:16.792 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 msgr2=0x7fa4a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 0x7fa4a806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80a7930 tx=0x7fa4b0008030 comp rx=0 tx=0).stop 2023-08-18T20:44:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 msgr2=0x7fa4c8156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000cba0 tx=0x7fa4c000cf60 comp rx=0 tx=0).stop 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 shutdown_connections 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4c8158540 0x7fa4c81ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa4a806a0e0 0x7fa4a806c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c806f1e0 0x7fa4c8156ac0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 --2- 172.21.15.121:0/4132486792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80c78b0 0x7fa4c81ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 >> 172.21.15.121:0/4132486792 conn(0x7fa4c80a9a90 msgr2=0x7fa4c80c4570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 shutdown_connections 2023-08-18T20:44:16.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.794+0000 7fa4cde84700 1 -- 172.21.15.121:0/4132486792 wait complete. 2023-08-18T20:44:16.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:16.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.932+0000 7fbf1f2ec700 1 Processor -- start 2023-08-18T20:44:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.932+0000 7fbf1f2ec700 1 -- start start 2023-08-18T20:44:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1f2ec700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbf180c1030 0x7fbf18066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1f2ec700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbf180bf550 0x7fbf180bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1f2ec700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1806cc30 con 0x7fbf181518e0 2023-08-18T20:44:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1f2ec700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf180c0b80 con 0x7fbf180c1030 2023-08-18T20:44:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1f2ec700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf18155260 con 0x7fbf180bf550 2023-08-18T20:44:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbf180c1030 0x7fbf18066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbf180c1030 0x7fbf18066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41336/0 (socket says 172.21.15.121:41336) 2023-08-18T20:44:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 -- 172.21.15.121:0/2687721035 learned_addr learned my addr 172.21.15.121:0/2687721035 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1d889700 1 --2- 172.21.15.121:0/2687721035 >> v2:172.21.15.122:3300/0 conn(0x7fbf180bf550 0x7fbf180bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 -- 172.21.15.121:0/2687721035 >> v2:172.21.15.122:3300/0 conn(0x7fbf180bf550 msgr2=0x7fbf180bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 --2- 172.21.15.121:0/2687721035 >> v2:172.21.15.122:3300/0 conn(0x7fbf180bf550 0x7fbf180bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 -- 172.21.15.121:0/2687721035 >> v1:172.21.15.122:6789/0 conn(0x7fbf181518e0 legacy=0x7fbf1806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.933+0000 7fbf1c887700 1 -- 172.21.15.121:0/2687721035 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1806ce80 con 0x7fbf180c1030 2023-08-18T20:44:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.934+0000 7fbf1c887700 1 --2- 172.21.15.121:0/2687721035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf18066340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf18154420 tx=0x7fbf14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6e6e54ee6423af server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.935+0000 7fbf0ffff700 1 -- 172.21.15.121:0/2687721035 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14005e30 con 0x7fbf180c1030 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.935+0000 7fbf0ffff700 1 -- 172.21.15.121:0/2687721035 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14006030 con 0x7fbf180c1030 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.935+0000 7fbf0ffff700 1 -- 172.21.15.121:0/2687721035 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140063e0 con 0x7fbf180c1030 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/2687721035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 msgr2=0x7fbf18066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/2687721035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf18066340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf18154420 tx=0x7fbf14009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/2687721035 shutdown_connections 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/2687721035 >> v2:172.21.15.122:3300/0 conn(0x7fbf180bf550 0x7fbf180bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/2687721035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf18066340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/2687721035 >> 172.21.15.121:0/2687721035 conn(0x7fbf180c2ca0 msgr2=0x7fbf180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/2687721035 shutdown_connections 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.936+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/2687721035 wait complete. 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.937+0000 7fbf1f2ec700 1 Processor -- start 2023-08-18T20:44:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.937+0000 7fbf1f2ec700 1 -- start start 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbf180bf550 0x7fbf18153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 0x7fbf181ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181575a0 con 0x7fbf180c1030 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180ab6c0 con 0x7fbf181518e0 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180aa450 con 0x7fbf180bf550 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41344/0 (socket says 172.21.15.121:41344) 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 -- 172.21.15.121:0/236937312 learned_addr learned my addr 172.21.15.121:0/236937312 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1d889700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 0x7fbf181ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1d088700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbf180bf550 0x7fbf18153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 -- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbf180bf550 msgr2=0x7fbf18153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbf180bf550 0x7fbf18153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 -- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 msgr2=0x7fbf181ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 0x7fbf181ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 -- 172.21.15.121:0/236937312 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009500 con 0x7fbf180c1030 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1d889700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 0x7fbf181ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1c887700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbf14006000 tx=0x7fbf14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140068f0 con 0x7fbf180c1030 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14020070 con 0x7fbf180c1030 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14025670 con 0x7fbf180c1030 2023-08-18T20:44:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.938+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180aa730 con 0x7fbf180c1030 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.939+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf181541c0 con 0x7fbf180c1030 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.940+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf180aa970 con 0x7fbf180c1030 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.940+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf14022030 con 0x7fbf180c1030 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.940+0000 7fbf0dffb700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 0x7fbefc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.940+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf14089b90 con 0x7fbf180c1030 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.940+0000 7fbf1d088700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 0x7fbefc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.941+0000 7fbf1d088700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 0x7fbefc06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf1814d0b0 tx=0x7fbf08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:16.945+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbf14055310 con 0x7fbf180c1030 2023-08-18T20:44:17.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.134+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf1806e460 con 0x7fbf180c1030 2023-08-18T20:44:17.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.134+0000 7fbf0dffb700 1 -- 172.21.15.121:0/236937312 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf14058930 con 0x7fbf180c1030 2023-08-18T20:44:17.134 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 msgr2=0x7fbefc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 0x7fbefc06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf1814d0b0 tx=0x7fbf08008040 comp rx=0 tx=0).stop 2023-08-18T20:44:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 msgr2=0x7fbf1813db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbf14006000 tx=0x7fbf14004750 comp rx=0 tx=0).stop 2023-08-18T20:44:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 shutdown_connections 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf181518e0 0x7fbf181ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbf180bf550 0x7fbf18153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbefc06a0e0 0x7fbefc06c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 --2- 172.21.15.121:0/236937312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf180c1030 0x7fbf1813db10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 >> 172.21.15.121:0/236937312 conn(0x7fbf180c2ca0 msgr2=0x7fbf180c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 shutdown_connections 2023-08-18T20:44:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.136+0000 7fbf1f2ec700 1 -- 172.21.15.121:0/236937312 wait complete. 2023-08-18T20:44:17.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.271+0000 7f4295654700 1 Processor -- start 2023-08-18T20:44:17.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.271+0000 7f4295654700 1 -- start start 2023-08-18T20:44:17.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f4295654700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f42901543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f4295654700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42900ca4a0 con 0x7f4290154900 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f4295654700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429006c0f0 con 0x7f4290151b10 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f4295654700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4290158540 con 0x7f42900c7ca0 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f428f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4290154900 0x7f429015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47936/0 (socket says 172.21.15.121:47936) 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f428f7fe700 1 -- 172.21.15.121:0/547362260 learned_addr learned my addr 172.21.15.121:0/547362260 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407283768 0 0) 0x7f42900ca4a0 con 0x7f4290154900 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f428e7fc700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f42901543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.272+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42780035b0 con 0x7f4290154900 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 723093393 0 0) 0x7f42780035b0 con 0x7f4290154900 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 msgr2=0x7f42901543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f42901543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 >> v1:172.21.15.122:6789/0 conn(0x7f4290151b10 legacy=0x7f42900c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290158820 con 0x7f4290154900 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f42880019f0 con 0x7f4290154900 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 >> v1:172.21.15.121:6789/0 conn(0x7f4290154900 legacy=0x7f429015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4278003a30 0x7f4278003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f4278004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4278004d90 0x7f4278005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290158540 con 0x7f4278004d90 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427800bb40 con 0x7f4278003a30 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427800bd00 con 0x7f42900c7ca0 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4278004d90 0x7f4278005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428effd700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4278003a30 0x7f4278003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428e7fc700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f4278004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 -- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 msgr2=0x7f4278004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42900c7ca0 0x7f4278004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 -- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4278003a30 msgr2=0x7f4278003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4278003a30 0x7f4278003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 -- 172.21.15.121:0/547362260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780035b0 con 0x7f4278004d90 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428f7fe700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4278004d90 0x7f4278005210 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f428800a830 tx=0x7f4278005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e777156cd879f3c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800a2f0 con 0x7f4278004d90 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288012600 con 0x7f4278004d90 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.273+0000 7f428dffb700 1 -- 172.21.15.121:0/547362260 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880129b0 con 0x7f4278004d90 2023-08-18T20:44:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 -- 172.21.15.121:0/547362260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4278004d90 msgr2=0x7f4278005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 --2- 172.21.15.121:0/547362260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4278004d90 0x7f4278005210 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f428800a830 tx=0x7f4278005880 comp rx=0 tx=0).stop 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f428f7fe700 1 -- 172.21.15.121:0/547362260 reap_dead start 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 -- 172.21.15.121:0/547362260 shutdown_connections 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 -- 172.21.15.121:0/547362260 >> 172.21.15.121:0/547362260 conn(0x7f4290071bb0 msgr2=0x7f4290071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 -- 172.21.15.121:0/547362260 shutdown_connections 2023-08-18T20:44:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.274+0000 7f4295654700 1 -- 172.21.15.121:0/547362260 wait complete. 2023-08-18T20:44:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.275+0000 7f4295654700 1 Processor -- start 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.275+0000 7f4295654700 1 -- start start 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42900ac2d0 0x7f42901ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42901ecc10 0x7f42900bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42901ed1e0 con 0x7f42900c8f10 2023-08-18T20:44:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42901ed4c0 con 0x7f42900ac2d0 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f4295654700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42901ed7a0 con 0x7f42901ecc10 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41362/0 (socket says 172.21.15.121:41362) 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 -- 172.21.15.121:0/465511517 learned_addr learned my addr 172.21.15.121:0/465511517 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 -- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42901ecc10 msgr2=0x7f42900bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42901ecc10 0x7f42900bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 -- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42900ac2d0 msgr2=0x7f42901ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42900ac2d0 0x7f42901ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 -- 172.21.15.121:0/465511517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900aa920 con 0x7f42900c8f10 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.276+0000 7f428effd700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f428400f7a0 tx=0x7f428400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.277+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284017070 con 0x7f42900c8f10 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.277+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840052e0 con 0x7f42900c8f10 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.277+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42901eda80 con 0x7f42900c8f10 2023-08-18T20:44:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.277+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284005490 con 0x7f42900c8f10 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.277+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429014c2d0 con 0x7f42900c8f10 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.278+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4290074730 con 0x7f42900c8f10 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.278+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4284006860 con 0x7f42900c8f10 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.278+0000 7f42777fe700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 0x7f427c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.278+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4284087b90 con 0x7f42900c8f10 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.278+0000 7f428e7fc700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 0x7f427c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.279+0000 7f428e7fc700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 0x7f427c06c5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42900ab040 tx=0x7f4280009670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.283+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4284053310 con 0x7f42900c8f10 2023-08-18T20:44:17.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.472+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f429006c2e0 con 0x7f42900c8f10 2023-08-18T20:44:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.472+0000 7f42777fe700 1 -- 172.21.15.121:0/465511517 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4284056930 con 0x7f42900c8f10 2023-08-18T20:44:17.472 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 msgr2=0x7f427c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 0x7f427c06c5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42900ab040 tx=0x7f4280009670 comp rx=0 tx=0).stop 2023-08-18T20:44:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 msgr2=0x7f42901e9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f428400f7a0 tx=0x7f428400fb60 comp rx=0 tx=0).stop 2023-08-18T20:44:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 shutdown_connections 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42901ecc10 0x7f42900bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f427c06a110 0x7f427c06c5d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42900c8f10 0x7f42901e9ce0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 --2- 172.21.15.121:0/465511517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42900ac2d0 0x7f42901ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 >> 172.21.15.121:0/465511517 conn(0x7f4290071bb0 msgr2=0x7f4290156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 shutdown_connections 2023-08-18T20:44:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.474+0000 7f4295654700 1 -- 172.21.15.121:0/465511517 wait complete. 2023-08-18T20:44:17.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:17.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.610+0000 7ff6ba9d8700 1 Processor -- start 2023-08-18T20:44:17.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.610+0000 7ff6ba9d8700 1 -- start start 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6ba9d8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff6b4152250 0x7ff6b40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6ba9d8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4155e00 0x7ff6b4156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6ba9d8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4155970 con 0x7ff6b414fb90 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6ba9d8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b41567d0 con 0x7ff6b4152250 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6ba9d8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b414ff70 con 0x7ff6b4155e00 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff6b4152250 0x7ff6b40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff6b4152250 0x7ff6b40c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41372/0 (socket says 172.21.15.121:41372) 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 -- 172.21.15.121:0/3501979325 learned_addr learned my addr 172.21.15.121:0/3501979325 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b8f75700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4155e00 0x7ff6b4156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 -- 172.21.15.121:0/3501979325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4155e00 msgr2=0x7ff6b4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4155e00 0x7ff6b4156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 -- 172.21.15.121:0/3501979325 >> v1:172.21.15.122:6789/0 conn(0x7ff6b414fb90 legacy=0x7ff6b406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 -- 172.21.15.121:0/3501979325 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b406e830 con 0x7ff6b4152250 2023-08-18T20:44:17.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b37fe700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4152250 0x7ff6b40c5d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a69180269ab9b8f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b2ffd700 1 -- 172.21.15.121:0/3501979325 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011830 con 0x7ff6b4152250 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b2ffd700 1 -- 172.21.15.121:0/3501979325 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4011990 con 0x7ff6b4152250 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.611+0000 7ff6b2ffd700 1 -- 172.21.15.121:0/3501979325 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011d20 con 0x7ff6b4152250 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3501979325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4152250 msgr2=0x7ff6b40c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4152250 0x7ff6b40c5d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3501979325 shutdown_connections 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4155e00 0x7ff6b4156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3501979325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4152250 0x7ff6b40c5d10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3501979325 >> 172.21.15.121:0/3501979325 conn(0x7ff6b40c6b10 msgr2=0x7ff6b40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3501979325 shutdown_connections 2023-08-18T20:44:17.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.612+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3501979325 wait complete. 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.613+0000 7ff6ba9d8700 1 Processor -- start 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.613+0000 7ff6ba9d8700 1 -- start start 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b414fb90 0x7ff6b4154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4152250 0x7ff6b4147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41eb6c0 con 0x7ff6b4155e00 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4147390 con 0x7ff6b414fb90 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6ba9d8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41ead90 con 0x7ff6b4152250 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41380/0 (socket says 172.21.15.121:41380) 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 -- 172.21.15.121:0/3454217721 learned_addr learned my addr 172.21.15.121:0/3454217721 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b37fe700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4152250 0x7ff6b4147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b3fff700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b414fb90 0x7ff6b4154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 -- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4152250 msgr2=0x7ff6b4147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4152250 0x7ff6b4147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 -- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b414fb90 msgr2=0x7ff6b4154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b414fb90 0x7ff6b4154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.614+0000 7ff6b8f75700 1 -- 172.21.15.121:0/3454217721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009550 con 0x7ff6b4155e00 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6b8f75700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00efc0 tx=0x7ff6ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac009ea0 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00f040 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00ced0 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41eb070 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.615+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40aae40 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.616+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b4074730 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.616+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6ac014480 con 0x7ff6b4155e00 2023-08-18T20:44:17.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.616+0000 7ff6b0ff9700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 0x7ff6a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.617+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6ac088d80 con 0x7ff6b4155e00 2023-08-18T20:44:17.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.617+0000 7ff6b3fff700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 0x7ff6a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.617+0000 7ff6b3fff700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 0x7ff6a006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6b414b410 tx=0x7ff6a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.621+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff6ac054500 con 0x7ff6b4155e00 2023-08-18T20:44:17.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.808+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6b40c6620 con 0x7ff6b4155e00 2023-08-18T20:44:17.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.808+0000 7ff6b0ff9700 1 -- 172.21.15.121:0/3454217721 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6ac018020 con 0x7ff6b4155e00 2023-08-18T20:44:17.808 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 msgr2=0x7ff6a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 0x7ff6a006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6b414b410 tx=0x7ff6a8009040 comp rx=0 tx=0).stop 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 msgr2=0x7ff6b41483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00efc0 tx=0x7ff6ac00c3a0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 shutdown_connections 2023-08-18T20:44:17.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff6a006a0e0 0x7ff6a006c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b4155e00 0x7ff6b41483e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b414fb90 0x7ff6b4154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 --2- 172.21.15.121:0/3454217721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6b4152250 0x7ff6b4147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 >> 172.21.15.121:0/3454217721 conn(0x7ff6b40c6b10 msgr2=0x7ff6b406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 shutdown_connections 2023-08-18T20:44:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.810+0000 7ff6ba9d8700 1 -- 172.21.15.121:0/3454217721 wait complete. 2023-08-18T20:44:17.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:17.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.945+0000 7f71de794700 1 Processor -- start 2023-08-18T20:44:17.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 -- start start 2023-08-18T20:44:17.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71d80c7380 0x7f71d81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8158ae0 con 0x7f71d80a6ed0 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d8155370 con 0x7f71d80c7380 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.946+0000 7f71de794700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80c7760 con 0x7f71d80c3740 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71d80c7380 0x7f71d81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71dcd31700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71dcd31700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37798/0 (socket says 172.21.15.121:37798) 2023-08-18T20:44:17.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71dcd31700 1 -- 172.21.15.121:0/931578378 learned_addr learned my addr 172.21.15.121:0/931578378 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:17.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71d80c7380 0x7f71d81585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:51222/0 (socket says 172.21.15.121:51222) 2023-08-18T20:44:17.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 -- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 msgr2=0x7f71d80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:17.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 -- 172.21.15.121:0/931578378 >> v1:172.21.15.122:6789/0 conn(0x7f71d80a6ed0 legacy=0x7f71d806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 -- 172.21.15.121:0/931578378 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8154760 con 0x7f71d80c7380 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71dcd31700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d7fff700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80c7380 0x7f71d81585a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009840 tx=0x7f71c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c915f6c85fd080 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d6ffd700 1 -- 172.21.15.121:0/931578378 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0011830 con 0x7f71d80c7380 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d6ffd700 1 -- 172.21.15.121:0/931578378 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0011990 con 0x7f71d80c7380 2023-08-18T20:44:17.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.947+0000 7f71d6ffd700 1 -- 172.21.15.121:0/931578378 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0011d20 con 0x7f71d80c7380 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 -- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80c7380 msgr2=0x7f71d81585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80c7380 0x7f71d81585a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009840 tx=0x7f71c0009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 -- 172.21.15.121:0/931578378 shutdown_connections 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c3740 0x7f71d80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 --2- 172.21.15.121:0/931578378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80c7380 0x7f71d81585a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 -- 172.21.15.121:0/931578378 >> 172.21.15.121:0/931578378 conn(0x7f71d80c7bf0 msgr2=0x7f71d80c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 -- 172.21.15.121:0/931578378 shutdown_connections 2023-08-18T20:44:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.948+0000 7f71de794700 1 -- 172.21.15.121:0/931578378 wait complete. 2023-08-18T20:44:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.950+0000 7f71de794700 1 Processor -- start 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.950+0000 7f71de794700 1 -- start start 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80a6ed0 0x7f71d81ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c7380 0x7f71d80bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80bf220 con 0x7f71d80c3740 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8157950 con 0x7f71d80a6ed0 2023-08-18T20:44:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8157c30 con 0x7f71d80c7380 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41392/0 (socket says 172.21.15.121:41392) 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 -- 172.21.15.121:0/2463073364 learned_addr learned my addr 172.21.15.121:0/2463073364 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d7fff700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80a6ed0 0x7f71d81ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71dcd31700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c7380 0x7f71d80bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 -- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c7380 msgr2=0x7f71d80bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c7380 0x7f71d80bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 -- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80a6ed0 msgr2=0x7f71d81ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80a6ed0 0x7f71d81ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 -- 172.21.15.121:0/2463073364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009b30 con 0x7f71d80c3740 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d77fe700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c450 tx=0x7f71c800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80052d0 con 0x7f71d80c3740 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8005430 con 0x7f71d80c3740 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80038c0 con 0x7f71d80c3740 2023-08-18T20:44:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c00094a0 con 0x7f71d80c3740 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.951+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d81eda70 con 0x7f71d80c3740 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.952+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d8157e70 con 0x7f71d80c3740 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.953+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71c8003a20 con 0x7f71d80c3740 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.953+0000 7f71d4ff9700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 0x7f71b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.953+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71c80876b0 con 0x7f71d80c3740 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.953+0000 7f71d7fff700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 0x7f71b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.954+0000 7f71d7fff700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 0x7f71b806c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000c00 tx=0x7f71c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:17.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:17.958+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f71d8157e70 con 0x7f71d80c3740 2023-08-18T20:44:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.146+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71d80bf360 con 0x7f71d80c3740 2023-08-18T20:44:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.146+0000 7f71d4ff9700 1 -- 172.21.15.121:0/2463073364 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71d80bf360 con 0x7f71d80c3740 2023-08-18T20:44:18.146 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 msgr2=0x7f71b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 0x7f71b806c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000c00 tx=0x7f71c0008030 comp rx=0 tx=0).stop 2023-08-18T20:44:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 msgr2=0x7f71d814ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c450 tx=0x7f71c800c760 comp rx=0 tx=0).stop 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 shutdown_connections 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80c7380 0x7f71d80bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80a6ed0 0x7f71d81ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b806a0e0 0x7f71b806c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 --2- 172.21.15.121:0/2463073364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d80c3740 0x7f71d814ea90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.148+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 >> 172.21.15.121:0/2463073364 conn(0x7f71d80c7bf0 msgr2=0x7f71d81531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.149+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 shutdown_connections 2023-08-18T20:44:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.149+0000 7f71de794700 1 -- 172.21.15.121:0/2463073364 wait complete. 2023-08-18T20:44:18.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:44:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.281+0000 7f0ef9231700 1 Processor -- start 2023-08-18T20:44:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.281+0000 7f0ef9231700 1 -- start start 2023-08-18T20:44:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef40c14a0 0x7f0ef406a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0ef40c6150 0x7f0ef4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40bbbf0 con 0x7f0ef406a2a0 2023-08-18T20:44:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef4152050 con 0x7f0ef40c6150 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef9231700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4154400 con 0x7f0ef40c14a0 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41398/0 (socket says 172.21.15.121:41398) 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 -- 172.21.15.121:0/1593668 learned_addr learned my addr 172.21.15.121:0/1593668 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef359e700 1 --2- 172.21.15.121:0/1593668 >> v2:172.21.15.122:3300/0 conn(0x7f0ef40c6150 0x7f0ef4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef259c700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef40c14a0 0x7f0ef406a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 -- 172.21.15.121:0/1593668 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef40c14a0 msgr2=0x7f0ef406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef40c14a0 0x7f0ef406a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 -- 172.21.15.121:0/1593668 >> v2:172.21.15.122:3300/0 conn(0x7f0ef40c6150 msgr2=0x7f0ef4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/1593668 >> v2:172.21.15.122:3300/0 conn(0x7f0ef40c6150 0x7f0ef4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 -- 172.21.15.121:0/1593668 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef40bcfd0 con 0x7f0ef406a2a0 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.282+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40a6670 tx=0x7f0ee8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6c9a7cb6760fac server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef1d9b700 1 -- 172.21.15.121:0/1593668 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800b870 con 0x7f0ef406a2a0 2023-08-18T20:44:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef1d9b700 1 -- 172.21.15.121:0/1593668 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800b9d0 con 0x7f0ef406a2a0 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef1d9b700 1 -- 172.21.15.121:0/1593668 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800bd60 con 0x7f0ef406a2a0 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 -- 172.21.15.121:0/1593668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef406a2a0 msgr2=0x7f0ef40bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40a6670 tx=0x7f0ee8009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 -- 172.21.15.121:0/1593668 shutdown_connections 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 --2- 172.21.15.121:0/1593668 >> v2:172.21.15.122:3300/0 conn(0x7f0ef40c6150 0x7f0ef4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef406a2a0 0x7f0ef40bc9f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 --2- 172.21.15.121:0/1593668 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef40c14a0 0x7f0ef406a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 -- 172.21.15.121:0/1593668 >> 172.21.15.121:0/1593668 conn(0x7f0ef40c35a0 msgr2=0x7f0ef40c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 -- 172.21.15.121:0/1593668 shutdown_connections 2023-08-18T20:44:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.283+0000 7f0ef9231700 1 -- 172.21.15.121:0/1593668 wait complete. 2023-08-18T20:44:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 Processor -- start 2023-08-18T20:44:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 -- start start 2023-08-18T20:44:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef406a2a0 0x7f0ef406dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ef40c14a0 0x7f0ef414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41ecd60 con 0x7f0ef40c6150 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41ea050 con 0x7f0ef40c14a0 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef9231700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40723c0 con 0x7f0ef406a2a0 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.285+0000 7f0ef359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41408/0 (socket says 172.21.15.121:41408) 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 -- 172.21.15.121:0/3101261470 learned_addr learned my addr 172.21.15.121:0/3101261470 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef259c700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ef40c14a0 0x7f0ef414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef406a2a0 0x7f0ef406dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 -- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef406a2a0 msgr2=0x7f0ef406dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef406a2a0 0x7f0ef406dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 -- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ef40c14a0 msgr2=0x7f0ef414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ef40c14a0 0x7f0ef414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 -- 172.21.15.121:0/3101261470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009550 con 0x7f0ef40c6150 2023-08-18T20:44:18.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef359e700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0eec007e90 tx=0x7f0eec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00ed30 con 0x7f0ef40c6150 2023-08-18T20:44:18.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00ee90 con 0x7f0ef40c6150 2023-08-18T20:44:18.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec014660 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef41ea580 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.286+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef41ea2a0 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.287+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef41eced0 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.287+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0eec0147c0 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.288+0000 7f0edb7fe700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 0x7f0ee006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.288+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0eec088a90 con 0x7f0ef40c6150 2023-08-18T20:44:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.288+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 0x7f0ee006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.288+0000 7f0ef2d9d700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 0x7f0ee006c5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000c00 tx=0x7f0ee8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.292+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0ef41eced0 con 0x7f0ef40c6150 2023-08-18T20:44:18.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.499+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ef41ecea0 con 0x7f0ef40c6150 2023-08-18T20:44:18.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.499+0000 7f0edb7fe700 1 -- 172.21.15.121:0/3101261470 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0eec054240 con 0x7f0ef40c6150 2023-08-18T20:44:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 msgr2=0x7f0ee006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 0x7f0ee006c5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000c00 tx=0x7f0ee8008030 comp rx=0 tx=0).stop 2023-08-18T20:44:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 msgr2=0x7f0ef40ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0eec007e90 tx=0x7f0eec00e3c0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 shutdown_connections 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ee006a110 0x7f0ee006c5d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ef40c6150 0x7f0ef40ac2e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ef406a2a0 0x7f0ef406dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 --2- 172.21.15.121:0/3101261470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ef40c14a0 0x7f0ef414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 >> 172.21.15.121:0/3101261470 conn(0x7f0ef40c35a0 msgr2=0x7f0ef4153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 shutdown_connections 2023-08-18T20:44:18.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.501+0000 7f0ef9231700 1 -- 172.21.15.121:0/3101261470 wait complete. 2023-08-18T20:44:18.503 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:44:18.513 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-18T20:44:18.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:18.514 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-18T20:44:18.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:44:18.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:18.565 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-18T20:44:18.598 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-18T20:44:18.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:18.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.719+0000 7ff0bebf1700 1 Processor -- start 2023-08-18T20:44:18.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.719+0000 7ff0bebf1700 1 -- start start 2023-08-18T20:44:18.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bebf1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0b814e950 0x7ff0b80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bebf1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 0x7ff0b80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bebf1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80c2260 con 0x7ff0b80c19d0 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bebf1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b80a6630 con 0x7ff0b814e950 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bebf1700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b8151d90 con 0x7ff0b814ed30 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.720+0000 7ff0bc98d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0b814e950 0x7ff0b80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bd18e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff0b80c19d0 0x7ff0b80c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47998/0 (socket says 172.21.15.121:47998) 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bd18e700 1 -- 172.21.15.121:0/1459663975 learned_addr learned my addr 172.21.15.121:0/1459663975 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0b7fff700 1 --2- 172.21.15.121:0/1459663975 >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 0x7ff0b80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bc98d700 1 -- 172.21.15.121:0/1459663975 >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 msgr2=0x7ff0b80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bc98d700 1 --2- 172.21.15.121:0/1459663975 >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 0x7ff0b80c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bc98d700 1 -- 172.21.15.121:0/1459663975 >> v1:172.21.15.121:6789/0 conn(0x7ff0b80c19d0 legacy=0x7ff0b80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bc98d700 1 -- 172.21.15.121:0/1459663975 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8152070 con 0x7ff0b814e950 2023-08-18T20:44:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0b7fff700 1 --2- 172.21.15.121:0/1459663975 >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 0x7ff0b80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0bc98d700 1 --2- 172.21.15.121:0/1459663975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814e950 0x7ff0b80c2ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c7ba0 tx=0x7ff0ac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8620015f27bf93 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0b77fe700 1 -- 172.21.15.121:0/1459663975 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac011830 con 0x7ff0b814e950 2023-08-18T20:44:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0b77fe700 1 -- 172.21.15.121:0/1459663975 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac011990 con 0x7ff0b814e950 2023-08-18T20:44:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.721+0000 7ff0b77fe700 1 -- 172.21.15.121:0/1459663975 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac011d20 con 0x7ff0b814e950 2023-08-18T20:44:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 -- 172.21.15.121:0/1459663975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814e950 msgr2=0x7ff0b80c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/1459663975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814e950 0x7ff0b80c2ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c7ba0 tx=0x7ff0ac009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 -- 172.21.15.121:0/1459663975 shutdown_connections 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/1459663975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814e950 0x7ff0b80c2ed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/1459663975 >> v2:172.21.15.122:3300/0 conn(0x7ff0b814ed30 0x7ff0b80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 -- 172.21.15.121:0/1459663975 >> 172.21.15.121:0/1459663975 conn(0x7ff0b80c6b10 msgr2=0x7ff0b80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 -- 172.21.15.121:0/1459663975 shutdown_connections 2023-08-18T20:44:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.722+0000 7ff0bebf1700 1 -- 172.21.15.121:0/1459663975 wait complete. 2023-08-18T20:44:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.723+0000 7ff0bebf1700 1 Processor -- start 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.723+0000 7ff0bebf1700 1 -- start start 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0b80c19d0 0x7ff0b81dab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0b814e950 0x7ff0b81e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80aa810 con 0x7ff0b814ed30 2023-08-18T20:44:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b814c300 con 0x7ff0b814e950 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bebf1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b81512e0 con 0x7ff0b80c19d0 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bd18e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bd18e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41422/0 (socket says 172.21.15.121:41422) 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.724+0000 7ff0bd18e700 1 -- 172.21.15.121:0/3324054323 learned_addr learned my addr 172.21.15.121:0/3324054323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bc98d700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0b80c19d0 0x7ff0b81dab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0b7fff700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0b814e950 0x7ff0b81e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 -- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0b80c19d0 msgr2=0x7ff0b81dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0b80c19d0 0x7ff0b81dab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 -- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0b814e950 msgr2=0x7ff0b81e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0b814e950 0x7ff0b81e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 -- 172.21.15.121:0/3324054323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0094a0 con 0x7ff0b814ed30 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bd18e700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000cbc0 tx=0x7ff0b000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000ab50 con 0x7ff0b814ed30 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b000acb0 con 0x7ff0b814ed30 2023-08-18T20:44:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b80a77e0 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0012600 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.725+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b81db640 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.726+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b8151450 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.727+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0b001b3b0 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.727+0000 7ff0b57fa700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 0x7ff09c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.727+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0b0088180 con 0x7ff0b814ed30 2023-08-18T20:44:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.727+0000 7ff0bc98d700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 0x7ff09c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.727+0000 7ff0bc98d700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 0x7ff09c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0090b0 tx=0x7ff0ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.731+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff0b0053920 con 0x7ff0b814ed30 2023-08-18T20:44:18.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:44:18.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.970+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0b8074730 con 0x7ff0b814ed30 2023-08-18T20:44:18.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.970+0000 7ff0b57fa700 1 -- 172.21.15.121:0/3324054323 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7ff0b0056f40 con 0x7ff0b814ed30 2023-08-18T20:44:18.970 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:18.971 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:44:18.972 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:44:18.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 msgr2=0x7ff09c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 0x7ff09c06c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0090b0 tx=0x7ff0ac008030 comp rx=0 tx=0).stop 2023-08-18T20:44:18.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 msgr2=0x7ff0b81e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:18.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000cbc0 tx=0x7ff0b000cf80 comp rx=0 tx=0).stop 2023-08-18T20:44:18.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 shutdown_connections 2023-08-18T20:44:18.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff09c06a0e0 0x7ff09c06c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0b814ed30 0x7ff0b81e9700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0b80c19d0 0x7ff0b81dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 --2- 172.21.15.121:0/3324054323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0b814e950 0x7ff0b81e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:18.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 >> 172.21.15.121:0/3324054323 conn(0x7ff0b80c6b10 msgr2=0x7ff0b80c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:18.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 shutdown_connections 2023-08-18T20:44:18.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:18.972+0000 7ff0bebf1700 1 -- 172.21.15.121:0/3324054323 wait complete. 2023-08-18T20:44:18.977 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:44:18.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:19.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.145+0000 7f1de2fa8700 1 Processor -- start 2023-08-18T20:44:19.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.145+0000 7f1de2fa8700 1 -- start start 2023-08-18T20:44:19.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de2fa8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de2fa8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c2c80 0x7f1ddc0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de2fa8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc151be0 con 0x7f1ddc0c6120 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de2fa8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc14ed20 con 0x7f1ddc0c6560 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de2fa8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c20d0 con 0x7f1ddc0c2c80 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41428/0 (socket says 172.21.15.121:41428) 2023-08-18T20:44:19.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 -- 172.21.15.121:0/2215474292 learned_addr learned my addr 172.21.15.121:0/2215474292 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:19.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1de1545700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c2c80 0x7f1ddc0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 -- 172.21.15.121:0/2215474292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c2c80 msgr2=0x7f1ddc0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:19.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c2c80 0x7f1ddc0c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 -- 172.21.15.121:0/2215474292 >> v1:172.21.15.122:6789/0 conn(0x7f1ddc0c6120 legacy=0x7f1ddc0bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.146+0000 7f1ddbfff700 1 -- 172.21.15.121:0/2215474292 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0c23b0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1ddbfff700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80098f0 tx=0x7f1dc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13758990455f0ae2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1ddb7fe700 1 -- 172.21.15.121:0/2215474292 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800b8a0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1ddb7fe700 1 -- 172.21.15.121:0/2215474292 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ba00 con 0x7f1ddc0c6560 2023-08-18T20:44:19.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1ddb7fe700 1 -- 172.21.15.121:0/2215474292 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800bd90 con 0x7f1ddc0c6560 2023-08-18T20:44:19.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 -- 172.21.15.121:0/2215474292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 msgr2=0x7f1ddc0c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80098f0 tx=0x7f1dc8009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 -- 172.21.15.121:0/2215474292 shutdown_connections 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c2c80 0x7f1ddc0c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/2215474292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc0c4a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 -- 172.21.15.121:0/2215474292 >> 172.21.15.121:0/2215474292 conn(0x7f1ddc0c35a0 msgr2=0x7f1ddc0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 -- 172.21.15.121:0/2215474292 shutdown_connections 2023-08-18T20:44:19.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.147+0000 7f1de2fa8700 1 -- 172.21.15.121:0/2215474292 wait complete. 2023-08-18T20:44:19.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.148+0000 7f1de2fa8700 1 Processor -- start 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.148+0000 7f1de2fa8700 1 -- start start 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc0c2c80 0x7f1ddc06a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c6120 0x7f1ddc1ea370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0bf1c0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0aafb0 con 0x7f1ddc0c2c80 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de2fa8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0bfe80 con 0x7f1ddc0c6120 2023-08-18T20:44:19.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de1545700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de1545700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41436/0 (socket says 172.21.15.121:41436) 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de1545700 1 -- 172.21.15.121:0/528456880 learned_addr learned my addr 172.21.15.121:0/528456880 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1ddbfff700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c6120 0x7f1ddc1ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.149+0000 7f1de0d44700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc0c2c80 0x7f1ddc06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 -- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c6120 msgr2=0x7f1ddc1ea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c6120 0x7f1ddc1ea370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 -- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc0c2c80 msgr2=0x7f1ddc06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc0c2c80 0x7f1ddc06a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 -- 172.21.15.121:0/528456880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009550 con 0x7f1ddc0c6560 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de1545700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007e60 tx=0x7f1dd400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400ed30 con 0x7f1ddc0c6560 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4014420 con 0x7f1ddc0c6560 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc0be6d0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40147d0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.150+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc06aa80 con 0x7f1ddc0c6560 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.151+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc0c0f20 con 0x7f1ddc0c6560 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.151+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1dd4014930 con 0x7f1ddc0c6560 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.152+0000 7f1dd97fa700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 0x7f1dc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.152+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dd4088af0 con 0x7f1ddc0c6560 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.152+0000 7f1de0d44700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 0x7f1dc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.152+0000 7f1de0d44700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 0x7f1dc006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0007fd0 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.156+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1dd4054320 con 0x7f1ddc0c6560 2023-08-18T20:44:19.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.347+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ddc074730 con 0x7f1ddc0c6560 2023-08-18T20:44:19.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.348+0000 7f1dd97fa700 1 -- 172.21.15.121:0/528456880 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f1dd4057940 con 0x7f1ddc0c6560 2023-08-18T20:44:19.348 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:19.348 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:19.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 msgr2=0x7f1dc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 0x7f1dc006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0007fd0 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 msgr2=0x7f1ddc1ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007e60 tx=0x7f1dd400e3c0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 shutdown_connections 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1dc006a0e0 0x7f1dc006c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ddc0c6560 0x7f1ddc1ea8b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc0c2c80 0x7f1ddc06a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 --2- 172.21.15.121:0/528456880 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ddc0c6120 0x7f1ddc1ea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 >> 172.21.15.121:0/528456880 conn(0x7f1ddc0c35a0 msgr2=0x7f1ddc06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:19.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 shutdown_connections 2023-08-18T20:44:19.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.350+0000 7f1de2fa8700 1 -- 172.21.15.121:0/528456880 wait complete. 2023-08-18T20:44:19.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:43:41.820617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:43:42.987696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:19.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.486+0000 7ff0ebcde700 1 Processor -- start 2023-08-18T20:44:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.486+0000 7ff0ebcde700 1 -- start start 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ebcde700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0e40c37c0 0x7ff0e4151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ebcde700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e4150d80 con 0x7ff0e4070150 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ebcde700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e40c2510 con 0x7ff0e414a8c0 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ebcde700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40c2a90 con 0x7ff0e40c37c0 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e9279700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0e40c37c0 0x7ff0e4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ea27b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff0e4070150 0x7ff0e406b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48026/0 (socket says 172.21.15.121:48026) 2023-08-18T20:44:19.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0ea27b700 1 -- 172.21.15.121:0/3613613725 learned_addr learned my addr 172.21.15.121:0/3613613725 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e9279700 1 -- 172.21.15.121:0/3613613725 >> v1:172.21.15.122:6789/0 conn(0x7ff0e414a8c0 legacy=0x7ff0e40c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e9279700 1 -- 172.21.15.121:0/3613613725 >> v1:172.21.15.121:6789/0 conn(0x7ff0e4070150 legacy=0x7ff0e406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e9279700 1 -- 172.21.15.121:0/3613613725 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4072630 con 0x7ff0e40c37c0 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e9279700 1 --2- 172.21.15.121:0/3613613725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e4151210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400a9c0 tx=0x7ff0d400acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776db8a9ab3821e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e8a78700 1 -- 172.21.15.121:0/3613613725 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4005e30 con 0x7ff0e40c37c0 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e8a78700 1 -- 172.21.15.121:0/3613613725 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d4004030 con 0x7ff0e40c37c0 2023-08-18T20:44:19.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.487+0000 7ff0e8a78700 1 -- 172.21.15.121:0/3613613725 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40043c0 con 0x7ff0e40c37c0 2023-08-18T20:44:19.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 -- 172.21.15.121:0/3613613725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 msgr2=0x7ff0e4151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/3613613725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e4151210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400a9c0 tx=0x7ff0d400acd0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 -- 172.21.15.121:0/3613613725 shutdown_connections 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/3613613725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e4151210 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 -- 172.21.15.121:0/3613613725 >> 172.21.15.121:0/3613613725 conn(0x7ff0e40c2ca0 msgr2=0x7ff0e40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 -- 172.21.15.121:0/3613613725 shutdown_connections 2023-08-18T20:44:19.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.488+0000 7ff0ebcde700 1 -- 172.21.15.121:0/3613613725 wait complete. 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.489+0000 7ff0ebcde700 1 Processor -- start 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.489+0000 7ff0ebcde700 1 -- start start 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0e4070150 0x7ff0e4149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0e414a8c0 0x7ff0e41ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e406a450 con 0x7ff0e40c37c0 2023-08-18T20:44:19.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41ecba0 con 0x7ff0e4070150 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ebcde700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41eda70 con 0x7ff0e414a8c0 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41448/0 (socket says 172.21.15.121:41448) 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 -- 172.21.15.121:0/4127842864 learned_addr learned my addr 172.21.15.121:0/4127842864 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9a7a700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0e4070150 0x7ff0e4149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0ea27b700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0e414a8c0 0x7ff0e41ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 -- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0e414a8c0 msgr2=0x7ff0e41ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0e414a8c0 0x7ff0e41ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 -- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0e4070150 msgr2=0x7ff0e4149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0e4070150 0x7ff0e4149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 -- 172.21.15.121:0/4127842864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d400a5d0 con 0x7ff0e40c37c0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0e9279700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d401f070 con 0x7ff0e40c37c0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.490+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400ce60 con 0x7ff0e40c37c0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.491+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40bf550 con 0x7ff0e40c37c0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.491+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4003af0 con 0x7ff0e40c37c0 2023-08-18T20:44:19.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.491+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40bfa80 con 0x7ff0e40c37c0 2023-08-18T20:44:19.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.492+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e41ecd10 con 0x7ff0e40c37c0 2023-08-18T20:44:19.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.492+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0d4003c50 con 0x7ff0e40c37c0 2023-08-18T20:44:19.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.492+0000 7ff0da7fc700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 0x7ff0c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.492+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d4089530 con 0x7ff0e40c37c0 2023-08-18T20:44:19.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.492+0000 7ff0e9a7a700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 0x7ff0c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.493+0000 7ff0e9a7a700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 0x7ff0c806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0007fd0 tx=0x7ff0e0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.497+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff0e41ecd10 con 0x7ff0e40c37c0 2023-08-18T20:44:19.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.686+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0e41ecd10 con 0x7ff0e40c37c0 2023-08-18T20:44:19.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.686+0000 7ff0da7fc700 1 -- 172.21.15.121:0/4127842864 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0e41ecd10 con 0x7ff0e40c37c0 2023-08-18T20:44:19.686 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:19.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 msgr2=0x7ff0c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 0x7ff0c806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0007fd0 tx=0x7ff0e0007ec0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 msgr2=0x7ff0e41ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d4004750 comp rx=0 tx=0).stop 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 shutdown_connections 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0e414a8c0 0x7ff0e41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0e4070150 0x7ff0e4149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c806a0e0 0x7ff0c806c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 --2- 172.21.15.121:0/4127842864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0e40c37c0 0x7ff0e41ecff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 >> 172.21.15.121:0/4127842864 conn(0x7ff0e40c2ca0 msgr2=0x7ff0e414e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:19.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 shutdown_connections 2023-08-18T20:44:19.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.689+0000 7ff0ebcde700 1 -- 172.21.15.121:0/4127842864 wait complete. 2023-08-18T20:44:19.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:19.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.823+0000 7f8ade186700 1 Processor -- start 2023-08-18T20:44:19.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.823+0000 7f8ade186700 1 -- start start 2023-08-18T20:44:19.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ade186700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ad8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ade186700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80c4f40 con 0x7f8ad80a6290 2023-08-18T20:44:19.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ade186700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80c6120 con 0x7f8ad80c0c50 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ade186700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81551f0 con 0x7f8ad80c5ae0 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad6ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8ad80a6290 0x7f8ad80c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48038/0 (socket says 172.21.15.121:48038) 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad6ffd700 1 -- 172.21.15.121:0/903280769 learned_addr learned my addr 172.21.15.121:0/903280769 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939830320 0 0) 0x7f8ad80c4f40 con 0x7f8ad80a6290 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad7fff700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ad8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac00035b0 con 0x7f8ad80a6290 2023-08-18T20:44:19.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1987835912 0 0) 0x7f8ac00035b0 con 0x7f8ad80a6290 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 msgr2=0x7f8ad8071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ad8071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 >> v1:172.21.15.122:6789/0 conn(0x7f8ad80c0c50 legacy=0x7f8ad806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80c63a0 con 0x7f8ad80a6290 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f8ac8001670 con 0x7f8ad80a6290 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 >> v1:172.21.15.121:6789/0 conn(0x7f8ad80a6290 legacy=0x7f8ad80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ac0003a30 0x7f8ac0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ac0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.824+0000 7f8ad67fc700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac0004d90 0x7f8ac0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81551f0 con 0x7f8ac0003a30 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac000baf0 con 0x7f8ac0004d90 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac000bcb0 con 0x7f8ad80c5ae0 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ac0003a30 0x7f8ac0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad6ffd700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ac0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad7fff700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac0004d90 0x7f8ac0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 -- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 msgr2=0x7f8ac0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ad80c5ae0 0x7f8ac0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 -- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac0004d90 msgr2=0x7f8ac0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac0004d90 0x7f8ac0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 -- 172.21.15.121:0/903280769 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00035b0 con 0x7f8ac0003a30 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ac0003a30 0x7f8ac0003e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8ac0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f47978e0d40d0f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0012f0 con 0x7f8ac0003a30 2023-08-18T20:44:19.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0052f0 con 0x7f8ac0003a30 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.825+0000 7f8ad67fc700 1 -- 172.21.15.121:0/903280769 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc006860 con 0x7f8ac0003a30 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 -- 172.21.15.121:0/903280769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ac0003a30 msgr2=0x7f8ac0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 --2- 172.21.15.121:0/903280769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ac0003a30 0x7f8ac0003e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8ac0005880 comp rx=0 tx=0).stop 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ad7fff700 1 -- 172.21.15.121:0/903280769 reap_dead start 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 -- 172.21.15.121:0/903280769 shutdown_connections 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 -- 172.21.15.121:0/903280769 >> 172.21.15.121:0/903280769 conn(0x7f8ad80c6b10 msgr2=0x7f8ad80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 -- 172.21.15.121:0/903280769 shutdown_connections 2023-08-18T20:44:19.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.826+0000 7f8ade186700 1 -- 172.21.15.121:0/903280769 wait complete. 2023-08-18T20:44:19.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.827+0000 7f8ade186700 1 Processor -- start 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.827+0000 7f8ade186700 1 -- start start 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac0003a30 0x7f8ad81ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 0x7f8ad8153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a9d60 con 0x7f8ad814c930 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81edf70 con 0x7f8ad81530f0 2023-08-18T20:44:19.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a9fb0 con 0x7f8ac0003a30 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41468/0 (socket says 172.21.15.121:41468) 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 -- 172.21.15.121:0/2011696466 learned_addr learned my addr 172.21.15.121:0/2011696466 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac0003a30 0x7f8ad81ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad7fff700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 0x7f8ad8153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 -- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac0003a30 msgr2=0x7f8ad81ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac0003a30 0x7f8ad81ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 -- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 msgr2=0x7f8ad8153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 0x7f8ad8153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 -- 172.21.15.121:0/2011696466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80aa290 con 0x7f8ad814c930 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad7fff700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 0x7f8ad8153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ad6ffd700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007290 tx=0x7f8ac80075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011580 con 0x7f8ad814c930 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80116e0 con 0x7f8ad814c930 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011a70 con 0x7f8ad814c930 2023-08-18T20:44:19.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad814d2f0 con 0x7f8ad814c930 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.828+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8156840 con 0x7f8ad814c930 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.829+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad806b1d0 con 0x7f8ad814c930 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.830+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ac8011bd0 con 0x7f8ad814c930 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.830+0000 7f8abffff700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.830+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ac8088420 con 0x7f8ad814c930 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.830+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:19.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.831+0000 7f8ad77fe700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8acc014040 tx=0x7f8acc011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:19.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:19.834+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8ac8053ba0 con 0x7f8ad814c930 2023-08-18T20:44:20.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.025+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ad8074730 con 0x7f8ad814c930 2023-08-18T20:44:20.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.025+0000 7f8abffff700 1 -- 172.21.15.121:0/2011696466 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ac80571c0 con 0x7f8ad814c930 2023-08-18T20:44:20.025 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:20.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 msgr2=0x7f8ac406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8acc014040 tx=0x7f8acc011000 comp rx=0 tx=0).stop 2023-08-18T20:44:20.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 msgr2=0x7f8ad814cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007290 tx=0x7f8ac80075a0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 shutdown_connections 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad81530f0 0x7f8ad8153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac0003a30 0x7f8ad81ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ac406a0e0 0x7f8ac406c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 --2- 172.21.15.121:0/2011696466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad814c930 0x7f8ad814cdb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.027+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 >> 172.21.15.121:0/2011696466 conn(0x7f8ad80c6b10 msgr2=0x7f8ad80c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.028+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 shutdown_connections 2023-08-18T20:44:20.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.028+0000 7f8ade186700 1 -- 172.21.15.121:0/2011696466 wait complete. 2023-08-18T20:44:20.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:20.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.163+0000 7fcd3e42e700 1 Processor -- start 2023-08-18T20:44:20.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.163+0000 7fcd3e42e700 1 -- start start 2023-08-18T20:44:20.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3e42e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd3806a510 0x7fcd380c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3e42e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd38157c10 0x7fcd381580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3e42e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380c21f0 con 0x7fcd380c1cf0 2023-08-18T20:44:20.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3e42e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380c2ba0 con 0x7fcd38157c10 2023-08-18T20:44:20.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3e42e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380c6300 con 0x7fcd3806a510 2023-08-18T20:44:20.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd38157c10 0x7fcd381580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd38157c10 0x7fcd381580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41478/0 (socket says 172.21.15.121:41478) 2023-08-18T20:44:20.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/3072903273 learned_addr learned my addr 172.21.15.121:0/3072903273 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd37fff700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd3806a510 0x7fcd380c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/3072903273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd3806a510 msgr2=0x7fcd380c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:20.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd3806a510 0x7fcd380c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/3072903273 >> v1:172.21.15.122:6789/0 conn(0x7fcd380c1cf0 legacy=0x7fcd38151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/3072903273 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380c5b20 con 0x7fcd38157c10 2023-08-18T20:44:20.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd3c9cb700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381580a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2f3bfba55c5cd server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.164+0000 7fcd36ffd700 1 -- 172.21.15.121:0/3072903273 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000e070 con 0x7fcd38157c10 2023-08-18T20:44:20.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd36ffd700 1 -- 172.21.15.121:0/3072903273 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000b9c0 con 0x7fcd38157c10 2023-08-18T20:44:20.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd36ffd700 1 -- 172.21.15.121:0/3072903273 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000bd70 con 0x7fcd38157c10 2023-08-18T20:44:20.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 -- 172.21.15.121:0/3072903273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 msgr2=0x7fcd381580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381580a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd3000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:20.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 -- 172.21.15.121:0/3072903273 shutdown_connections 2023-08-18T20:44:20.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381580a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/3072903273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd3806a510 0x7fcd380c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 -- 172.21.15.121:0/3072903273 >> 172.21.15.121:0/3072903273 conn(0x7fcd380c6b10 msgr2=0x7fcd380c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 -- 172.21.15.121:0/3072903273 shutdown_connections 2023-08-18T20:44:20.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.165+0000 7fcd3e42e700 1 -- 172.21.15.121:0/3072903273 wait complete. 2023-08-18T20:44:20.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.166+0000 7fcd3e42e700 1 Processor -- start 2023-08-18T20:44:20.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.167+0000 7fcd3e42e700 1 -- start start 2023-08-18T20:44:20.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.167+0000 7fcd3e42e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd3806a510 0x7fcd3806d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 0x7fcd381e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380acbe0 con 0x7fcd38157c10 2023-08-18T20:44:20.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381528c0 con 0x7fcd3806a510 2023-08-18T20:44:20.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381ea890 con 0x7fcd380c1cf0 2023-08-18T20:44:20.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41484/0 (socket says 172.21.15.121:41484) 2023-08-18T20:44:20.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/195126030 learned_addr learned my addr 172.21.15.121:0/195126030 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd37fff700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd3806a510 0x7fcd3806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd377fe700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 0x7fcd381e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 msgr2=0x7fcd381e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 0x7fcd381e9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd3806a510 msgr2=0x7fcd3806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd3806a510 0x7fcd3806d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 -- 172.21.15.121:0/195126030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30009b30 con 0x7fcd38157c10 2023-08-18T20:44:20.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd377fe700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 0x7fcd381e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:20.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3c9cb700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000b730 tx=0x7fcd30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300099b0 con 0x7fcd38157c10 2023-08-18T20:44:20.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300092e0 con 0x7fcd38157c10 2023-08-18T20:44:20.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd381e9910 con 0x7fcd38157c10 2023-08-18T20:44:20.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3001c640 con 0x7fcd38157c10 2023-08-18T20:44:20.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.168+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38152b10 con 0x7fcd38157c10 2023-08-18T20:44:20.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.169+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd38074730 con 0x7fcd38157c10 2023-08-18T20:44:20.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.170+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd3001c7a0 con 0x7fcd38157c10 2023-08-18T20:44:20.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.170+0000 7fcd34ff9700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.170+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd3008a1e0 con 0x7fcd38157c10 2023-08-18T20:44:20.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.170+0000 7fcd37fff700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.171+0000 7fcd37fff700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd381e7750 tx=0x7fcd2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.175+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fcd30055960 con 0x7fcd38157c10 2023-08-18T20:44:20.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.365+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd380c18c0 con 0x7fcd38157c10 2023-08-18T20:44:20.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.365+0000 7fcd34ff9700 1 -- 172.21.15.121:0/195126030 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd30058f80 con 0x7fcd38157c10 2023-08-18T20:44:20.365 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:20.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.367+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 msgr2=0x7fcd2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.367+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd381e7750 tx=0x7fcd2c008040 comp rx=0 tx=0).stop 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.367+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 msgr2=0x7fcd381ea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.367+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000b730 tx=0x7fcd30004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 shutdown_connections 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd38157c10 0x7fcd381ea350 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd3806a510 0x7fcd3806d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 --2- 172.21.15.121:0/195126030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd380c1cf0 0x7fcd381e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 >> 172.21.15.121:0/195126030 conn(0x7fcd380c6b10 msgr2=0x7fcd38070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 shutdown_connections 2023-08-18T20:44:20.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.368+0000 7fcd3e42e700 1 -- 172.21.15.121:0/195126030 wait complete. 2023-08-18T20:44:20.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:20.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.502+0000 7eff234fe700 1 Processor -- start 2023-08-18T20:44:20.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 -- start start 2023-08-18T20:44:20.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7eff1c0c0c50 0x7eff1c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c06a7e0 0x7eff1c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff1c0a6290 0x7eff1c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0c5e50 con 0x7eff1c0a6290 2023-08-18T20:44:20.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0c4f40 con 0x7eff1c0c0c50 2023-08-18T20:44:20.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff234fe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c6120 con 0x7eff1c06a7e0 2023-08-18T20:44:20.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff21a9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff1c0a6290 0x7eff1c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff21a9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff1c0a6290 0x7eff1c0c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41492/0 (socket says 172.21.15.121:41492) 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.503+0000 7eff21a9b700 1 -- 172.21.15.121:0/3405577494 learned_addr learned my addr 172.21.15.121:0/3405577494 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 -- 172.21.15.121:0/3405577494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c06a7e0 msgr2=0x7eff1c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 --2- 172.21.15.121:0/3405577494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c06a7e0 0x7eff1c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 -- 172.21.15.121:0/3405577494 >> v2:172.21.15.122:3300/0 conn(0x7eff1c0c0c50 msgr2=0x7eff1c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 --2- 172.21.15.121:0/3405577494 >> v2:172.21.15.122:3300/0 conn(0x7eff1c0c0c50 0x7eff1c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 -- 172.21.15.121:0/3405577494 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c1551f0 con 0x7eff1c0a6290 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff21a9b700 1 --2- 172.21.15.121:0/3405577494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c0a6290 0x7eff1c0c5910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff1c067fc0 tx=0x7eff1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e089af965caa3bd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff13fff700 1 -- 172.21.15.121:0/3405577494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e070 con 0x7eff1c0a6290 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff13fff700 1 -- 172.21.15.121:0/3405577494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400b9c0 con 0x7eff1c0a6290 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.504+0000 7eff13fff700 1 -- 172.21.15.121:0/3405577494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400bd70 con 0x7eff1c0a6290 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 -- 172.21.15.121:0/3405577494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c0a6290 msgr2=0x7eff1c0c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 --2- 172.21.15.121:0/3405577494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c0a6290 0x7eff1c0c5910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff1c067fc0 tx=0x7eff1400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:20.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 -- 172.21.15.121:0/3405577494 shutdown_connections 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 --2- 172.21.15.121:0/3405577494 >> v2:172.21.15.122:3300/0 conn(0x7eff1c0c0c50 0x7eff1c06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 --2- 172.21.15.121:0/3405577494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c0a6290 0x7eff1c0c5910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 --2- 172.21.15.121:0/3405577494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c06a7e0 0x7eff1c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 -- 172.21.15.121:0/3405577494 >> 172.21.15.121:0/3405577494 conn(0x7eff1c0c6b10 msgr2=0x7eff1c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 -- 172.21.15.121:0/3405577494 shutdown_connections 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.505+0000 7eff234fe700 1 -- 172.21.15.121:0/3405577494 wait complete. 2023-08-18T20:44:20.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.506+0000 7eff234fe700 1 Processor -- start 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.506+0000 7eff234fe700 1 -- start start 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 0x7eff1c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c0c0c50 0x7eff1c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c155ac0 con 0x7eff1c06a7e0 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14c5d0 con 0x7eff1c0a6290 2023-08-18T20:44:20.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff234fe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c155cd0 con 0x7eff1c0c0c50 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41494/0 (socket says 172.21.15.121:41494) 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 -- 172.21.15.121:0/1164081390 learned_addr learned my addr 172.21.15.121:0/1164081390 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff21a9b700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c0c0c50 0x7eff1c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff20a99700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 0x7eff1c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 -- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c0c0c50 msgr2=0x7eff1c14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c0c0c50 0x7eff1c14c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 -- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 msgr2=0x7eff1c14bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 0x7eff1c14bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff2129a700 1 -- 172.21.15.121:0/1164081390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009b30 con 0x7eff1c06a7e0 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.507+0000 7eff20a99700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 0x7eff1c14bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff2129a700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00b4a0 tx=0x7eff0c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c011830 con 0x7eff1c06a7e0 2023-08-18T20:44:20.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c011990 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c011d40 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c155fb0 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.508+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c156570 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.509+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c074730 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.509+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff0c01a400 con 0x7eff1c06a7e0 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.510+0000 7eff11ffb700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 0x7eff0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.510+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff0c088570 con 0x7eff1c06a7e0 2023-08-18T20:44:20.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.510+0000 7eff20a99700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 0x7eff0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.510+0000 7eff20a99700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 0x7eff0006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c1f00 tx=0x7eff18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.514+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7eff0c053c70 con 0x7eff1c06a7e0 2023-08-18T20:44:20.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.701+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff1c0c4a10 con 0x7eff1c06a7e0 2023-08-18T20:44:20.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.702+0000 7eff11ffb700 1 -- 172.21.15.121:0/1164081390 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff0c057290 con 0x7eff1c06a7e0 2023-08-18T20:44:20.702 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:20.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 msgr2=0x7eff0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 0x7eff0006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c1f00 tx=0x7eff18008040 comp rx=0 tx=0).stop 2023-08-18T20:44:20.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 msgr2=0x7eff1c157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00b4a0 tx=0x7eff0c00b860 comp rx=0 tx=0).stop 2023-08-18T20:44:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 shutdown_connections 2023-08-18T20:44:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7eff1c0c0c50 0x7eff1c14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7eff0006a0e0 0x7eff0006c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff1c06a7e0 0x7eff1c157180 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 --2- 172.21.15.121:0/1164081390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1c0a6290 0x7eff1c14bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 >> 172.21.15.121:0/1164081390 conn(0x7eff1c0c6b10 msgr2=0x7eff1c0a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 shutdown_connections 2023-08-18T20:44:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.704+0000 7eff234fe700 1 -- 172.21.15.121:0/1164081390 wait complete. 2023-08-18T20:44:20.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:20.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.835+0000 7f009cbb7700 1 Processor -- start 2023-08-18T20:44:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.835+0000 7f009cbb7700 1 -- start start 2023-08-18T20:44:20.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009cbb7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980c7380 0x7f00981585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009cbb7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f00980a6ed0 0x7f009806f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009cbb7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0098158ae0 con 0x7f009806feb0 2023-08-18T20:44:20.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009cbb7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0098155370 con 0x7f00980a6ed0 2023-08-18T20:44:20.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009cbb7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980c7760 con 0x7f00980c7380 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f00980a6ed0 0x7f009806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f00980a6ed0 0x7f009806f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41502/0 (socket says 172.21.15.121:41502) 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 -- 172.21.15.121:0/2543269769 learned_addr learned my addr 172.21.15.121:0/2543269769 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f009659c700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980c7380 0x7f00981585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 -- 172.21.15.121:0/2543269769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980c7380 msgr2=0x7f00981585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980c7380 0x7f00981585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 -- 172.21.15.121:0/2543269769 >> v1:172.21.15.122:6789/0 conn(0x7f009806feb0 legacy=0x7f00980c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.836+0000 7f0095d9b700 1 -- 172.21.15.121:0/2543269769 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098154760 con 0x7f00980a6ed0 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f0095d9b700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00980a6ed0 0x7f009806f970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00880098f0 tx=0x7f0088009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70cd8eedcbc7f93 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009559a700 1 -- 172.21.15.121:0/2543269769 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088004230 con 0x7f00980a6ed0 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009559a700 1 -- 172.21.15.121:0/2543269769 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088004390 con 0x7f00980a6ed0 2023-08-18T20:44:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009559a700 1 -- 172.21.15.121:0/2543269769 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880036a0 con 0x7f00980a6ed0 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 -- 172.21.15.121:0/2543269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00980a6ed0 msgr2=0x7f009806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00980a6ed0 0x7f009806f970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00880098f0 tx=0x7f0088009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 -- 172.21.15.121:0/2543269769 shutdown_connections 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980c7380 0x7f00981585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 --2- 172.21.15.121:0/2543269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00980a6ed0 0x7f009806f970 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 -- 172.21.15.121:0/2543269769 >> 172.21.15.121:0/2543269769 conn(0x7f00980c7bf0 msgr2=0x7f00980c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 -- 172.21.15.121:0/2543269769 shutdown_connections 2023-08-18T20:44:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.837+0000 7f009cbb7700 1 -- 172.21.15.121:0/2543269769 wait complete. 2023-08-18T20:44:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 Processor -- start 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 -- start start 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980a6ed0 0x7f00980bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c7380 0x7f00980bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098156e00 con 0x7f009806feb0 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098157380 con 0x7f00980c7380 2023-08-18T20:44:20.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009cbb7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00981562d0 con 0x7f00980a6ed0 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41508/0 (socket says 172.21.15.121:41508) 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.839+0000 7f009659c700 1 -- 172.21.15.121:0/3640025610 learned_addr learned my addr 172.21.15.121:0/3640025610 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 -- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980a6ed0 msgr2=0x7f00980bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980a6ed0 0x7f00980bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 -- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c7380 msgr2=0x7f00980bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f0096d9d700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c7380 0x7f00980bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c7380 0x7f00980bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 -- 172.21.15.121:0/3640025610 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088009550 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009659c700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c011800 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c011960 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00981565b0 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c011cf0 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.840+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0098157b20 con 0x7f009806feb0 2023-08-18T20:44:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.841+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00981567a0 con 0x7f009806feb0 2023-08-18T20:44:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.842+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f008c018360 con 0x7f009806feb0 2023-08-18T20:44:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.842+0000 7f0086ffd700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 0x7f007806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.842+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f008c0883d0 con 0x7f009806feb0 2023-08-18T20:44:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.842+0000 7f0095d9b700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 0x7f007806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.842+0000 7f0095d9b700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 0x7f007806c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0088009c40 tx=0x7f0088010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:20.846+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f008c053b50 con 0x7f009806feb0 2023-08-18T20:44:21.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.079+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0098074730 con 0x7f009806feb0 2023-08-18T20:44:21.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.080+0000 7f0086ffd700 1 -- 172.21.15.121:0/3640025610 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7f008c057170 con 0x7f009806feb0 2023-08-18T20:44:21.079 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:21.080 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:44:21.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 msgr2=0x7f007806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 0x7f007806c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0088009c40 tx=0x7f0088010000 comp rx=0 tx=0).stop 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 msgr2=0x7f0098151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 shutdown_connections 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c7380 0x7f00980bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f007806a0e0 0x7f007806c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009806feb0 0x7f0098151100 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 --2- 172.21.15.121:0/3640025610 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00980a6ed0 0x7f00980bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 >> 172.21.15.121:0/3640025610 conn(0x7f00980c7bf0 msgr2=0x7f009806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 shutdown_connections 2023-08-18T20:44:21.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.082+0000 7f009cbb7700 1 -- 172.21.15.121:0/3640025610 wait complete. 2023-08-18T20:44:21.083 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:44:21.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:21.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.214+0000 7f2ed47c5700 1 Processor -- start 2023-08-18T20:44:21.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 -- start start 2023-08-18T20:44:21.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc0ca4a0 con 0x7f2ecc151b10 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc06c0f0 con 0x7f2ecc154900 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.215+0000 7f2ed47c5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc158540 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed2d62700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed2d62700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:51358/0 (socket says 172.21.15.121:51358) 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed2d62700 1 -- 172.21.15.121:0/3015478985 learned_addr learned my addr 172.21.15.121:0/3015478985 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37926/0 (socket says 172.21.15.121:37926) 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 -- 172.21.15.121:0/3015478985 >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 msgr2=0x7f2ecc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 --2- 172.21.15.121:0/3015478985 >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 -- 172.21.15.121:0/3015478985 >> v1:172.21.15.122:6789/0 conn(0x7f2ecc151b10 legacy=0x7f2ecc0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 -- 172.21.15.121:0/3015478985 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc158820 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed2d62700 1 --2- 172.21.15.121:0/3015478985 >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:21.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.216+0000 7f2ed1d60700 1 --2- 172.21.15.121:0/3015478985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009840 tx=0x7f2ec8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83003534f98815a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed155f700 1 -- 172.21.15.121:0/3015478985 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011830 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed155f700 1 -- 172.21.15.121:0/3015478985 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8011990 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed155f700 1 -- 172.21.15.121:0/3015478985 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8011d20 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3015478985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 msgr2=0x7f2ecc1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3015478985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009840 tx=0x7f2ec8009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3015478985 shutdown_connections 2023-08-18T20:44:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3015478985 >> v2:172.21.15.122:3300/0 conn(0x7f2ecc154900 0x7f2ecc15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3015478985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc0c7ca0 0x7f2ecc1543c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3015478985 >> 172.21.15.121:0/3015478985 conn(0x7f2ecc071bb0 msgr2=0x7f2ecc071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3015478985 shutdown_connections 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.217+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3015478985 wait complete. 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.219+0000 7f2ed47c5700 1 Processor -- start 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.219+0000 7f2ed47c5700 1 -- start start 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc151b10 0x7f2ecc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc154900 0x7f2ecc1e9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc1ed230 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0bf8d0 con 0x7f2ecc151b10 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc1ec890 con 0x7f2ecc154900 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41522/0 (socket says 172.21.15.121:41522) 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 -- 172.21.15.121:0/3697146989 learned_addr learned my addr 172.21.15.121:0/3697146989 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed1d60700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc151b10 0x7f2ecc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2d62700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc154900 0x7f2ecc1e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 -- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc154900 msgr2=0x7f2ecc1e9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc154900 0x7f2ecc1e9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 -- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc151b10 msgr2=0x7f2ecc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc151b10 0x7f2ecc0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 -- 172.21.15.121:0/3697146989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4009b30 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed2561700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c4e0 tx=0x7f2ec000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00052d0 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0005430 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec80094a0 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00038c0 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.220+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc1ece50 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.221+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc1ed370 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.222+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ec0003a20 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.223+0000 7f2ebeffd700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 0x7f2eb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.223+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ec0087a60 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.223+0000 7f2ed1d60700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 0x7f2eb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.223+0000 7f2ed1d60700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 0x7f2eb006c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0c8100 tx=0x7f2ec8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.227+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2ec00532c0 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.417+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ecc1ed370 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.419+0000 7f2ebeffd700 1 -- 172.21.15.121:0/3697146989 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f2ec00568e0 con 0x7f2ecc0c7ca0 2023-08-18T20:44:21.418 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:21.419 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:21.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 msgr2=0x7f2eb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 0x7f2eb006c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0c8100 tx=0x7f2ec8008030 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 msgr2=0x7f2ecc0bf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c4e0 tx=0x7f2ec000c7f0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 shutdown_connections 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2ecc154900 0x7f2ecc1e9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2eb006a0e0 0x7f2eb006c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ecc0c7ca0 0x7f2ecc0bf240 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 --2- 172.21.15.121:0/3697146989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc151b10 0x7f2ecc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 >> 172.21.15.121:0/3697146989 conn(0x7f2ecc071bb0 msgr2=0x7f2ecc071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 shutdown_connections 2023-08-18T20:44:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.421+0000 7f2ed47c5700 1 -- 172.21.15.121:0/3697146989 wait complete. 2023-08-18T20:44:21.433 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-18T20:44:21.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:21.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.554+0000 7fbeff2f0700 1 Processor -- start 2023-08-18T20:44:21.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.554+0000 7fbeff2f0700 1 -- start start 2023-08-18T20:44:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbeff2f0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbeff2f0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbef80c5ae0 0x7fbef8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbeff2f0700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80c4f40 con 0x7fbef806a7e0 2023-08-18T20:44:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbeff2f0700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80c6120 con 0x7fbef80c5ae0 2023-08-18T20:44:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbeff2f0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81551f0 con 0x7fbef80c0c50 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd88d700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbef80c5ae0 0x7fbef8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:37940/0 (socket says 172.21.15.121:37940) 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 -- 172.21.15.121:0/3084638104 learned_addr learned my addr 172.21.15.121:0/3084638104 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 -- 172.21.15.121:0/3084638104 >> v2:172.21.15.122:3300/0 conn(0x7fbef80c5ae0 msgr2=0x7fbef8071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 --2- 172.21.15.121:0/3084638104 >> v2:172.21.15.122:3300/0 conn(0x7fbef80c5ae0 0x7fbef8071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 -- 172.21.15.121:0/3084638104 >> v1:172.21.15.122:6789/0 conn(0x7fbef806a7e0 legacy=0x7fbef80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.555+0000 7fbefd08c700 1 -- 172.21.15.121:0/3084638104 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c63a0 con 0x7fbef80c0c50 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbefd08c700 1 --2- 172.21.15.121:0/3084638104 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbef40098f0 tx=0x7fbef4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7df2d259ad4b9f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeeffff700 1 -- 172.21.15.121:0/3084638104 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011830 con 0x7fbef80c0c50 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeeffff700 1 -- 172.21.15.121:0/3084638104 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4011990 con 0x7fbef80c0c50 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeeffff700 1 -- 172.21.15.121:0/3084638104 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011d20 con 0x7fbef80c0c50 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 -- 172.21.15.121:0/3084638104 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 msgr2=0x7fbef806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/3084638104 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbef40098f0 tx=0x7fbef4009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:21.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 -- 172.21.15.121:0/3084638104 shutdown_connections 2023-08-18T20:44:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/3084638104 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef80c0c50 0x7fbef806a2a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/3084638104 >> v2:172.21.15.122:3300/0 conn(0x7fbef80c5ae0 0x7fbef8071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 -- 172.21.15.121:0/3084638104 >> 172.21.15.121:0/3084638104 conn(0x7fbef80c6b10 msgr2=0x7fbef80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 -- 172.21.15.121:0/3084638104 shutdown_connections 2023-08-18T20:44:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.556+0000 7fbeff2f0700 1 -- 172.21.15.121:0/3084638104 wait complete. 2023-08-18T20:44:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 Processor -- start 2023-08-18T20:44:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 -- start start 2023-08-18T20:44:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef806a7e0 0x7fbef814dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbef80c0c50 0x7fbef8071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8158990 con 0x7fbef80c5ae0 2023-08-18T20:44:21.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8157e10 con 0x7fbef80c0c50 2023-08-18T20:44:21.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbeff2f0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81580f0 con 0x7fbef806a7e0 2023-08-18T20:44:21.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbefd88d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbefd88d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41540/0 (socket says 172.21.15.121:41540) 2023-08-18T20:44:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.558+0000 7fbefd88d700 1 -- 172.21.15.121:0/2349167976 learned_addr learned my addr 172.21.15.121:0/2349167976 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd08c700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef806a7e0 0x7fbef814dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefc88b700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbef80c0c50 0x7fbef8071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 -- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef806a7e0 msgr2=0x7fbef814dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef806a7e0 0x7fbef814dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 -- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbef80c0c50 msgr2=0x7fbef8071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbef80c0c50 0x7fbef8071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 -- 172.21.15.121:0/2349167976 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4009550 con 0x7fbef80c5ae0 2023-08-18T20:44:21.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbefd88d700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbef000efc0 tx=0x7fbef000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0009ea0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000f040 con 0x7fbef80c5ae0 2023-08-18T20:44:21.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef81583d0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000ced0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.559+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef80abcd0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.560+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8074730 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.561+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbef0014480 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.561+0000 7fbeedffb700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 0x7fbedc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.561+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbef0088e30 con 0x7fbef80c5ae0 2023-08-18T20:44:21.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.561+0000 7fbefd08c700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 0x7fbedc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.562+0000 7fbefd08c700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 0x7fbedc06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009c40 tx=0x7fbef4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.566+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbef00544a0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.797+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef81ecd30 con 0x7fbef80c5ae0 2023-08-18T20:44:21.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.797+0000 7fbeedffb700 1 -- 172.21.15.121:0/2349167976 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7fbef0057ac0 con 0x7fbef80c5ae0 2023-08-18T20:44:21.799 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:21.799 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:44:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.799+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 msgr2=0x7fbedc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.799+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 0x7fbedc06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009c40 tx=0x7fbef4008030 comp rx=0 tx=0).stop 2023-08-18T20:44:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.799+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 msgr2=0x7fbef81ed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.799+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbef000efc0 tx=0x7fbef000c3a0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 shutdown_connections 2023-08-18T20:44:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbedc06a0e0 0x7fbedc06c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef80c5ae0 0x7fbef81ed080 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbef806a7e0 0x7fbef814dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 --2- 172.21.15.121:0/2349167976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbef80c0c50 0x7fbef8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 >> 172.21.15.121:0/2349167976 conn(0x7fbef80c6b10 msgr2=0x7fbef80c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 shutdown_connections 2023-08-18T20:44:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.800+0000 7fbeff2f0700 1 -- 172.21.15.121:0/2349167976 wait complete. 2023-08-18T20:44:21.805 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:44:21.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:21.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.932+0000 7f94b97d1700 1 Processor -- start 2023-08-18T20:44:21.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.932+0000 7f94b97d1700 1 -- start start 2023-08-18T20:44:21.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 0x7f94b40bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c6560 0x7f94b40bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f94b40c2c80 0x7f94b40c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b414ed20 con 0x7f94b40c2c80 2023-08-18T20:44:21.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b4151be0 con 0x7f94b40c6120 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b97d1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c20d0 con 0x7f94b40c6560 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f94b40c2c80 0x7f94b40c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b37fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f94b40c2c80 0x7f94b40c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41548/0 (socket says 172.21.15.121:41548) 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b37fe700 1 -- 172.21.15.121:0/4240506954 learned_addr learned my addr 172.21.15.121:0/4240506954 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b2ffd700 1 --2- 172.21.15.121:0/4240506954 >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 0x7f94b40bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.933+0000 7f94b27fc700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c6560 0x7f94b40bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 -- 172.21.15.121:0/4240506954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c6560 msgr2=0x7f94b40bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c6560 0x7f94b40bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 -- 172.21.15.121:0/4240506954 >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 msgr2=0x7f94b40bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 --2- 172.21.15.121:0/4240506954 >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 0x7f94b40bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 -- 172.21.15.121:0/4240506954 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40c23b0 con 0x7f94b40c2c80 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b2ffd700 1 --2- 172.21.15.121:0/4240506954 >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 0x7f94b40bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b37fe700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c2c80 0x7f94b40c4a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f94b4066ea0 tx=0x7f94ac00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d22d69c9ff6615 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b1ffb700 1 -- 172.21.15.121:0/4240506954 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac010070 con 0x7f94b40c2c80 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b1ffb700 1 -- 172.21.15.121:0/4240506954 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00dd90 con 0x7f94b40c2c80 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b1ffb700 1 -- 172.21.15.121:0/4240506954 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00b310 con 0x7f94b40c2c80 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 -- 172.21.15.121:0/4240506954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c2c80 msgr2=0x7f94b40c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c2c80 0x7f94b40c4a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f94b4066ea0 tx=0x7f94ac00d430 comp rx=0 tx=0).stop 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 -- 172.21.15.121:0/4240506954 shutdown_connections 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 --2- 172.21.15.121:0/4240506954 >> v2:172.21.15.122:3300/0 conn(0x7f94b40c6120 0x7f94b40bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c2c80 0x7f94b40c4a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 --2- 172.21.15.121:0/4240506954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c6560 0x7f94b40bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 -- 172.21.15.121:0/4240506954 >> 172.21.15.121:0/4240506954 conn(0x7f94b40c35a0 msgr2=0x7f94b40c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:21.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.934+0000 7f94b97d1700 1 -- 172.21.15.121:0/4240506954 shutdown_connections 2023-08-18T20:44:21.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.935+0000 7f94b97d1700 1 -- 172.21.15.121:0/4240506954 wait complete. 2023-08-18T20:44:21.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 Processor -- start 2023-08-18T20:44:21.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 -- start start 2023-08-18T20:44:21.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c2c80 0x7f94b4154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94b40c6120 0x7f94b41ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40be3f0 con 0x7f94b40c6560 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4153ea0 con 0x7f94b40c6120 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b97d1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4154180 con 0x7f94b40c2c80 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.936+0000 7f94b37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41554/0 (socket says 172.21.15.121:41554) 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 -- 172.21.15.121:0/1961445245 learned_addr learned my addr 172.21.15.121:0/1961445245 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b2ffd700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c2c80 0x7f94b4154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b27fc700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94b40c6120 0x7f94b41ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 -- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c2c80 msgr2=0x7f94b4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c2c80 0x7f94b4154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 -- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94b40c6120 msgr2=0x7f94b41ead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94b40c6120 0x7f94b41ead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 -- 172.21.15.121:0/1961445245 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac00bd40 con 0x7f94b40c6560 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b37fe700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94ac014000 tx=0x7f94ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00bbc0 con 0x7f94b40c6560 2023-08-18T20:44:21.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac003e30 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b4154460 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac009a30 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.937+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b41eb270 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.938+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b4154980 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.939+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94ac009b90 con 0x7f94b40c6560 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.939+0000 7f949b7fe700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 0x7f94a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:21.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.939+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94ac0898b0 con 0x7f94b40c6560 2023-08-18T20:44:21.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.939+0000 7f94b2ffd700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 0x7f94a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:21.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.939+0000 7f94b2ffd700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 0x7f94a006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94b4099b10 tx=0x7f94a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:21.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:21.943+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f94b4154980 con 0x7f94b40c6560 2023-08-18T20:44:22.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.176+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94b4154980 con 0x7f94b40c6560 2023-08-18T20:44:22.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.176+0000 7f949b7fe700 1 -- 172.21.15.121:0/1961445245 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4881 (secure 0 0 0) 0x7f94b4154980 con 0x7f94b40c6560 2023-08-18T20:44:22.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:22.176 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1341099317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1341099317},{"type":"v1","addr":"172.21.15.122:6834","nonce":1341099317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3242986304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":3242986304},{"type":"v1","addr":"172.21.15.122:6835","nonce":3242986304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1339390519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1339390519},{"type":"v1","addr":"172.21.15.121:6837","nonce":1339390519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:43:43.995422+0000","modified":"2023-08-18T20:43:47.615544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2861878928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2861878928},{"type":"v1","addr":"172.21.15.121:6835","nonce":2861878928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-18T20:44:22.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 msgr2=0x7f94a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 0x7f94a006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94b4099b10 tx=0x7f94a8008040 comp rx=0 tx=0).stop 2023-08-18T20:44:22.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 msgr2=0x7f94b414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94ac014000 tx=0x7f94ac004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 shutdown_connections 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f94a006a0e0 0x7f94a006c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b40c6560 0x7f94b414cf50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94b40c2c80 0x7f94b4154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 --2- 172.21.15.121:0/1961445245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94b40c6120 0x7f94b41ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.178+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 >> 172.21.15.121:0/1961445245 conn(0x7f94b40c35a0 msgr2=0x7f94b406e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:22.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.179+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 shutdown_connections 2023-08-18T20:44:22.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.179+0000 7f94b97d1700 1 -- 172.21.15.121:0/1961445245 wait complete. 2023-08-18T20:44:22.180 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2023-08-18T20:44:22.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:22.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.311+0000 7f4e67f2f700 1 Processor -- start 2023-08-18T20:44:22.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.311+0000 7f4e67f2f700 1 -- start start 2023-08-18T20:44:22.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e67f2f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e6014e950 0x7f4e600c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e67f2f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4e6014ed30 0x7f4e600c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e67f2f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600c2260 con 0x7f4e600c19d0 2023-08-18T20:44:22.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e67f2f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e600a6630 con 0x7f4e6014ed30 2023-08-18T20:44:22.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e67f2f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60151d90 con 0x7f4e6014e950 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e654ca700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4e6014ed30 0x7f4e600c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e654ca700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4e6014ed30 0x7f4e600c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41558/0 (socket says 172.21.15.121:41558) 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.312+0000 7f4e654ca700 1 -- 172.21.15.121:0/390378781 learned_addr learned my addr 172.21.15.121:0/390378781 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e65ccb700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e6014e950 0x7f4e600c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e654ca700 1 -- 172.21.15.121:0/390378781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e6014e950 msgr2=0x7f4e600c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e654ca700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e6014e950 0x7f4e600c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e654ca700 1 -- 172.21.15.121:0/390378781 >> v1:172.21.15.122:6789/0 conn(0x7f4e600c19d0 legacy=0x7f4e600c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:22.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e654ca700 1 -- 172.21.15.121:0/390378781 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60152070 con 0x7f4e6014ed30 2023-08-18T20:44:22.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e654ca700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e600c1490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00bb90 tx=0x7f4e5c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae46cd6a9bcec2b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e64cc9700 1 -- 172.21.15.121:0/390378781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00dd50 con 0x7f4e6014ed30 2023-08-18T20:44:22.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e64cc9700 1 -- 172.21.15.121:0/390378781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c010470 con 0x7f4e6014ed30 2023-08-18T20:44:22.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e64cc9700 1 -- 172.21.15.121:0/390378781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c010800 con 0x7f4e6014ed30 2023-08-18T20:44:22.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e67f2f700 1 -- 172.21.15.121:0/390378781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 msgr2=0x7f4e600c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.313+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e600c1490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00bb90 tx=0x7f4e5c00bea0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 -- 172.21.15.121:0/390378781 shutdown_connections 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e6014e950 0x7f4e600c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/390378781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e600c1490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 -- 172.21.15.121:0/390378781 >> 172.21.15.121:0/390378781 conn(0x7f4e600c6b10 msgr2=0x7f4e600c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 -- 172.21.15.121:0/390378781 shutdown_connections 2023-08-18T20:44:22.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.314+0000 7f4e67f2f700 1 -- 172.21.15.121:0/390378781 wait complete. 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 Processor -- start 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 -- start start 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e600c19d0 0x7f4e60148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6014e950 0x7f4e6014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6014c400 con 0x7f4e6014ed30 2023-08-18T20:44:22.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6006e9e0 con 0x7f4e6014e950 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.315+0000 7f4e67f2f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6006cb30 con 0x7f4e600c19d0 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41566/0 (socket says 172.21.15.121:41566) 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 -- 172.21.15.121:0/2232429718 learned_addr learned my addr 172.21.15.121:0/2232429718 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e65ccb700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e600c19d0 0x7f4e60148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e654ca700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6014e950 0x7f4e6014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 -- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e600c19d0 msgr2=0x7f4e60148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e600c19d0 0x7f4e60148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 -- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6014e950 msgr2=0x7f4e6014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6014e950 0x7f4e6014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 -- 172.21.15.121:0/2232429718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c00b7f0 con 0x7f4e6014ed30 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e664cc700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800cc80 tx=0x7f4e5800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58003c00 con 0x7f4e6014ed30 2023-08-18T20:44:22.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58003d60 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6014c120 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800aaa0 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.316+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601e9da0 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.317+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6006ccf0 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.318+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e5800ac00 con 0x7f4e6014ed30 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.318+0000 7f4e567fc700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 0x7f4e4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.318+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e58088490 con 0x7f4e6014ed30 2023-08-18T20:44:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.318+0000 7f4e65ccb700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 0x7f4e4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.318+0000 7f4e65ccb700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 0x7f4e4406c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e50006b20 tx=0x7f4e50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.322+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4e58053c10 con 0x7f4e6014ed30 2023-08-18T20:44:22.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.511+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e60074730 con 0x7f4e6014ed30 2023-08-18T20:44:22.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.512+0000 7f4e567fc700 1 -- 172.21.15.121:0/2232429718 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f4e58057230 con 0x7f4e6014ed30 2023-08-18T20:44:22.512 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:22.512 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:43:45.604148+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:43:41.820617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-18T20:43:42.987696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:22.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 msgr2=0x7f4e4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 0x7f4e4406c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e50006b20 tx=0x7f4e50008040 comp rx=0 tx=0).stop 2023-08-18T20:44:22.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 msgr2=0x7f4e601ec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800cc80 tx=0x7f4e5800cf90 comp rx=0 tx=0).stop 2023-08-18T20:44:22.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 shutdown_connections 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4e4406a0e0 0x7f4e4406c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e6014ed30 0x7f4e601ec500 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e600c19d0 0x7f4e60148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 --2- 172.21.15.121:0/2232429718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6014e950 0x7f4e6014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 >> 172.21.15.121:0/2232429718 conn(0x7f4e600c6b10 msgr2=0x7f4e600a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 shutdown_connections 2023-08-18T20:44:22.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.514+0000 7f4e67f2f700 1 -- 172.21.15.121:0/2232429718 wait complete. 2023-08-18T20:44:22.526 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-18T20:44:22.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.649+0000 7f9a64244700 1 Processor -- start 2023-08-18T20:44:22.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.649+0000 7f9a64244700 1 -- start start 2023-08-18T20:44:22.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a64244700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9a5c0c5490 0x7f9a5c158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a64244700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0c21f0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a64244700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0c5b20 con 0x7f9a5c06a510 2023-08-18T20:44:22.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a64244700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c2ba0 con 0x7f9a5c0c5490 2023-08-18T20:44:22.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a617df700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9a5c0c1cf0 0x7f9a5c157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48154/0 (socket says 172.21.15.121:48154) 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a617df700 1 -- 172.21.15.121:0/546249825 learned_addr learned my addr 172.21.15.121:0/546249825 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a627e1700 1 --2- 172.21.15.121:0/546249825 >> v2:172.21.15.122:3300/0 conn(0x7f9a5c0c5490 0x7f9a5c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719499973 0 0) 0x7f9a5c0c21f0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a480035b0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a627e1700 1 -- 172.21.15.121:0/546249825 >> v1:172.21.15.122:6789/0 conn(0x7f9a5c06a510 legacy=0x7f9a5c151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538668615 0 0) 0x7f9a480035b0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a627e1700 1 -- 172.21.15.121:0/546249825 >> v1:172.21.15.121:6789/0 conn(0x7f9a5c0c1cf0 legacy=0x7f9a5c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.650+0000 7f9a627e1700 1 -- 172.21.15.121:0/546249825 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0c6510 con 0x7f9a5c0c5490 2023-08-18T20:44:22.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a627e1700 1 --2- 172.21.15.121:0/546249825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c0c5490 0x7f9a5c158320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce08e81b9d5c8e47 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400e070 con 0x7f9a5c0c5490 2023-08-18T20:44:22.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54003a20 con 0x7f9a5c0c5490 2023-08-18T20:44:22.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a60fde700 1 -- 172.21.15.121:0/546249825 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58001670 con 0x7f9a5c0c5490 2023-08-18T20:44:22.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 -- 172.21.15.121:0/546249825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c0c5490 msgr2=0x7f9a5c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 --2- 172.21.15.121:0/546249825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c0c5490 0x7f9a5c158320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:22.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 -- 172.21.15.121:0/546249825 shutdown_connections 2023-08-18T20:44:22.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 --2- 172.21.15.121:0/546249825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c0c5490 0x7f9a5c158320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 -- 172.21.15.121:0/546249825 >> 172.21.15.121:0/546249825 conn(0x7f9a5c0c6b10 msgr2=0x7f9a5c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:22.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 -- 172.21.15.121:0/546249825 shutdown_connections 2023-08-18T20:44:22.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.651+0000 7f9a64244700 1 -- 172.21.15.121:0/546249825 wait complete. 2023-08-18T20:44:22.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.652+0000 7f9a64244700 1 Processor -- start 2023-08-18T20:44:22.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 -- start start 2023-08-18T20:44:22.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c06a510 0x7f9a5c06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a5c0c5490 0x7f9a5c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c1ea8f0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ab8d0 con 0x7f9a5c06a510 2023-08-18T20:44:22.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a64244700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c1e9f50 con 0x7f9a5c0c5490 2023-08-18T20:44:22.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a617df700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a617df700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41578/0 (socket says 172.21.15.121:41578) 2023-08-18T20:44:22.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.653+0000 7f9a617df700 1 -- 172.21.15.121:0/2614899823 learned_addr learned my addr 172.21.15.121:0/2614899823 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:22.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a627e1700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a5c0c5490 0x7f9a5c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a61fe0700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c06a510 0x7f9a5c06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 -- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a5c0c5490 msgr2=0x7f9a5c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a5c0c5490 0x7f9a5c14dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 -- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c06a510 msgr2=0x7f9a5c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c06a510 0x7f9a5c06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 -- 172.21.15.121:0/2614899823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009a70 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a617df700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a580011e0 tx=0x7f9a5800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58007560 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a580076c0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c1ea230 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004a90 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.654+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c06dd50 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.655+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c06b220 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.655+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a58004bf0 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.656+0000 7f9a527fc700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 0x7f9a4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.656+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a58087a00 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.656+0000 7f9a61fe0700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 0x7f9a4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.656+0000 7f9a61fe0700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 0x7f9a4006c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c000f60 tx=0x7f9a4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.660+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9a58053180 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.894+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9a5c072a20 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.893 INFO:tasks.ceph.mon.a.smithi121.stderr:2023-08-18T20:44:22.894+0000 7f5248ffa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-18T20:44:22.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.898+0000 7f9a527fc700 1 -- 172.21.15.121:0/2614899823 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a5c072a20 con 0x7f9a5c0c1cf0 2023-08-18T20:44:22.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 msgr2=0x7f9a4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 0x7f9a4006c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c000f60 tx=0x7f9a4c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 msgr2=0x7f9a5c154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a580011e0 tx=0x7f9a5800cb00 comp rx=0 tx=0).stop 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 shutdown_connections 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a5c0c5490 0x7f9a5c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a5c06a510 0x7f9a5c06d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9a4006a0e0 0x7f9a4006c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 --2- 172.21.15.121:0/2614899823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c0c1cf0 0x7f9a5c154de0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 >> 172.21.15.121:0/2614899823 conn(0x7f9a5c0c6b10 msgr2=0x7f9a5c156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 shutdown_connections 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:22.901+0000 7f9a64244700 1 -- 172.21.15.121:0/2614899823 wait complete. 2023-08-18T20:44:22.902 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-18T20:44:22.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-18T20:44:22.936 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2023-08-18T20:44:23.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.038+0000 7f76134a7700 1 Processor -- start 2023-08-18T20:44:23.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.038+0000 7f76134a7700 1 -- start start 2023-08-18T20:44:23.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f76134a7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f760c072200 0x7f760c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f76134a7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c14eb70 con 0x7f760c14e790 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f76134a7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c070790 con 0x7f760c0c37c0 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f76134a7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c154830 con 0x7f760c072200 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f7611243700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f760c14e790 0x7f760c06b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48178/0 (socket says 172.21.15.121:48178) 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.039+0000 7f7611243700 1 -- 172.21.15.121:0/1920462105 learned_addr learned my addr 172.21.15.121:0/1920462105 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:23.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7610a42700 1 --2- 172.21.15.121:0/1920462105 >> v2:172.21.15.122:3300/0 conn(0x7f760c072200 0x7f760c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794033050 0 0) 0x7f760c14eb70 con 0x7f760c14e790 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f80035b0 con 0x7f760c14e790 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3810241052 0 0) 0x7f75f80035b0 con 0x7f760c14e790 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 >> v2:172.21.15.122:3300/0 conn(0x7f760c072200 msgr2=0x7f760c1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 --2- 172.21.15.121:0/1920462105 >> v2:172.21.15.122:3300/0 conn(0x7f760c072200 0x7f760c1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 >> v1:172.21.15.122:6789/0 conn(0x7f760c0c37c0 legacy=0x7f760c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c154b10 con 0x7f760c14e790 2023-08-18T20:44:23.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f75fc001670 con 0x7f760c14e790 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 >> v1:172.21.15.121:6789/0 conn(0x7f760c14e790 legacy=0x7f760c06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8003a00 0x7f75f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f8004850 0x7f75f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 0x7f75f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c154830 con 0x7f75f8005210 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f800c0b0 con 0x7f75f8004850 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f800c270 con 0x7f75f8003a00 2023-08-18T20:44:23.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 0x7f75f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7610a42700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f8004850 0x7f75f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611243700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8003a00 0x7f75f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 -- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8003a00 msgr2=0x7f75f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8003a00 0x7f75f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 -- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f8004850 msgr2=0x7f75f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f8004850 0x7f75f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 -- 172.21.15.121:0/1920462105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80035b0 con 0x7f75f8005210 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.040+0000 7f7611a44700 1 -- 172.21.15.121:0/1920462105 reap_dead start 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f7611a44700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 0x7f75f800ba10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f760400c110 tx=0x7f75f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dc126cb10b7feb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604001da0 con 0x7f75f8005210 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604003c50 con 0x7f75f8005210 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f7603fff700 1 -- 172.21.15.121:0/1920462105 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400ca50 con 0x7f75f8005210 2023-08-18T20:44:23.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 -- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 msgr2=0x7f75f800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 0x7f75f800ba10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f760400c110 tx=0x7f75f8005880 comp rx=0 tx=0).stop 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 -- 172.21.15.121:0/1920462105 shutdown_connections 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 --2- 172.21.15.121:0/1920462105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f8005210 0x7f75f800ba10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 -- 172.21.15.121:0/1920462105 >> 172.21.15.121:0/1920462105 conn(0x7f760c0c2ca0 msgr2=0x7f760c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 -- 172.21.15.121:0/1920462105 shutdown_connections 2023-08-18T20:44:23.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.041+0000 7f76134a7700 1 -- 172.21.15.121:0/1920462105 wait complete. 2023-08-18T20:44:23.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.042+0000 7f76134a7700 1 Processor -- start 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.042+0000 7f76134a7700 1 -- start start 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8005210 0x7f760c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 0x7f760c0a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c151860 con 0x7f760c0aa6b0 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1e64e0 con 0x7f760c1513d0 2023-08-18T20:44:23.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f76134a7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1e67c0 con 0x7f75f8005210 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41610/0 (socket says 172.21.15.121:41610) 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 -- 172.21.15.121:0/2267363732 learned_addr learned my addr 172.21.15.121:0/2267363732 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7611a44700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 0x7f760c0a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7611243700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8005210 0x7f760c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 -- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8005210 msgr2=0x7f760c0c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8005210 0x7f760c0c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 -- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 msgr2=0x7f760c0a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 0x7f760c0a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7610a42700 1 -- 172.21.15.121:0/2267363732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c1e6aa0 con 0x7f760c0aa6b0 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.043+0000 7f7611a44700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 0x7f760c0a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f7610a42700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7608011910 tx=0x7f7608011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608005c30 con 0x7f760c0aa6b0 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608005d90 con 0x7f760c0aa6b0 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800f8f0 con 0x7f760c0aa6b0 2023-08-18T20:44:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c1e6d80 con 0x7f760c0aa6b0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.044+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c06e750 con 0x7f760c0aa6b0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.045+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c074730 con 0x7f760c0aa6b0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.045+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f760800fa50 con 0x7f760c0aa6b0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.046+0000 7f7601ffb700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 0x7f75f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.046+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7608088c10 con 0x7f760c0aa6b0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.046+0000 7f7611243700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 0x7f75f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.046+0000 7f7611243700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 0x7f75f006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001200 tx=0x7f75fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:23.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.050+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7608054290 con 0x7f760c0aa6b0 2023-08-18T20:44:23.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.283+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f760c0c1c90 con 0x7f760c0aa6b0 2023-08-18T20:44:23.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.952+0000 7f7601ffb700 1 -- 172.21.15.121:0/2267363732 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76080578b0 con 0x7f760c0aa6b0 2023-08-18T20:44:23.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 msgr2=0x7f75f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 0x7f75f006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001200 tx=0x7f75fc009040 comp rx=0 tx=0).stop 2023-08-18T20:44:23.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 msgr2=0x7f760c150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:23.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7608011910 tx=0x7f7608011cd0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 shutdown_connections 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f760c1513d0 0x7f760c0a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75f8005210 0x7f760c0c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f75f006a0e0 0x7f75f006c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 --2- 172.21.15.121:0/2267363732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f760c0aa6b0 0x7f760c150e90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 >> 172.21.15.121:0/2267363732 conn(0x7f760c0c2ca0 msgr2=0x7f760c14b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:23.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.954+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 shutdown_connections 2023-08-18T20:44:23.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:23.955+0000 7f76134a7700 1 -- 172.21.15.121:0/2267363732 wait complete. 2023-08-18T20:44:23.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-18T20:44:24.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.139+0000 7f3655dc0700 1 Processor -- start 2023-08-18T20:44:24.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.139+0000 7f3655dc0700 1 -- start start 2023-08-18T20:44:24.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f3655dc0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f3655dc0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36500c0230 0x7f365006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f3655dc0700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36500c6700 con 0x7f365006a7e0 2023-08-18T20:44:24.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f3655dc0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36501554d0 con 0x7f36500c0230 2023-08-18T20:44:24.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f3655dc0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a64b0 con 0x7f365014b0c0 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36500c0230 0x7f365006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36500c0230 0x7f365006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41620/0 (socket says 172.21.15.121:41620) 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 -- 172.21.15.121:0/1024791205 learned_addr learned my addr 172.21.15.121:0/1024791205 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364f7fe700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 -- 172.21.15.121:0/1024791205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 msgr2=0x7f3650154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 -- 172.21.15.121:0/1024791205 >> v1:172.21.15.122:6789/0 conn(0x7f365006a7e0 legacy=0x7f365006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 -- 172.21.15.121:0/1024791205 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500a5ef0 con 0x7f36500c0230 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.140+0000 7f364effd700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36500c0230 0x7f365006a2a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f3640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ff8c4922aa3a04 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f364e7fc700 1 -- 172.21.15.121:0/1024791205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640004230 con 0x7f36500c0230 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f364e7fc700 1 -- 172.21.15.121:0/1024791205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640004390 con 0x7f36500c0230 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f364e7fc700 1 -- 172.21.15.121:0/1024791205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400036a0 con 0x7f36500c0230 2023-08-18T20:44:24.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 -- 172.21.15.121:0/1024791205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36500c0230 msgr2=0x7f365006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36500c0230 0x7f365006a2a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f3640009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 -- 172.21.15.121:0/1024791205 shutdown_connections 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1024791205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36500c0230 0x7f365006a2a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 -- 172.21.15.121:0/1024791205 >> 172.21.15.121:0/1024791205 conn(0x7f36500a8770 msgr2=0x7f36500a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 -- 172.21.15.121:0/1024791205 shutdown_connections 2023-08-18T20:44:24.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.141+0000 7f3655dc0700 1 -- 172.21.15.121:0/1024791205 wait complete. 2023-08-18T20:44:24.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.142+0000 7f3655dc0700 1 Processor -- start 2023-08-18T20:44:24.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 -- start start 2023-08-18T20:44:24.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 0x7f36500a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501ea590 con 0x7f365006a7e0 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500ab800 con 0x7f36500c0230 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f3655dc0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500ac5a0 con 0x7f365014b0c0 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f364f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f364f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41624/0 (socket says 172.21.15.121:41624) 2023-08-18T20:44:24.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.143+0000 7f364f7fe700 1 -- 172.21.15.121:0/1795754708 learned_addr learned my addr 172.21.15.121:0/1795754708 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364effd700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 0x7f36500a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364ffff700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 -- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 msgr2=0x7f3650149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 -- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 msgr2=0x7f36500a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 0x7f36500a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 -- 172.21.15.121:0/1795754708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009550 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364effd700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 0x7f36500a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f364f7fe700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f363800c7f0 tx=0x7f363800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638011800 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638011960 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500ac880 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638011cf0 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.144+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36501eaa80 con 0x7f365006a7e0 2023-08-18T20:44:24.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.145+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650074730 con 0x7f365006a7e0 2023-08-18T20:44:24.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.145+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3638018360 con 0x7f365006a7e0 2023-08-18T20:44:24.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.146+0000 7f3647fff700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 0x7f363006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:24.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.146+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3638088540 con 0x7f365006a7e0 2023-08-18T20:44:24.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.146+0000 7f364effd700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 0x7f363006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:24.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.146+0000 7f364effd700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 0x7f363006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36500714d0 tx=0x7f3640008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:24.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.150+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3638053bd0 con 0x7f365006a7e0 2023-08-18T20:44:24.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.342+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36500c0010 con 0x7f365006a7e0 2023-08-18T20:44:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.962+0000 7f3647fff700 1 -- 172.21.15.121:0/1795754708 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f36380571f0 con 0x7f365006a7e0 2023-08-18T20:44:24.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.965+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 msgr2=0x7f363006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:24.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.965+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 0x7f363006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36500714d0 tx=0x7f3640008030 comp rx=0 tx=0).stop 2023-08-18T20:44:24.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.965+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 msgr2=0x7f36500ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:24.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.965+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f363800c7f0 tx=0x7f363800cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 shutdown_connections 2023-08-18T20:44:24.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f365014b0c0 0x7f3650149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f363006a0e0 0x7f363006c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f365006a7e0 0x7f36500ab2c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 --2- 172.21.15.121:0/1795754708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36500c0230 0x7f36500a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:24.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 >> 172.21.15.121:0/1795754708 conn(0x7f36500a8770 msgr2=0x7f36500a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:24.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 shutdown_connections 2023-08-18T20:44:24.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:24.967+0000 7f3655dc0700 1 -- 172.21.15.121:0/1795754708 wait complete. 2023-08-18T20:44:24.967 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2023-08-18T20:44:24.980 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-18T20:44:25.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.105+0000 7f663eedd700 1 Processor -- start 2023-08-18T20:44:25.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.105+0000 7f663eedd700 1 -- start start 2023-08-18T20:44:25.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663eedd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f66380c1720 0x7f66380c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663eedd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66380abf10 0x7f6638151690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663eedd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6638066180 con 0x7f6638151bd0 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663eedd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6638066700 con 0x7f66380c1720 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663eedd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638155410 con 0x7f66380abf10 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f66380c1720 0x7f66380c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663d47a700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6638151bd0 0x7f663806a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48218/0 (socket says 172.21.15.121:48218) 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663d47a700 1 -- 172.21.15.121:0/2864131005 learned_addr learned my addr 172.21.15.121:0/2864131005 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f6637fff700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66380abf10 0x7f6638151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 -- 172.21.15.121:0/2864131005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66380abf10 msgr2=0x7f6638151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66380abf10 0x7f6638151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 -- 172.21.15.121:0/2864131005 >> v1:172.21.15.121:6789/0 conn(0x7f6638151bd0 legacy=0x7f663806a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f66377fe700 1 -- 172.21.15.121:0/2864131005 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246957974 0 0) 0x7f6638066180 con 0x7f6638151bd0 2023-08-18T20:44:25.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 -- 172.21.15.121:0/2864131005 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638154e70 con 0x7f66380c1720 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.106+0000 7f663cc79700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f66380c0dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f662c009870 tx=0x7f662c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c79259ad95c7f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f66377fe700 1 -- 172.21.15.121:0/2864131005 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c011830 con 0x7f66380c1720 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f66377fe700 1 -- 172.21.15.121:0/2864131005 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c011990 con 0x7f66380c1720 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f66377fe700 1 -- 172.21.15.121:0/2864131005 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c011d20 con 0x7f66380c1720 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 -- 172.21.15.121:0/2864131005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 msgr2=0x7f66380c0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f66380c0dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f662c009870 tx=0x7f662c009b80 comp rx=0 tx=0).stop 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 -- 172.21.15.121:0/2864131005 shutdown_connections 2023-08-18T20:44:25.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f66380c0dd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 --2- 172.21.15.121:0/2864131005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66380abf10 0x7f6638151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 -- 172.21.15.121:0/2864131005 >> 172.21.15.121:0/2864131005 conn(0x7f663806bdc0 msgr2=0x7f663806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:25.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 -- 172.21.15.121:0/2864131005 shutdown_connections 2023-08-18T20:44:25.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.107+0000 7f663eedd700 1 -- 172.21.15.121:0/2864131005 wait complete. 2023-08-18T20:44:25.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.108+0000 7f663eedd700 1 Processor -- start 2023-08-18T20:44:25.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.108+0000 7f663eedd700 1 -- start start 2023-08-18T20:44:25.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66380abf10 0x7f663814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 0x7f6638156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638158210 con 0x7f66380c1720 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663814b200 con 0x7f66380abf10 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f663eedd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66381586a0 con 0x7f6638151bd0 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f6637fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f6637fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41642/0 (socket says 172.21.15.121:41642) 2023-08-18T20:44:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.109+0000 7f6637fff700 1 -- 172.21.15.121:0/613656568 learned_addr learned my addr 172.21.15.121:0/613656568 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:25.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f663d47a700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 0x7f6638156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 -- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 msgr2=0x7f6638156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f663cc79700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66380abf10 0x7f663814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 0x7f6638156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 -- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66380abf10 msgr2=0x7f663814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66380abf10 0x7f663814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 -- 172.21.15.121:0/613656568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0094a0 con 0x7f66380c1720 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f663d47a700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 0x7f6638156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f6637fff700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f662400c7f0 tx=0x7f662400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:25.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624004220 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624004380 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663814e750 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240036a0 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.110+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66381ea350 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.111+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66381584f0 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.111+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6624003800 con 0x7f66380c1720 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.112+0000 7f66357fa700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 0x7f661c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:25.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.112+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f6624087fb0 con 0x7f66380c1720 2023-08-18T20:44:25.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.112+0000 7f663cc79700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 0x7f661c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:25.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.112+0000 7f663cc79700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 0x7f661c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f662c0090b0 tx=0x7f662c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:25.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.116+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f66240ba940 con 0x7f66380c1720 2023-08-18T20:44:25.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.306+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66381ea570 con 0x7f66380c1720 2023-08-18T20:44:25.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.969+0000 7f66357fa700 1 -- 172.21.15.121:0/613656568 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f66240572a0 con 0x7f66380c1720 2023-08-18T20:44:25.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 msgr2=0x7f661c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 0x7f661c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f662c0090b0 tx=0x7f662c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:25.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 msgr2=0x7f6638152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:25.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f662400c7f0 tx=0x7f662400cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 shutdown_connections 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6638151bd0 0x7f6638156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66380abf10 0x7f663814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f661c06a0e0 0x7f661c06c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 --2- 172.21.15.121:0/613656568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66380c1720 0x7f6638152260 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.973+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 >> 172.21.15.121:0/613656568 conn(0x7f663806bdc0 msgr2=0x7f66380c0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:25.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.974+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 shutdown_connections 2023-08-18T20:44:25.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:25.974+0000 7f663eedd700 1 -- 172.21.15.121:0/613656568 wait complete. 2023-08-18T20:44:25.975 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2023-08-18T20:44:25.990 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-18T20:44:25.991 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-18T20:44:25.991 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-18T20:44:25.991 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:44:25.992 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-18T20:44:25.992 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-18T20:44:25.992 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-18T20:44:25.992 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:44:25.992 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-18T20:44:25.993 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-18T20:44:25.993 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-18T20:44:25.993 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:44:25.993 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-18T20:44:25.994 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-18T20:44:25.994 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-18T20:44:25.994 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:44:26.003 INFO:tasks.ceph.mds.a:Stopped 2023-08-18T20:44:26.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-18T20:44:26.004 INFO:tasks.ceph.mds.c:Stopped 2023-08-18T20:44:26.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-18T20:44:26.006 INFO:tasks.ceph.mds.b:Stopped 2023-08-18T20:44:26.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-18T20:44:26.007 INFO:tasks.ceph.mds.d:Stopped 2023-08-18T20:44:26.007 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-18T20:44:26.045 INFO:tasks.ceph.mds.a:Started 2023-08-18T20:44:26.046 DEBUG:teuthology.parallel:result is None 2023-08-18T20:44:26.047 INFO:tasks.ceph.mds.c:Started 2023-08-18T20:44:26.047 DEBUG:teuthology.parallel:result is None 2023-08-18T20:44:26.049 INFO:tasks.ceph.mds.b:Started 2023-08-18T20:44:26.049 DEBUG:teuthology.parallel:result is None 2023-08-18T20:44:26.050 INFO:tasks.ceph.mds.d:Started 2023-08-18T20:44:26.050 DEBUG:teuthology.parallel:result is None 2023-08-18T20:44:26.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-18T20:44:26.127 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2023-08-18T20:44:26.127 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2023-08-18T20:44:26.137 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-08-18T20:44:26.137 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-08-18T20:44:26.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.182+0000 7f71d75f1700 1 Processor -- start 2023-08-18T20:44:26.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.182+0000 7f71d75f1700 1 -- start start 2023-08-18T20:44:26.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d75f1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d75f1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f71d0157c10 0x7f71d01580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d75f1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00c21f0 con 0x7f71d006a510 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d75f1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00c2ba0 con 0x7f71d0157c10 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d75f1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00c6300 con 0x7f71d00c1cf0 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d5b8e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f71d0157c10 0x7f71d01580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d538d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f71d006a510 0x7f71d0151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48254/0 (socket says 172.21.15.121:48254) 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d538d700 1 -- 172.21.15.121:0/3678216733 learned_addr learned my addr 172.21.15.121:0/3678216733 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d4b8c700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3678216733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 msgr2=0x7f71d00c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:26.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d5b8e700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d00c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3678216733 >> v1:172.21.15.121:6789/0 conn(0x7f71d006a510 legacy=0x7f71d0151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3678216733 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00c5b20 con 0x7f71d0157c10 2023-08-18T20:44:26.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.183+0000 7f71c7fff700 1 -- 172.21.15.121:0/3678216733 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195515650 0 0) 0x7f71d00c21f0 con 0x7f71d006a510 2023-08-18T20:44:26.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d5b8e700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d01580a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009840 tx=0x7f71cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853a1826bd2902d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:26.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71c7fff700 1 -- 172.21.15.121:0/3678216733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011830 con 0x7f71d0157c10 2023-08-18T20:44:26.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71c7fff700 1 -- 172.21.15.121:0/3678216733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc011990 con 0x7f71d0157c10 2023-08-18T20:44:26.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71c7fff700 1 -- 172.21.15.121:0/3678216733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011d20 con 0x7f71d0157c10 2023-08-18T20:44:26.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 -- 172.21.15.121:0/3678216733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 msgr2=0x7f71d01580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d01580a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009840 tx=0x7f71cc009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:26.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 -- 172.21.15.121:0/3678216733 shutdown_connections 2023-08-18T20:44:26.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d01580a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3678216733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d00c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 -- 172.21.15.121:0/3678216733 >> 172.21.15.121:0/3678216733 conn(0x7f71d00c6b10 msgr2=0x7f71d00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 -- 172.21.15.121:0/3678216733 shutdown_connections 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.184+0000 7f71d75f1700 1 -- 172.21.15.121:0/3678216733 wait complete. 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 Processor -- start 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 -- start start 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d006a510 0x7f71d014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d014e250 con 0x7f71d0157c10 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d014eaf0 con 0x7f71d006a510 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d75f1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d014f4c0 con 0x7f71d00c1cf0 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d5b8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d5b8e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41682/0 (socket says 172.21.15.121:41682) 2023-08-18T20:44:26.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.186+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3042022564 learned_addr learned my addr 172.21.15.121:0/3042022564 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d4b8c700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d538d700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d006a510 0x7f71d014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 msgr2=0x7f71d014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d014f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d006a510 msgr2=0x7f71d014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d006a510 0x7f71d014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 -- 172.21.15.121:0/3042022564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0094a0 con 0x7f71d0157c10 2023-08-18T20:44:26.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d5b8e700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f71d00c4690 tx=0x7f71cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0038a0 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc01f070 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d006df60 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc003c60 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.187+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d014e780 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.188+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d014e940 con 0x7f71d0157c10 2023-08-18T20:44:26.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.188+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71cc01a430 con 0x7f71d0157c10 2023-08-18T20:44:26.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.189+0000 7f71c5ffb700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 0x7f71b406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:26.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.189+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f71cc021070 con 0x7f71d0157c10 2023-08-18T20:44:26.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.189+0000 7f71d538d700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 0x7f71b406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:26.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.189+0000 7f71d538d700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 0x7f71b406c5d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f71c80012e0 tx=0x7f71c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:26.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.193+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f71cc055520 con 0x7f71d0157c10 2023-08-18T20:44:26.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.399+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f71d0074730 con 0x7f71d0157c10 2023-08-18T20:44:26.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.978+0000 7f71c5ffb700 1 -- 172.21.15.121:0/3042022564 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f71cc02b080 con 0x7f71d0157c10 2023-08-18T20:44:26.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 msgr2=0x7f71b406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 0x7f71b406c5d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f71c80012e0 tx=0x7f71c8009040 comp rx=0 tx=0).stop 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 msgr2=0x7f71d00aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f71d00c4690 tx=0x7f71cc004750 comp rx=0 tx=0).stop 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 shutdown_connections 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f71b406a110 0x7f71b406c5d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71d0157c10 0x7f71d00aa4d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d006a510 0x7f71d014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 --2- 172.21.15.121:0/3042022564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d00c1cf0 0x7f71d014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:26.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 >> 172.21.15.121:0/3042022564 conn(0x7f71d00c6b10 msgr2=0x7f71d0151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:26.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 shutdown_connections 2023-08-18T20:44:26.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:26.981+0000 7f71d75f1700 1 -- 172.21.15.121:0/3042022564 wait complete. 2023-08-18T20:44:26.982 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2023-08-18T20:44:26.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-18T20:44:27.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.115+0000 7f1a2f835700 1 Processor -- start 2023-08-18T20:44:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 -- start start 2023-08-18T20:44:27.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a280a6290 0x7f1a280c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a280c1b10 0x7f1a280c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280c4f40 con 0x7f1a280c0c50 2023-08-18T20:44:27.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280c5e50 con 0x7f1a280c1b10 2023-08-18T20:44:27.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.116+0000 7f1a2f835700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280c6120 con 0x7f1a280a6290 2023-08-18T20:44:27.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a280c1b10 0x7f1a280c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2d5d1700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a280c0c50 0x7f1a2806a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48268/0 (socket says 172.21.15.121:48268) 2023-08-18T20:44:27.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2d5d1700 1 -- 172.21.15.121:0/1028888030 learned_addr learned my addr 172.21.15.121:0/1028888030 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:27.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 -- 172.21.15.121:0/1028888030 >> v2:172.21.15.122:3300/0 conn(0x7f1a280a6290 msgr2=0x7f1a280c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:27.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2cdd0700 1 --2- 172.21.15.121:0/1028888030 >> v2:172.21.15.122:3300/0 conn(0x7f1a280a6290 0x7f1a280c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 --2- 172.21.15.121:0/1028888030 >> v2:172.21.15.122:3300/0 conn(0x7f1a280a6290 0x7f1a280c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 -- 172.21.15.121:0/1028888030 >> v1:172.21.15.121:6789/0 conn(0x7f1a280c0c50 legacy=0x7f1a2806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a1ffff700 1 -- 172.21.15.121:0/1028888030 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491064391 0 0) 0x7f1a280c4f40 con 0x7f1a280c0c50 2023-08-18T20:44:27.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 -- 172.21.15.121:0/1028888030 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a281551f0 con 0x7f1a280c1b10 2023-08-18T20:44:27.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a2ddd2700 1 --2- 172.21.15.121:0/1028888030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280c1b10 0x7f1a280c5910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c45c0 tx=0x7f1a2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b672346b2fd71 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a1ffff700 1 -- 172.21.15.121:0/1028888030 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000e070 con 0x7f1a280c1b10 2023-08-18T20:44:27.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a1ffff700 1 -- 172.21.15.121:0/1028888030 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000bbd0 con 0x7f1a280c1b10 2023-08-18T20:44:27.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.117+0000 7f1a1ffff700 1 -- 172.21.15.121:0/1028888030 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20012430 con 0x7f1a280c1b10 2023-08-18T20:44:27.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 -- 172.21.15.121:0/1028888030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280c1b10 msgr2=0x7f1a280c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1028888030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280c1b10 0x7f1a280c5910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c45c0 tx=0x7f1a2000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:27.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 -- 172.21.15.121:0/1028888030 shutdown_connections 2023-08-18T20:44:27.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1028888030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280c1b10 0x7f1a280c5910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1028888030 >> v2:172.21.15.122:3300/0 conn(0x7f1a280a6290 0x7f1a280c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 -- 172.21.15.121:0/1028888030 >> 172.21.15.121:0/1028888030 conn(0x7f1a280c6b10 msgr2=0x7f1a280c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 -- 172.21.15.121:0/1028888030 shutdown_connections 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.118+0000 7f1a2f835700 1 -- 172.21.15.121:0/1028888030 wait complete. 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.119+0000 7f1a2f835700 1 Processor -- start 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.119+0000 7f1a2f835700 1 -- start start 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a280c0c50 0x7f1a28150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 0x7f1a28150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281564f0 con 0x7f1a280a6290 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28072550 con 0x7f1a280c1b10 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28072830 con 0x7f1a280c0c50 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41692/0 (socket says 172.21.15.121:41692) 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 -- 172.21.15.121:0/1883624661 learned_addr learned my addr 172.21.15.121:0/1883624661 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:27.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2cdd0700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a280c0c50 0x7f1a28150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2ddd2700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 0x7f1a28150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 -- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a280c0c50 msgr2=0x7f1a28150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a280c0c50 0x7f1a28150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 -- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 msgr2=0x7f1a28150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 0x7f1a28150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 -- 172.21.15.121:0/1883624661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009a70 con 0x7f1a280a6290 2023-08-18T20:44:27.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2ddd2700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 0x7f1a28150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2d5d1700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1a180011e0 tx=0x7f1a1800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18004c80 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18004e00 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007310 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.120+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a281ed250 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.121+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a28150ed0 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.121+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a28154e70 con 0x7f1a280a6290 2023-08-18T20:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.122+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a18007470 con 0x7f1a280a6290 2023-08-18T20:44:27.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.122+0000 7f1a1dffb700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.122+0000 7f1a2cdd0700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.122+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1a18087f50 con 0x7f1a280a6290 2023-08-18T20:44:27.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.122+0000 7f1a2cdd0700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a28151780 tx=0x7f1a24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.126+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1a18053990 con 0x7f1a280a6290 2023-08-18T20:44:27.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.394+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1a28074730 con 0x7f1a280a6290 2023-08-18T20:44:27.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.395+0000 7f1a1dffb700 1 -- 172.21.15.121:0/1883624661 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f1a18056fb0 con 0x7f1a280a6290 2023-08-18T20:44:27.394 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199ktYKlJRAAs3mdbvzBKm1gLPfu8TLwlg==", 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.395 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.396 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kqtgxMhAAdpQQEmGpyIJyUuUXtpzLow==", 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.398 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2023-08-18T20:44:27.398 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kW+0aLRAAud1uvjmNRpU23rxK9nkK3Q==", 2023-08-18T20:44:27.398 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.399 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kBXpoORAA10zaeB/8n2rpDXJwCxolLA==", 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.400 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDP199kr+27DhAAPoOB9TF8z4jkfi5FxHUlEw==", 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.401 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDS199kn0mkDxAAj5a4T282EkIifx69SShtMg==", 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.402 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV199kw+X/DhAAQ2yTAFT/Km+Ew2TPwuJLOQ==", 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.403 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2023-08-18T20:44:27.404 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY199keIxJDhAAnPMJ66EEeCVapCyfpeX8Cg==", 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.405 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe199kAK1DFBAAI9P5XM6ck/pDxTKY9p5MwQ==", 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDh199kJWQJFBAAoNVlAuCLrwWSyyrc40GklQ==", 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2023-08-18T20:44:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDk199k9nbEExAA+21djSBfGKMzVRbn3fofkg==", 2023-08-18T20:44:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2023-08-18T20:44:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDn199kreETExAAuxx2sXu016kvAc8Mj1dV8A==", 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ==", 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2023-08-18T20:44:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A==", 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2023-08-18T20:44:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kAD3xBxAAddKwPSoc28i6a0+nXOE8MQ==", 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mds", 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199k7IrsBBAArn+OXWlGo+B+Grrgj+QH6g==", 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mds" 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mgr", 2023-08-18T20:44:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199k55XsBBAAjiZAiALOVs+eu24V9u/68A==", 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-osd", 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199kVJ3sBBAAKhYzBCZmo4RGrh42dZuApA==", 2023-08-18T20:44:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-osd" 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd", 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199kuaTsBBAARvQrylwHYSq1NnWnXFhKbQ==", 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199kD6zsBBAAtEXB+WfmrMNt2Ry0/GzOKQ==", 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rgw", 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDt199kerPsBBAAqfl1NeVQLsGeV5VT4zNd3w==", 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-18T20:44:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199k071CIhAA4ietCYXB23iN50L9O0VEAw==", 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2023-08-18T20:44:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199k4X4vHRAA02Ik8CbuInP8RM5T3Z9qqw==", 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:44:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2023-08-18T20:44:27.422 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-08-18T20:44:27.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 msgr2=0x7f1a0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a28151780 tx=0x7f1a24008040 comp rx=0 tx=0).stop 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 msgr2=0x7f1a281eca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1a180011e0 tx=0x7f1a1800cae0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 shutdown_connections 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a280c1b10 0x7f1a28150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a280a6290 0x7f1a281eca10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 --2- 172.21.15.121:0/1883624661 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a280c0c50 0x7f1a28150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 >> 172.21.15.121:0/1883624661 conn(0x7f1a280c6b10 msgr2=0x7f1a2806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:27.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 shutdown_connections 2023-08-18T20:44:27.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.397+0000 7f1a2f835700 1 -- 172.21.15.121:0/1883624661 wait complete. 2023-08-18T20:44:27.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-18T20:44:27.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.546+0000 7fae57388700 1 Processor -- start 2023-08-18T20:44:27.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 -- start start 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fae5006a7e0 0x7fae500c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 0x7fae500c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500c5e50 con 0x7fae5006a7e0 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500c4f40 con 0x7fae500a6290 2023-08-18T20:44:27.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.547+0000 7fae57388700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c6120 con 0x7fae500c0c50 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fae5006a7e0 0x7fae500c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fae5006a7e0 0x7fae500c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41702/0 (socket says 172.21.15.121:41702) 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 -- 172.21.15.121:0/523919975 learned_addr learned my addr 172.21.15.121:0/523919975 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 -- 172.21.15.121:0/523919975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 msgr2=0x7fae5006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae55124700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae55925700 1 --2- 172.21.15.121:0/523919975 >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 0x7fae500c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 -- 172.21.15.121:0/523919975 >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 msgr2=0x7fae500c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 --2- 172.21.15.121:0/523919975 >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 0x7fae500c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 -- 172.21.15.121:0/523919975 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae501551f0 con 0x7fae5006a7e0 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae55925700 1 --2- 172.21.15.121:0/523919975 >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 0x7fae500c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae54923700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae500c53d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae500708e0 tx=0x7fae4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fed1ad1ef7d3ba server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae47fff700 1 -- 172.21.15.121:0/523919975 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00b870 con 0x7fae5006a7e0 2023-08-18T20:44:27.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae47fff700 1 -- 172.21.15.121:0/523919975 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00b9d0 con 0x7fae5006a7e0 2023-08-18T20:44:27.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.548+0000 7fae47fff700 1 -- 172.21.15.121:0/523919975 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00bd60 con 0x7fae5006a7e0 2023-08-18T20:44:27.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 -- 172.21.15.121:0/523919975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 msgr2=0x7fae500c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae500c53d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae500708e0 tx=0x7fae4c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 -- 172.21.15.121:0/523919975 shutdown_connections 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 --2- 172.21.15.121:0/523919975 >> v2:172.21.15.122:3300/0 conn(0x7fae500a6290 0x7fae500c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 --2- 172.21.15.121:0/523919975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae500c53d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 -- 172.21.15.121:0/523919975 >> 172.21.15.121:0/523919975 conn(0x7fae500c6b10 msgr2=0x7fae500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 -- 172.21.15.121:0/523919975 shutdown_connections 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.549+0000 7fae57388700 1 -- 172.21.15.121:0/523919975 wait complete. 2023-08-18T20:44:27.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.550+0000 7fae57388700 1 Processor -- start 2023-08-18T20:44:27.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.550+0000 7fae57388700 1 -- start start 2023-08-18T20:44:27.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 0x7fae5014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50158a10 con 0x7fae5006a7e0 2023-08-18T20:44:27.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae501ea590 con 0x7fae500a6290 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae501eaac0 con 0x7fae500c0c50 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41706/0 (socket says 172.21.15.121:41706) 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 -- 172.21.15.121:0/4157129438 learned_addr learned my addr 172.21.15.121:0/4157129438 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55925700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae54923700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 0x7fae5014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 -- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 msgr2=0x7fae5014c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5014c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 -- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 msgr2=0x7fae5014be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 0x7fae5014be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 -- 172.21.15.121:0/4157129438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009550 con 0x7fae5006a7e0 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae54923700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 0x7fae5014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae55124700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c820 tx=0x7fae4000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40011800 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae40011960 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50156090 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.551+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40011cf0 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.552+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae50156330 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.553+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae500c46e0 con 0x7fae5006a7e0 2023-08-18T20:44:27.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.553+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae40018360 con 0x7fae5006a7e0 2023-08-18T20:44:27.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.553+0000 7fae45ffb700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 0x7fae3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.553+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae40088040 con 0x7fae5006a7e0 2023-08-18T20:44:27.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.553+0000 7fae54923700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 0x7fae3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.554+0000 7fae54923700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 0x7fae3406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000c00 tx=0x7fae4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.558+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fae40053b10 con 0x7fae5006a7e0 2023-08-18T20:44:27.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.826+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fae501520d0 con 0x7fae5006a7e0 2023-08-18T20:44:27.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.829+0000 7fae45ffb700 1 -- 172.21.15.121:0/4157129438 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fae40057130 con 0x7fae5006a7e0 2023-08-18T20:44:27.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 msgr2=0x7fae3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 0x7fae3406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000c00 tx=0x7fae4c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:27.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 msgr2=0x7fae50157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c820 tx=0x7fae4000cb30 comp rx=0 tx=0).stop 2023-08-18T20:44:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 shutdown_connections 2023-08-18T20:44:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae500c0c50 0x7fae5014c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fae3406a0e0 0x7fae3406c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5006a7e0 0x7fae50157710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 --2- 172.21.15.121:0/4157129438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae500a6290 0x7fae5014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 >> 172.21.15.121:0/4157129438 conn(0x7fae500c6b10 msgr2=0x7fae500a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:27.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 shutdown_connections 2023-08-18T20:44:27.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.831+0000 7fae57388700 1 -- 172.21.15.121:0/4157129438 wait complete. 2023-08-18T20:44:27.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-18T20:44:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.965+0000 7f873f30f700 1 Processor -- start 2023-08-18T20:44:27.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.965+0000 7f873f30f700 1 -- start start 2023-08-18T20:44:27.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873f30f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87380c0c50 0x7f873806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873f30f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f873806a7e0 0x7f87380c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873f30f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87380c4f40 con 0x7f87380a6290 2023-08-18T20:44:27.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873f30f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380c6120 con 0x7f87380c0c50 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873f30f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87381551f0 con 0x7f873806a7e0 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873d0ab700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87380c0c50 0x7f873806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873d8ac700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f87380a6290 0x7f8738071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48298/0 (socket says 172.21.15.121:48298) 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873d8ac700 1 -- 172.21.15.121:0/627365807 learned_addr learned my addr 172.21.15.121:0/627365807 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.966+0000 7f873c8aa700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f873806a7e0 0x7f87380c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873d0ab700 1 -- 172.21.15.121:0/627365807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f873806a7e0 msgr2=0x7f87380c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:27.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873d0ab700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f873806a7e0 0x7f87380c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873d0ab700 1 -- 172.21.15.121:0/627365807 >> v1:172.21.15.121:6789/0 conn(0x7f87380a6290 legacy=0x7f8738071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873d0ab700 1 -- 172.21.15.121:0/627365807 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380c63a0 con 0x7f87380c0c50 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f872ffff700 1 -- 172.21.15.121:0/627365807 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654719008 0 0) 0x7f87380c4f40 con 0x7f87380a6290 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873d0ab700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f873806a2a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5d3654dbbff3c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f872ffff700 1 -- 172.21.15.121:0/627365807 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f87380c0c50 2023-08-18T20:44:27.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f872ffff700 1 -- 172.21.15.121:0/627365807 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011990 con 0x7f87380c0c50 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f872ffff700 1 -- 172.21.15.121:0/627365807 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d20 con 0x7f87380c0c50 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 -- 172.21.15.121:0/627365807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 msgr2=0x7f873806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f873806a2a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 -- 172.21.15.121:0/627365807 shutdown_connections 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f873806a2a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 --2- 172.21.15.121:0/627365807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f873806a7e0 0x7f87380c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.967+0000 7f873f30f700 1 -- 172.21.15.121:0/627365807 >> 172.21.15.121:0/627365807 conn(0x7f87380c6b10 msgr2=0x7f87380c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:27.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.968+0000 7f873f30f700 1 -- 172.21.15.121:0/627365807 shutdown_connections 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.968+0000 7f873f30f700 1 -- 172.21.15.121:0/627365807 wait complete. 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 Processor -- start 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 -- start start 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873806a7e0 0x7f87380ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87380a6290 0x7f8738157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381e96a0 con 0x7f87380c0c50 2023-08-18T20:44:27.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381e9940 con 0x7f873806a7e0 2023-08-18T20:44:27.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873f30f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87381e9c20 con 0x7f87380a6290 2023-08-18T20:44:27.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873d8ac700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873d8ac700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41724/0 (socket says 172.21.15.121:41724) 2023-08-18T20:44:27.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.969+0000 7f873d8ac700 1 -- 172.21.15.121:0/2574296241 learned_addr learned my addr 172.21.15.121:0/2574296241 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873c8aa700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87380a6290 0x7f8738157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d0ab700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873806a7e0 0x7f87380ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 -- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87380a6290 msgr2=0x7f8738157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87380a6290 0x7f8738157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 -- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873806a7e0 msgr2=0x7f87380ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873806a7e0 0x7f87380ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 -- 172.21.15.121:0/2574296241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280094a0 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873d8ac700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8730002230 tx=0x7f873000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000ab70 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000acf0 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87381e9f00 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.970+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007310 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.971+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87381ea420 con 0x7f87380c0c50 2023-08-18T20:44:27.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.971+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87381ea120 con 0x7f87380c0c50 2023-08-18T20:44:27.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.972+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8730007470 con 0x7f87380c0c50 2023-08-18T20:44:27.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.972+0000 7f872dffb700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 0x7f871c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:27.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.972+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8730087fc0 con 0x7f87380c0c50 2023-08-18T20:44:27.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.972+0000 7f873d0ab700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 0x7f871c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:27.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.973+0000 7f873d0ab700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 0x7f871c06c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f8728008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:27.976+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f87300ba940 con 0x7f87380c0c50 2023-08-18T20:44:28.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.247+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8738074730 con 0x7f87380c0c50 2023-08-18T20:44:28.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.253+0000 7f872dffb700 1 -- 172.21.15.121:0/2574296241 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f87300180a0 con 0x7f87380c0c50 2023-08-18T20:44:28.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 msgr2=0x7f871c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 0x7f871c06c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f8728008030 comp rx=0 tx=0).stop 2023-08-18T20:44:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 msgr2=0x7f8738071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8730002230 tx=0x7f873000cf50 comp rx=0 tx=0).stop 2023-08-18T20:44:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 shutdown_connections 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f871c06a0e0 0x7f871c06c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87380c0c50 0x7f8738071c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873806a7e0 0x7f87380ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 --2- 172.21.15.121:0/2574296241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87380a6290 0x7f8738157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 >> 172.21.15.121:0/2574296241 conn(0x7f87380c6b10 msgr2=0x7f873806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:28.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 shutdown_connections 2023-08-18T20:44:28.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.255+0000 7f873f30f700 1 -- 172.21.15.121:0/2574296241 wait complete. 2023-08-18T20:44:28.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-18T20:44:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.388+0000 7f8d0c0a5700 1 Processor -- start 2023-08-18T20:44:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.388+0000 7f8d0c0a5700 1 -- start start 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0c0a5700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8d040c1cf0 0x7f8d040c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0c0a5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040c21f0 con 0x7f8d04157c10 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0c0a5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040c5b20 con 0x7f8d0406a510 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0c0a5700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d040c2ba0 con 0x7f8d040c1cf0 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0a642700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8d04157c10 0x7f8d041580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48318/0 (socket says 172.21.15.121:48318) 2023-08-18T20:44:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d0a642700 1 -- 172.21.15.121:0/1332122332 learned_addr learned my addr 172.21.15.121:0/1332122332 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d09640700 1 --2- 172.21.15.121:0/1332122332 >> v2:172.21.15.122:3300/0 conn(0x7f8d040c1cf0 0x7f8d040c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.389+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640646433 0 0) 0x7f8d040c21f0 con 0x7f8d04157c10 2023-08-18T20:44:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf00035b0 con 0x7f8d04157c10 2023-08-18T20:44:28.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242394218 0 0) 0x7f8cf00035b0 con 0x7f8d04157c10 2023-08-18T20:44:28.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 >> v2:172.21.15.122:3300/0 conn(0x7f8d040c1cf0 msgr2=0x7f8d040c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:28.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 --2- 172.21.15.121:0/1332122332 >> v2:172.21.15.122:3300/0 conn(0x7f8d040c1cf0 0x7f8d040c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 >> v1:172.21.15.122:6789/0 conn(0x7f8d0406a510 legacy=0x7f8d04151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040c6510 con 0x7f8d04157c10 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f8cfc0019f0 con 0x7f8d04157c10 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 >> v1:172.21.15.121:6789/0 conn(0x7f8d04157c10 legacy=0x7f8d041580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8cf0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf0004850 0x7f8cf0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cf0005280 0x7f8cf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf000c1b0 con 0x7f8cf0003a70 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf000c320 con 0x7f8cf0004850 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf000c4e0 con 0x7f8cf0005280 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8cf0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09640700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf0004850 0x7f8cf0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d0a642700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cf0005280 0x7f8cf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 -- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cf0005280 msgr2=0x7f8cf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cf0005280 0x7f8cf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 -- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf0004850 msgr2=0x7f8cf0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf0004850 0x7f8cf0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 -- 172.21.15.121:0/1332122332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00035b0 con 0x7f8cf0003a70 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d0a642700 1 -- 172.21.15.121:0/1332122332 reap_dead start 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d09e41700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8cf0003e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40017c0 tx=0x7f8cf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88bfe8f3bbe7298 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.390+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40052d0 con 0x7f8cf0003a70 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4005450 con 0x7f8cf0003a70 2023-08-18T20:44:28.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d08e3f700 1 -- 172.21.15.121:0/1332122332 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40038c0 con 0x7f8cf0003a70 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 msgr2=0x7f8cf0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8cf0003e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40017c0 tx=0x7f8cf0005880 comp rx=0 tx=0).stop 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/1332122332 shutdown_connections 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/1332122332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8cf0003e90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/1332122332 >> 172.21.15.121:0/1332122332 conn(0x7f8d040c6b10 msgr2=0x7f8d040c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/1332122332 shutdown_connections 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.391+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/1332122332 wait complete. 2023-08-18T20:44:28.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.392+0000 7f8d0c0a5700 1 Processor -- start 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.392+0000 7f8d0c0a5700 1 -- start start 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d0414c8a0 0x7f8d040a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d0414cd20 0x7f8d040aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d041ece10 con 0x7f8cf0003a70 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0414af30 con 0x7f8d0414c8a0 2023-08-18T20:44:28.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0c0a5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d041ed020 con 0x7f8d0414cd20 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41744/0 (socket says 172.21.15.121:41744) 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 -- 172.21.15.121:0/3307080132 learned_addr learned my addr 172.21.15.121:0/3307080132 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d0a642700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d0414cd20 0x7f8d040aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09640700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d0414c8a0 0x7f8d040a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 -- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d0414cd20 msgr2=0x7f8d040aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d0414cd20 0x7f8d040aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 -- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d0414c8a0 msgr2=0x7f8d040a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d0414c8a0 0x7f8d040a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 -- 172.21.15.121:0/3307080132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d041ed300 con 0x7f8cf0003a70 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.393+0000 7f8d09e41700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4000c00 tx=0x7f8cf4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.394+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4001290 con 0x7f8cf0003a70 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.394+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4006e70 con 0x7f8cf0003a70 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.394+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d041ed5e0 con 0x7f8cf0003a70 2023-08-18T20:44:28.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.394+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4007470 con 0x7f8cf0003a70 2023-08-18T20:44:28.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.394+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d040a7ab0 con 0x7f8cf0003a70 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.395+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d041edc30 con 0x7f8cf0003a70 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.395+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8cf40075d0 con 0x7f8cf0003a70 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.395+0000 7f8cfa7fc700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 0x7f8ce806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.395+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8cf4088b20 con 0x7f8cf0003a70 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.395+0000 7f8d09640700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 0x7f8ce806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.396+0000 7f8d09640700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 0x7f8ce806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009b40 tx=0x7f8d00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.400+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8cf40545f0 con 0x7f8cf0003a70 2023-08-18T20:44:28.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.671+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8d040a7c40 con 0x7f8cf0003a70 2023-08-18T20:44:28.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.677+0000 7f8cfa7fc700 1 -- 172.21.15.121:0/3307080132 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8cf402b0a0 con 0x7f8cf0003a70 2023-08-18T20:44:28.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 msgr2=0x7f8ce806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 0x7f8ce806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009b40 tx=0x7f8d00008040 comp rx=0 tx=0).stop 2023-08-18T20:44:28.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 msgr2=0x7f8d0414a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4000c00 tx=0x7f8cf4001120 comp rx=0 tx=0).stop 2023-08-18T20:44:28.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 shutdown_connections 2023-08-18T20:44:28.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d0414cd20 0x7f8d040aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ce806a0e0 0x7f8ce806c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cf0003a70 0x7f8d0414a9f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 --2- 172.21.15.121:0/3307080132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d0414c8a0 0x7f8d040a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 >> 172.21.15.121:0/3307080132 conn(0x7f8d040c6b10 msgr2=0x7f8d04157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:28.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 shutdown_connections 2023-08-18T20:44:28.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.679+0000 7f8d0c0a5700 1 -- 172.21.15.121:0/3307080132 wait complete. 2023-08-18T20:44:28.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-18T20:44:28.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.813+0000 7f24d156c700 1 Processor -- start 2023-08-18T20:44:28.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.813+0000 7f24d156c700 1 -- start start 2023-08-18T20:44:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.813+0000 7f24d156c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24cc151b10 0x7f24cc0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.813+0000 7f24d156c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c7ca0 0x7f24cc1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24d156c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc0ca4a0 con 0x7f24cc0c4c60 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24d156c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc06c0f0 con 0x7f24cc151b10 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24d156c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc158540 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24cc151b10 0x7f24cc0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24cc151b10 0x7f24cc0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41752/0 (socket says 172.21.15.121:41752) 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 -- 172.21.15.121:0/408608592 learned_addr learned my addr 172.21.15.121:0/408608592 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24ca7fc700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c7ca0 0x7f24cc1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 -- 172.21.15.121:0/408608592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c7ca0 msgr2=0x7f24cc1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c7ca0 0x7f24cc1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 -- 172.21.15.121:0/408608592 >> v1:172.21.15.122:6789/0 conn(0x7f24cc0c4c60 legacy=0x7f24cc154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 -- 172.21.15.121:0/408608592 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc158820 con 0x7f24cc151b10 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24caffd700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc151b10 0x7f24cc0c4720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0098f0 tx=0x7f24bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb0b488b778b6df server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24c9ffb700 1 -- 172.21.15.121:0/408608592 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc004230 con 0x7f24cc151b10 2023-08-18T20:44:28.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24c9ffb700 1 -- 172.21.15.121:0/408608592 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc004390 con 0x7f24cc151b10 2023-08-18T20:44:28.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.814+0000 7f24c9ffb700 1 -- 172.21.15.121:0/408608592 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0036a0 con 0x7f24cc151b10 2023-08-18T20:44:28.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 -- 172.21.15.121:0/408608592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc151b10 msgr2=0x7f24cc0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc151b10 0x7f24cc0c4720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0098f0 tx=0x7f24bc009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:28.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 -- 172.21.15.121:0/408608592 shutdown_connections 2023-08-18T20:44:28.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc151b10 0x7f24cc0c4720 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 --2- 172.21.15.121:0/408608592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c7ca0 0x7f24cc1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 -- 172.21.15.121:0/408608592 >> 172.21.15.121:0/408608592 conn(0x7f24cc071bb0 msgr2=0x7f24cc071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:28.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 -- 172.21.15.121:0/408608592 shutdown_connections 2023-08-18T20:44:28.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.815+0000 7f24d156c700 1 -- 172.21.15.121:0/408608592 wait complete. 2023-08-18T20:44:28.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.816+0000 7f24d156c700 1 Processor -- start 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.816+0000 7f24d156c700 1 -- start start 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c4c60 0x7f24cc1ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24cc151b10 0x7f24cc1eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0c97e0 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0aa7f0 con 0x7f24cc151b10 2023-08-18T20:44:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24d156c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc1eabe0 con 0x7f24cc0c4c60 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41758/0 (socket says 172.21.15.121:41758) 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 -- 172.21.15.121:0/2788739957 learned_addr learned my addr 172.21.15.121:0/2788739957 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24caffd700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c4c60 0x7f24cc1ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24cb7fe700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24cc151b10 0x7f24cc1eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 -- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c4c60 msgr2=0x7f24cc1ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c4c60 0x7f24cc1ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 -- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24cc151b10 msgr2=0x7f24cc1eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24cc151b10 0x7f24cc1eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 -- 172.21.15.121:0/2788739957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009550 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24ca7fc700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c7f0 tx=0x7f24c000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.817+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004220 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.818+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0004380 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.818+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0ac5c0 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.818+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00036a0 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.818+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc0aad20 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.819+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc0ca910 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.819+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f24c0003800 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.819+0000 7f24b37fe700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 0x7f24b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.819+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f24c0087c50 con 0x7f24cc0c7ca0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.819+0000 7f24caffd700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 0x7f24b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.820+0000 7f24caffd700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 0x7f24b806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009130 tx=0x7f24bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:28.824+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f24cc0ca910 con 0x7f24cc0c7ca0 2023-08-18T20:44:29.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.093+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f24cc0ca910 con 0x7f24cc0c7ca0 2023-08-18T20:44:29.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.098+0000 7f24b37fe700 1 -- 172.21.15.121:0/2788739957 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f24cc0ca910 con 0x7f24cc0c7ca0 2023-08-18T20:44:29.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 msgr2=0x7f24b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 0x7f24b806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009130 tx=0x7f24bc008030 comp rx=0 tx=0).stop 2023-08-18T20:44:29.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 msgr2=0x7f24cc156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c7f0 tx=0x7f24c000cb00 comp rx=0 tx=0).stop 2023-08-18T20:44:29.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 shutdown_connections 2023-08-18T20:44:29.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24cc151b10 0x7f24cc1eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24cc0c4c60 0x7f24cc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f24b806a0e0 0x7f24b806c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 --2- 172.21.15.121:0/2788739957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24cc0c7ca0 0x7f24cc156ba0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 >> 172.21.15.121:0/2788739957 conn(0x7f24cc071bb0 msgr2=0x7f24cc071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 shutdown_connections 2023-08-18T20:44:29.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.100+0000 7f24d156c700 1 -- 172.21.15.121:0/2788739957 wait complete. 2023-08-18T20:44:29.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-18T20:44:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.233+0000 7f4758bfb700 1 Processor -- start 2023-08-18T20:44:29.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.233+0000 7f4758bfb700 1 -- start start 2023-08-18T20:44:29.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f4758bfb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f47540c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f4758bfb700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47540c2260 con 0x7f475414e950 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f4758bfb700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754151d90 con 0x7f475414ed30 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f4758bfb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47540a6630 con 0x7f4754070950 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f475259c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f475414e950 0x7f47540c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48346/0 (socket says 172.21.15.121:48346) 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.234+0000 7f475259c700 1 -- 172.21.15.121:0/336838486 learned_addr learned my addr 172.21.15.121:0/336838486 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070482787 0 0) 0x7f47540c2260 con 0x7f475414e950 2023-08-18T20:44:29.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c0035b0 con 0x7f475414e950 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f47540c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348970200 0 0) 0x7f473c0035b0 con 0x7f475414e950 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 msgr2=0x7f47540c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f47540c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 >> v1:172.21.15.122:6789/0 conn(0x7f475414ed30 legacy=0x7f47540c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754152070 con 0x7f475414e950 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f4748001670 con 0x7f475414e950 2023-08-18T20:44:29.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 >> v1:172.21.15.121:6789/0 conn(0x7f475414e950 legacy=0x7f47540c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f473c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f473c004020 0x7f473c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f473c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540a6630 con 0x7f473c004d90 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c00bc00 con 0x7f473c004020 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c00bdc0 con 0x7f4754070950 2023-08-18T20:44:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f473c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f475259c700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f473c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4751d9b700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f473c004020 0x7f473c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 -- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 msgr2=0x7f473c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4754070950 0x7f473c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 -- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f473c004020 msgr2=0x7f473c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f473c004020 0x7f473c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 -- 172.21.15.121:0/336838486 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0035b0 con 0x7f473c004d90 2023-08-18T20:44:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4751d9b700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f473c004020 0x7f473c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.235+0000 7f4752d9d700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f473c005210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f474c009fc0 tx=0x7f473c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8609f02bd4f4a2f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ec30 con 0x7f473c004d90 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00f040 con 0x7f473c004d90 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f475159a700 1 -- 172.21.15.121:0/336838486 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c014480 con 0x7f473c004d90 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 -- 172.21.15.121:0/336838486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 msgr2=0x7f473c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 --2- 172.21.15.121:0/336838486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f473c005210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f474c009fc0 tx=0x7f473c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4752d9d700 1 -- 172.21.15.121:0/336838486 reap_dead start 2023-08-18T20:44:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 -- 172.21.15.121:0/336838486 shutdown_connections 2023-08-18T20:44:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 -- 172.21.15.121:0/336838486 >> 172.21.15.121:0/336838486 conn(0x7f47540c6b10 msgr2=0x7f47540c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 -- 172.21.15.121:0/336838486 shutdown_connections 2023-08-18T20:44:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.236+0000 7f4758bfb700 1 -- 172.21.15.121:0/336838486 wait complete. 2023-08-18T20:44:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.238+0000 7f4758bfb700 1 Processor -- start 2023-08-18T20:44:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.238+0000 7f4758bfb700 1 -- start start 2023-08-18T20:44:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4754145670 0x7f47540a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 0x7f4754144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541e6d70 con 0x7f473c004d90 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541da680 con 0x7f4754145670 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4758bfb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47540c19a0 con 0x7f47540a77d0 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41778/0 (socket says 172.21.15.121:41778) 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 -- 172.21.15.121:0/2021360416 learned_addr learned my addr 172.21.15.121:0/2021360416 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:29.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4752d9d700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 0x7f4754144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4751d9b700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4754145670 0x7f47540a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 -- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 msgr2=0x7f4754144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 0x7f4754144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 -- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4754145670 msgr2=0x7f47540a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4754145670 0x7f47540a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 -- 172.21.15.121:0/2021360416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47541da890 con 0x7f473c004d90 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4752d9d700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 0x7f4754144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f475259c700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4748004aa0 tx=0x7f4748004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.239+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748011ad0 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.240+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4748011c50 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.240+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47541e63d0 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.240+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748014370 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.240+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541e6990 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.241+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475406eb60 con 0x7f473c004d90 2023-08-18T20:44:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.241+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47480144d0 con 0x7f473c004d90 2023-08-18T20:44:29.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.241+0000 7f4742ffd700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 0x7f473406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.241+0000 7f4751d9b700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 0x7f473406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.241+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f474808a190 con 0x7f473c004d90 2023-08-18T20:44:29.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.242+0000 7f4751d9b700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 0x7f473406c5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f475414c7f0 tx=0x7f4744009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.246+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4748055c60 con 0x7f473c004d90 2023-08-18T20:44:29.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.515+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f47541e6eb0 con 0x7f473c004d90 2023-08-18T20:44:29.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.520+0000 7f4742ffd700 1 -- 172.21.15.121:0/2021360416 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f47541e6eb0 con 0x7f473c004d90 2023-08-18T20:44:29.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.522+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 msgr2=0x7f473406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.522+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 0x7f473406c5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f475414c7f0 tx=0x7f4744009040 comp rx=0 tx=0).stop 2023-08-18T20:44:29.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.522+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 msgr2=0x7f47541da140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.522+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4748004aa0 tx=0x7f4748004e60 comp rx=0 tx=0).stop 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 shutdown_connections 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47540a77d0 0x7f4754144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f473406a110 0x7f473406c5d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f473c004d90 0x7f47541da140 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 --2- 172.21.15.121:0/2021360416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4754145670 0x7f47540a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 >> 172.21.15.121:0/2021360416 conn(0x7f47540c6b10 msgr2=0x7f47541501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:29.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 shutdown_connections 2023-08-18T20:44:29.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.523+0000 7f4758bfb700 1 -- 172.21.15.121:0/2021360416 wait complete. 2023-08-18T20:44:29.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-18T20:44:29.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.656+0000 7f74b4162700 1 Processor -- start 2023-08-18T20:44:29.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.656+0000 7f74b4162700 1 -- start start 2023-08-18T20:44:29.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b4162700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b4162700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b4162700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac06cc30 con 0x7f74ac0c1030 2023-08-18T20:44:29.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b4162700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0c0b80 con 0x7f74ac1518e0 2023-08-18T20:44:29.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b4162700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac155260 con 0x7f74ac0bf550 2023-08-18T20:44:29.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.657+0000 7f74b1efe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b1efe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:51622/0 (socket says 172.21.15.121:51622) 2023-08-18T20:44:29.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b1efe700 1 -- 172.21.15.121:0/4132244159 learned_addr learned my addr 172.21.15.121:0/4132244159 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:29.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:38198/0 (socket says 172.21.15.121:38198) 2023-08-18T20:44:29.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 -- 172.21.15.121:0/4132244159 >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 msgr2=0x7f74ac066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:29.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 --2- 172.21.15.121:0/4132244159 >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 -- 172.21.15.121:0/4132244159 >> v1:172.21.15.122:6789/0 conn(0x7f74ac0c1030 legacy=0x7f74ac06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 -- 172.21.15.121:0/4132244159 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac06ce80 con 0x7f74ac0bf550 2023-08-18T20:44:29.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b1efe700 1 --2- 172.21.15.121:0/4132244159 >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:29.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b26ff700 1 --2- 172.21.15.121:0/4132244159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009d90 tx=0x7f74a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99cc751a1540369 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b0efc700 1 -- 172.21.15.121:0/4132244159 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400e070 con 0x7f74ac0bf550 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b0efc700 1 -- 172.21.15.121:0/4132244159 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400bb20 con 0x7f74ac0bf550 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.658+0000 7f74b0efc700 1 -- 172.21.15.121:0/4132244159 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4012430 con 0x7f74ac0bf550 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 -- 172.21.15.121:0/4132244159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 msgr2=0x7f74ac0bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 --2- 172.21.15.121:0/4132244159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009d90 tx=0x7f74a400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 -- 172.21.15.121:0/4132244159 shutdown_connections 2023-08-18T20:44:29.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 --2- 172.21.15.121:0/4132244159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac0bf550 0x7f74ac0bf9c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 --2- 172.21.15.121:0/4132244159 >> v2:172.21.15.122:3300/0 conn(0x7f74ac1518e0 0x7f74ac066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 -- 172.21.15.121:0/4132244159 >> 172.21.15.121:0/4132244159 conn(0x7f74ac0c2ca0 msgr2=0x7f74ac0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 -- 172.21.15.121:0/4132244159 shutdown_connections 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.659+0000 7f74b4162700 1 -- 172.21.15.121:0/4132244159 wait complete. 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.660+0000 7f74b4162700 1 Processor -- start 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.660+0000 7f74b4162700 1 -- start start 2023-08-18T20:44:29.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ac0bf550 0x7f74ac1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac1518e0 0x7f74ac0a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac157e40 con 0x7f74ac0c1030 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0a93e0 con 0x7f74ac0bf550 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b4162700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac153d70 con 0x7f74ac1518e0 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b16fd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b16fd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41792/0 (socket says 172.21.15.121:41792) 2023-08-18T20:44:29.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b16fd700 1 -- 172.21.15.121:0/177114247 learned_addr learned my addr 172.21.15.121:0/177114247 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.661+0000 7f74b26ff700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac1518e0 0x7f74ac0a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b1efe700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ac0bf550 0x7f74ac1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 -- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac1518e0 msgr2=0x7f74ac0a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac1518e0 0x7f74ac0a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 -- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ac0bf550 msgr2=0x7f74ac1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ac0bf550 0x7f74ac1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 -- 172.21.15.121:0/177114247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c009550 con 0x7f74ac0c1030 2023-08-18T20:44:29.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b16fd700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c450 tx=0x7f74a800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80050d0 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8005250 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a4009a70 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80068b0 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.662+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac1e18c0 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.663+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac14c890 con 0x7f74ac0c1030 2023-08-18T20:44:29.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.663+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74a80036d0 con 0x7f74ac0c1030 2023-08-18T20:44:29.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.664+0000 7f74a27fc700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 0x7f749006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:29.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.664+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f74a8087280 con 0x7f74ac0c1030 2023-08-18T20:44:29.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.664+0000 7f74b1efe700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 0x7f749006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:29.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.664+0000 7f74b1efe700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 0x7f749006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f749c006d30 tx=0x7f749c0092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:29.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.668+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f74a8052d50 con 0x7f74ac0c1030 2023-08-18T20:44:29.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.936+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f74ac06e460 con 0x7f74ac0c1030 2023-08-18T20:44:29.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.942+0000 7f74a27fc700 1 -- 172.21.15.121:0/177114247 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f74a8056370 con 0x7f74ac0c1030 2023-08-18T20:44:29.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 msgr2=0x7f749006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 0x7f749006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f749c006d30 tx=0x7f749c0092c0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 msgr2=0x7f74ac0a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:29.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c450 tx=0x7f74a800c760 comp rx=0 tx=0).stop 2023-08-18T20:44:29.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 shutdown_connections 2023-08-18T20:44:29.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74ac1518e0 0x7f74ac0a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ac0bf550 0x7f74ac1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f749006a0e0 0x7f749006c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 --2- 172.21.15.121:0/177114247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74ac0c1030 0x7f74ac0a9800 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:29.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 >> 172.21.15.121:0/177114247 conn(0x7f74ac0c2ca0 msgr2=0x7f74ac0c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:29.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 shutdown_connections 2023-08-18T20:44:29.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:29.944+0000 7f74b4162700 1 -- 172.21.15.121:0/177114247 wait complete. 2023-08-18T20:44:29.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:30.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.077+0000 7f0685b85700 1 Processor -- start 2023-08-18T20:44:30.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.077+0000 7f0685b85700 1 -- start start 2023-08-18T20:44:30.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0685b85700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f068006f1e0 0x7f06800c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0685b85700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c78b0 0x7f0680158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0685b85700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0680157aa0 con 0x7f06800c5d60 2023-08-18T20:44:30.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0685b85700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800c5240 con 0x7f068006f1e0 2023-08-18T20:44:30.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0685b85700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0680155090 con 0x7f06800c78b0 2023-08-18T20:44:30.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f068006f1e0 0x7f06800c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f068006f1e0 0x7f06800c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41798/0 (socket says 172.21.15.121:41798) 2023-08-18T20:44:30.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 -- 172.21.15.121:0/2476901563 learned_addr learned my addr 172.21.15.121:0/2476901563 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:30.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f0677fff700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c78b0 0x7f0680158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 -- 172.21.15.121:0/2476901563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c78b0 msgr2=0x7f0680158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:30.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c78b0 0x7f0680158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 -- 172.21.15.121:0/2476901563 >> v1:172.21.15.122:6789/0 conn(0x7f06800c5d60 legacy=0x7f068006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 -- 172.21.15.121:0/2476901563 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680157d40 con 0x7f068006f1e0 2023-08-18T20:44:30.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067f7fe700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f068006f1e0 0x7f06800c7280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06700098f0 tx=0x7f0670009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55387cfa0a496c47 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067effd700 1 -- 172.21.15.121:0/2476901563 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670011830 con 0x7f068006f1e0 2023-08-18T20:44:30.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067effd700 1 -- 172.21.15.121:0/2476901563 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0670011990 con 0x7f068006f1e0 2023-08-18T20:44:30.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.078+0000 7f067effd700 1 -- 172.21.15.121:0/2476901563 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670011d20 con 0x7f068006f1e0 2023-08-18T20:44:30.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 -- 172.21.15.121:0/2476901563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f068006f1e0 msgr2=0x7f06800c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f068006f1e0 0x7f06800c7280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06700098f0 tx=0x7f0670009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:30.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 -- 172.21.15.121:0/2476901563 shutdown_connections 2023-08-18T20:44:30.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f068006f1e0 0x7f06800c7280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 --2- 172.21.15.121:0/2476901563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c78b0 0x7f0680158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 -- 172.21.15.121:0/2476901563 >> 172.21.15.121:0/2476901563 conn(0x7f06800a9a90 msgr2=0x7f06800a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 -- 172.21.15.121:0/2476901563 shutdown_connections 2023-08-18T20:44:30.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.079+0000 7f0685b85700 1 -- 172.21.15.121:0/2476901563 wait complete. 2023-08-18T20:44:30.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 Processor -- start 2023-08-18T20:44:30.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 -- start start 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f068006f1e0 0x7f06800ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c5d60 0x7f06800a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ab770 con 0x7f06800c78b0 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068014ee20 con 0x7f068006f1e0 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.081+0000 7f0685b85700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0680150e60 con 0x7f06800c5d60 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41808/0 (socket says 172.21.15.121:41808) 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 -- 172.21.15.121:0/96176672 learned_addr learned my addr 172.21.15.121:0/96176672 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f0677fff700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c5d60 0x7f06800a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067f7fe700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f068006f1e0 0x7f06800ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 -- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c5d60 msgr2=0x7f06800a8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c5d60 0x7f06800a8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 -- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f068006f1e0 msgr2=0x7f06800ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f068006f1e0 0x7f06800ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 -- 172.21.15.121:0/96176672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670009550 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067ffff700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f067800cc50 tx=0x7f067800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678003c00 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678003d60 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800aab0 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800aac20 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.082+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800a9200 con 0x7f06800c78b0 2023-08-18T20:44:30.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.083+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0680067d80 con 0x7f06800c78b0 2023-08-18T20:44:30.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.084+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f067800ac10 con 0x7f06800c78b0 2023-08-18T20:44:30.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.084+0000 7f067cff9700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 0x7f066006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.084+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0678088120 con 0x7f06800c78b0 2023-08-18T20:44:30.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.084+0000 7f067f7fe700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 0x7f066006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.084+0000 7f067f7fe700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 0x7f066006c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0670014040 tx=0x7f0670008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.088+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0678053bf0 con 0x7f06800c78b0 2023-08-18T20:44:30.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.279+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0680074730 con 0x7f06800c78b0 2023-08-18T20:44:30.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.280+0000 7f067cff9700 1 -- 172.21.15.121:0/96176672 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f0678057210 con 0x7f06800c78b0 2023-08-18T20:44:30.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:30.281 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":29,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:26.984383+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:30.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 msgr2=0x7f066006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 0x7f066006c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0670014040 tx=0x7f0670008030 comp rx=0 tx=0).stop 2023-08-18T20:44:30.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 msgr2=0x7f0680156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f067800cc50 tx=0x7f067800cf60 comp rx=0 tx=0).stop 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 shutdown_connections 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f066006a0e0 0x7f066006c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06800c78b0 0x7f0680156e20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f068006f1e0 0x7f06800ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 --2- 172.21.15.121:0/96176672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06800c5d60 0x7f06800a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 >> 172.21.15.121:0/96176672 conn(0x7f06800a9a90 msgr2=0x7f06800c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 shutdown_connections 2023-08-18T20:44:30.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.282+0000 7f0685b85700 1 -- 172.21.15.121:0/96176672 wait complete. 2023-08-18T20:44:30.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:30.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:30.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.419+0000 7f3ec7090700 1 Processor -- start 2023-08-18T20:44:30.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.419+0000 7f3ec7090700 1 -- start start 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ec7090700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ec014a8c0 0x7f3ec00c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ec7090700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0150d80 con 0x7f3ec00c37c0 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ec7090700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec00c10c0 con 0x7f3ec0070150 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ec7090700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec00c2510 con 0x7f3ec014a8c0 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ebffff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3ec00c37c0 0x7f3ec0151210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48396/0 (socket says 172.21.15.121:48396) 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ebffff700 1 -- 172.21.15.121:0/3354518475 learned_addr learned my addr 172.21.15.121:0/3354518475 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.420+0000 7f3ec4e2c700 1 --2- 172.21.15.121:0/3354518475 >> v2:172.21.15.122:3300/0 conn(0x7f3ec014a8c0 0x7f3ec00c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670032687 0 0) 0x7f3ec0150d80 con 0x7f3ec00c37c0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb00035b0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875277843 0 0) 0x7f3eb00035b0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ec4e2c700 1 -- 172.21.15.121:0/3354518475 >> v1:172.21.15.122:6789/0 conn(0x7f3ec0070150 legacy=0x7f3ec006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ec4e2c700 1 -- 172.21.15.121:0/3354518475 >> v1:172.21.15.121:6789/0 conn(0x7f3ec00c37c0 legacy=0x7f3ec0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ec4e2c700 1 -- 172.21.15.121:0/3354518475 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00c2a90 con 0x7f3ec014a8c0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ec4e2c700 1 --2- 172.21.15.121:0/3354518475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec014a8c0 0x7f3ec00c0b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009840 tx=0x7f3eb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=881e0509354366c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0017f0 con 0x7f3ec014a8c0 2023-08-18T20:44:30.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb4004030 con 0x7f3ec014a8c0 2023-08-18T20:44:30.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.421+0000 7f3ebf7fe700 1 -- 172.21.15.121:0/3354518475 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40043a0 con 0x7f3ec014a8c0 2023-08-18T20:44:30.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 -- 172.21.15.121:0/3354518475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec014a8c0 msgr2=0x7f3ec00c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3354518475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec014a8c0 0x7f3ec00c0b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009840 tx=0x7f3eb4009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:30.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 -- 172.21.15.121:0/3354518475 shutdown_connections 2023-08-18T20:44:30.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3354518475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec014a8c0 0x7f3ec00c0b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 -- 172.21.15.121:0/3354518475 >> 172.21.15.121:0/3354518475 conn(0x7f3ec00c2ca0 msgr2=0x7f3ec00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 -- 172.21.15.121:0/3354518475 shutdown_connections 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.422+0000 7f3ec7090700 1 -- 172.21.15.121:0/3354518475 wait complete. 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.423+0000 7f3ec7090700 1 Processor -- start 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.423+0000 7f3ec7090700 1 -- start start 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0070150 0x7f3ec01e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ec014a8c0 0x7f3ec0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0153ef0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01532e0 con 0x7f3ec0070150 2023-08-18T20:44:30.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01535c0 con 0x7f3ec014a8c0 2023-08-18T20:44:30.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41820/0 (socket says 172.21.15.121:41820) 2023-08-18T20:44:30.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 -- 172.21.15.121:0/3340439372 learned_addr learned my addr 172.21.15.121:0/3340439372 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec4e2c700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0070150 0x7f3ec01e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec562d700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ec014a8c0 0x7f3ec0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 -- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ec014a8c0 msgr2=0x7f3ec0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ec014a8c0 0x7f3ec0154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 -- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0070150 msgr2=0x7f3ec01e6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0070150 0x7f3ec01e6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 -- 172.21.15.121:0/3340439372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40094a0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebffff700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c500 tx=0x7f3eac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0074e0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac007640 con 0x7f3ec00c37c0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec01538a0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.424+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac005a50 con 0x7f3ec00c37c0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.425+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec0154c70 con 0x7f3ec00c37c0 2023-08-18T20:44:30.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.425+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec0154060 con 0x7f3ec00c37c0 2023-08-18T20:44:30.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.426+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3eac005bb0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.426+0000 7f3ebd7fa700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 0x7f3ea406e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.427+0000 7f3ec4e2c700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 0x7f3ea406e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.427+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3eac0874b0 con 0x7f3ec00c37c0 2023-08-18T20:44:30.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.427+0000 7f3ec4e2c700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 0x7f3ea406e7e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40090b0 tx=0x7f3eb4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.431+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3eac053070 con 0x7f3ec00c37c0 2023-08-18T20:44:30.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.620+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ec0074730 con 0x7f3ec00c37c0 2023-08-18T20:44:30.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.621+0000 7f3ebd7fa700 1 -- 172.21.15.121:0/3340439372 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3eac005e60 con 0x7f3ec00c37c0 2023-08-18T20:44:30.621 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 msgr2=0x7f3ea406e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 0x7f3ea406e7e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40090b0 tx=0x7f3eb4008030 comp rx=0 tx=0).stop 2023-08-18T20:44:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 msgr2=0x7f3ec0152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c500 tx=0x7f3eac00c810 comp rx=0 tx=0).stop 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 shutdown_connections 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ec014a8c0 0x7f3ec0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0070150 0x7f3ec01e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3ea406c320 0x7f3ea406e7e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 --2- 172.21.15.121:0/3340439372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ec00c37c0 0x7f3ec0152c70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 >> 172.21.15.121:0/3340439372 conn(0x7f3ec00c2ca0 msgr2=0x7f3ec01502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 shutdown_connections 2023-08-18T20:44:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.623+0000 7f3ec7090700 1 -- 172.21.15.121:0/3340439372 wait complete. 2023-08-18T20:44:30.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:30.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.758+0000 7fa9a486c700 1 Processor -- start 2023-08-18T20:44:30.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.758+0000 7fa9a486c700 1 -- start start 2023-08-18T20:44:30.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa9a486c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa9a014ed30 0x7fa9a00c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa9a486c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9a0070950 0x7fa9a00c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa9a486c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00c2260 con 0x7fa9a014e950 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa9a486c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00a6630 con 0x7fa9a014ed30 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa9a486c700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a0151d90 con 0x7fa9a0070950 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa99dd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa9a014ed30 0x7fa9a00c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa99e59c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa9a014e950 0x7fa9a00c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48408/0 (socket says 172.21.15.121:48408) 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa99dd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa9a014ed30 0x7fa9a00c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41828/0 (socket says 172.21.15.121:41828) 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa99e59c700 1 -- 172.21.15.121:0/3879241655 learned_addr learned my addr 172.21.15.121:0/3879241655 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.759+0000 7fa99ed9d700 1 --2- 172.21.15.121:0/3879241655 >> v2:172.21.15.122:3300/0 conn(0x7fa9a0070950 0x7fa9a00c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3879241655 >> v2:172.21.15.122:3300/0 conn(0x7fa9a0070950 msgr2=0x7fa9a00c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99dd9b700 1 --2- 172.21.15.121:0/3879241655 >> v2:172.21.15.122:3300/0 conn(0x7fa9a0070950 0x7fa9a00c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3879241655 >> v1:172.21.15.121:6789/0 conn(0x7fa9a014e950 legacy=0x7fa9a00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3879241655 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0152070 con 0x7fa9a014ed30 2023-08-18T20:44:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99d59a700 1 -- 172.21.15.121:0/3879241655 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997340825 0 0) 0x7fa9a00c2260 con 0x7fa9a014e950 2023-08-18T20:44:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99dd9b700 1 --2- 172.21.15.121:0/3879241655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014ed30 0x7fa9a00c2ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00c64f0 tx=0x7fa990009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bf5776d5149610 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99d59a700 1 -- 172.21.15.121:0/3879241655 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990011830 con 0x7fa9a014ed30 2023-08-18T20:44:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99d59a700 1 -- 172.21.15.121:0/3879241655 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990011990 con 0x7fa9a014ed30 2023-08-18T20:44:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa99d59a700 1 -- 172.21.15.121:0/3879241655 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990011d20 con 0x7fa9a014ed30 2023-08-18T20:44:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa9a486c700 1 -- 172.21.15.121:0/3879241655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014ed30 msgr2=0x7fa9a00c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.760+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3879241655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014ed30 0x7fa9a00c2ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00c64f0 tx=0x7fa990009b20 comp rx=0 tx=0).stop 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 -- 172.21.15.121:0/3879241655 shutdown_connections 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3879241655 >> v2:172.21.15.122:3300/0 conn(0x7fa9a0070950 0x7fa9a00c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3879241655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014ed30 0x7fa9a00c2ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 -- 172.21.15.121:0/3879241655 >> 172.21.15.121:0/3879241655 conn(0x7fa9a00c6b10 msgr2=0x7fa9a00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 -- 172.21.15.121:0/3879241655 shutdown_connections 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.761+0000 7fa9a486c700 1 -- 172.21.15.121:0/3879241655 wait complete. 2023-08-18T20:44:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 Processor -- start 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 -- start start 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0070950 0x7fa9a00c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a014ed30 0x7fa9a01e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.762+0000 7fa9a486c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01e71a0 con 0x7fa9a014e950 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa9a486c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01e6fb0 con 0x7fa9a0070950 2023-08-18T20:44:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa9a486c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a006b1d0 con 0x7fa9a014ed30 2023-08-18T20:44:30.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41836/0 (socket says 172.21.15.121:41836) 2023-08-18T20:44:30.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3336816690 learned_addr learned my addr 172.21.15.121:0/3336816690 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:30.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99e59c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0070950 0x7fa9a00c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99ed9d700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a014ed30 0x7fa9a01e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a014ed30 msgr2=0x7fa9a01e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a014ed30 0x7fa9a01e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0070950 msgr2=0x7fa9a00c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0070950 0x7fa9a00c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 -- 172.21.15.121:0/3336816690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900094a0 con 0x7fa9a014e950 2023-08-18T20:44:30.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa99dd9b700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9900090b0 tx=0x7fa990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900038a0 con 0x7fa9a014e950 2023-08-18T20:44:30.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99001f070 con 0x7fa9a014e950 2023-08-18T20:44:30.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a006a2a0 con 0x7fa9a014e950 2023-08-18T20:44:30.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990003c20 con 0x7fa9a014e950 2023-08-18T20:44:30.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.763+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a006a4f0 con 0x7fa9a014e950 2023-08-18T20:44:30.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.764+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a01e72e0 con 0x7fa9a014e950 2023-08-18T20:44:30.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.765+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa99001a430 con 0x7fa9a014e950 2023-08-18T20:44:30.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.765+0000 7fa98effd700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 0x7fa98006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:30.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.765+0000 7fa99e59c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 0x7fa98006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:30.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.765+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa990021070 con 0x7fa9a014e950 2023-08-18T20:44:30.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.765+0000 7fa99e59c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 0x7fa98006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa994000f60 tx=0x7fa994007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:30.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.769+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa9a01e72e0 con 0x7fa9a014e950 2023-08-18T20:44:30.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.959+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9a01e72e0 con 0x7fa9a014e950 2023-08-18T20:44:30.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.959+0000 7fa98effd700 1 -- 172.21.15.121:0/3336816690 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9a01e72e0 con 0x7fa9a014e950 2023-08-18T20:44:30.960 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:30.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 msgr2=0x7fa98006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 0x7fa98006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa994000f60 tx=0x7fa994007be0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 msgr2=0x7fa9a01e75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:30.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9900090b0 tx=0x7fa990004750 comp rx=0 tx=0).stop 2023-08-18T20:44:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 shutdown_connections 2023-08-18T20:44:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a014ed30 0x7fa9a01e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0070950 0x7fa9a00c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa98006a0e0 0x7fa98006c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 --2- 172.21.15.121:0/3336816690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9a014e950 0x7fa9a01e75c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:30.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 >> 172.21.15.121:0/3336816690 conn(0x7fa9a00c6b10 msgr2=0x7fa9a00c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:30.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 shutdown_connections 2023-08-18T20:44:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:30.961+0000 7fa9a486c700 1 -- 172.21.15.121:0/3336816690 wait complete. 2023-08-18T20:44:30.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-18T20:44:31.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.095+0000 7f3813fde700 1 Processor -- start 2023-08-18T20:44:31.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.095+0000 7f3813fde700 1 -- start start 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3813fde700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 0x7f380c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3813fde700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f380c152450 0x7f380c14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3813fde700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c1529a0 con 0x7f380c06fd30 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3813fde700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c152c80 con 0x7f380c152450 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3813fde700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c152f60 con 0x7f380c0c7440 2023-08-18T20:44:31.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f380c152450 0x7f380c14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f380c152450 0x7f380c14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41848/0 (socket says 172.21.15.121:41848) 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 -- 172.21.15.121:0/2538940318 learned_addr learned my addr 172.21.15.121:0/2538940318 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3811579700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 0x7f380c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 -- 172.21.15.121:0/2538940318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 msgr2=0x7f380c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 0x7f380c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 -- 172.21.15.121:0/2538940318 >> v1:172.21.15.122:6789/0 conn(0x7f380c06fd30 legacy=0x7f380c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:31.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 -- 172.21.15.121:0/2538940318 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c153240 con 0x7f380c152450 2023-08-18T20:44:31.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3811579700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 0x7f380c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:31.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f381257b700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c14f8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3804009e50 tx=0x7f380400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc450e804266ce3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3810d78700 1 -- 172.21.15.121:0/2538940318 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380400e070 con 0x7f380c152450 2023-08-18T20:44:31.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.096+0000 7f3810d78700 1 -- 172.21.15.121:0/2538940318 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804003a20 con 0x7f380c152450 2023-08-18T20:44:31.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3810d78700 1 -- 172.21.15.121:0/2538940318 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804003dd0 con 0x7f380c152450 2023-08-18T20:44:31.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 -- 172.21.15.121:0/2538940318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 msgr2=0x7f380c14f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c14f8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3804009e50 tx=0x7f380400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:31.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 -- 172.21.15.121:0/2538940318 shutdown_connections 2023-08-18T20:44:31.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c14f8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 --2- 172.21.15.121:0/2538940318 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c0c7440 0x7f380c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 -- 172.21.15.121:0/2538940318 >> 172.21.15.121:0/2538940318 conn(0x7f380c0c7bf0 msgr2=0x7f380c0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 -- 172.21.15.121:0/2538940318 shutdown_connections 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.097+0000 7f3813fde700 1 -- 172.21.15.121:0/2538940318 wait complete. 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.098+0000 7f3813fde700 1 Processor -- start 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.098+0000 7f3813fde700 1 -- start start 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c06fd30 0x7f380c1e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c0c7440 0x7f380c0c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c151770 con 0x7f380c152450 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c0060 con 0x7f380c0c7440 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3813fde700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c0340 con 0x7f380c06fd30 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41854/0 (socket says 172.21.15.121:41854) 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 -- 172.21.15.121:0/1561462996 learned_addr learned my addr 172.21.15.121:0/1561462996 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:31.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3811d7a700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c06fd30 0x7f380c1e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f3811579700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c0c7440 0x7f380c0c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 -- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c06fd30 msgr2=0x7f380c1e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c06fd30 0x7f380c1e76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 -- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c0c7440 msgr2=0x7f380c0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c0c7440 0x7f380c0c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 -- 172.21.15.121:0/1561462996 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009b30 con 0x7f380c152450 2023-08-18T20:44:31.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.099+0000 7f381257b700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f380c072af0 tx=0x7f3804004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040094d0 con 0x7f380c152450 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804004240 con 0x7f380c152450 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040045f0 con 0x7f380c152450 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0c0620 con 0x7f380c152450 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c0c0be0 con 0x7f380c152450 2023-08-18T20:44:31.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.100+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c074730 con 0x7f380c152450 2023-08-18T20:44:31.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.101+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3804019070 con 0x7f380c152450 2023-08-18T20:44:31.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.102+0000 7f38027fc700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 0x7f37f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.102+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f38040893c0 con 0x7f380c152450 2023-08-18T20:44:31.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.102+0000 7f3811d7a700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 0x7f37f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.102+0000 7f3811d7a700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 0x7f37f006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3808004f30 tx=0x7f3808009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.105+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3804058b20 con 0x7f380c152450 2023-08-18T20:44:31.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.297+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f380c06f190 con 0x7f380c152450 2023-08-18T20:44:31.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.297+0000 7f38027fc700 1 -- 172.21.15.121:0/1561462996 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+126 (secure 0 0 0) 0x7f38040586b0 con 0x7f380c152450 2023-08-18T20:44:31.298 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:31.298 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2023-08-18T20:44:31.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:31.298 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:31.299 INFO:teuthology.orchestra.run.smithi121.stdout:] 2023-08-18T20:44:31.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 msgr2=0x7f37f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 0x7f37f006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3808004f30 tx=0x7f3808009040 comp rx=0 tx=0).stop 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 msgr2=0x7f380c0aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f380c072af0 tx=0x7f3804004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 shutdown_connections 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f37f006a0e0 0x7f37f006c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f380c152450 0x7f380c0aaba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f380c06fd30 0x7f380c1e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 --2- 172.21.15.121:0/1561462996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f380c0c7440 0x7f380c0c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 >> 172.21.15.121:0/1561462996 conn(0x7f380c0c7bf0 msgr2=0x7f380c155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:31.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 shutdown_connections 2023-08-18T20:44:31.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.299+0000 7f3813fde700 1 -- 172.21.15.121:0/1561462996 wait complete. 2023-08-18T20:44:31.311 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-18T20:44:31.312 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-18T20:44:31.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.435+0000 7f00bc50d700 1 Processor -- start 2023-08-18T20:44:31.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.435+0000 7f00bc50d700 1 -- start start 2023-08-18T20:44:31.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00bc50d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00b40c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00bc50d700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b4066180 con 0x7f00b4151da0 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00bc50d700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b4154e70 con 0x7f00b40c1720 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00bc50d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4066700 con 0x7f00b40abf10 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00baaaa700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f00b4151da0 0x7f00b406a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48444/0 (socket says 172.21.15.121:48444) 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00baaaa700 1 -- 172.21.15.121:0/1480759614 learned_addr learned my addr 172.21.15.121:0/1480759614 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00b40c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161657672 0 0) 0x7f00b4066180 con 0x7f00b4151da0 2023-08-18T20:44:31.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a00035b0 con 0x7f00b4151da0 2023-08-18T20:44:31.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670393829 0 0) 0x7f00a00035b0 con 0x7f00b4151da0 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 msgr2=0x7f00b40c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00b40c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 >> v1:172.21.15.122:6789/0 conn(0x7f00b40c1720 legacy=0x7f00b4151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4155130 con 0x7f00b4151da0 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f00ac0019f0 con 0x7f00b4151da0 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 >> v1:172.21.15.121:6789/0 conn(0x7f00b4151da0 legacy=0x7f00b406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a0003aa0 0x7f00a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.436+0000 7f00b92a7700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a0004850 0x7f00a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00a0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4066700 con 0x7f00a0004850 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a000bb20 con 0x7f00a0003aa0 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a000bce0 con 0x7f00b40abf10 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a0004850 0x7f00a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00ba2a9700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a0003aa0 0x7f00a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00baaaa700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00a0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 msgr2=0x7f00a0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00b40abf10 0x7f00a0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a0003aa0 msgr2=0x7f00a0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a0003aa0 0x7f00a0003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1480759614 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00035b0 con 0x7f00a0004850 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a0004850 0x7f00a0004cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009b30 tx=0x7f00a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb27c9c155e3702 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400e6c0 con 0x7f00a0004850 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a400e820 con 0x7f00a0004850 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.437+0000 7f00b92a7700 1 -- 172.21.15.121:0/1480759614 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400eb90 con 0x7f00a0004850 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 -- 172.21.15.121:0/1480759614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a0004850 msgr2=0x7f00a0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1480759614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a0004850 0x7f00a0004cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009b30 tx=0x7f00a0005880 comp rx=0 tx=0).stop 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00baaaa700 1 -- 172.21.15.121:0/1480759614 reap_dead start 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 -- 172.21.15.121:0/1480759614 shutdown_connections 2023-08-18T20:44:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 -- 172.21.15.121:0/1480759614 >> 172.21.15.121:0/1480759614 conn(0x7f00b406bdc0 msgr2=0x7f00b406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 -- 172.21.15.121:0/1480759614 shutdown_connections 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.438+0000 7f00bc50d700 1 -- 172.21.15.121:0/1480759614 wait complete. 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.439+0000 7f00bc50d700 1 Processor -- start 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.439+0000 7f00bc50d700 1 -- start start 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00a0004850 0x7f00b41e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b414fdb0 0x7f00b4150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40ab6d0 con 0x7f00b40c5930 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a9bc0 con 0x7f00b414fdb0 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41ed610 con 0x7f00a0004850 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41872/0 (socket says 172.21.15.121:41872) 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1923679779 learned_addr learned my addr 172.21.15.121:0/1923679779 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00ba2a9700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00a0004850 0x7f00b41e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00baaaa700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b414fdb0 0x7f00b4150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00a0004850 msgr2=0x7f00b41e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00a0004850 0x7f00b41e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b414fdb0 msgr2=0x7f00b4150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b414fdb0 0x7f00b4150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 -- 172.21.15.121:0/1923679779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40a9830 con 0x7f00b40c5930 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00b9aa8700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e4b0 tx=0x7f00a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400e6c0 con 0x7f00b40c5930 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4013ab0 con 0x7f00b40c5930 2023-08-18T20:44:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b40a9e10 con 0x7f00b40c5930 2023-08-18T20:44:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4013e40 con 0x7f00b40c5930 2023-08-18T20:44:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.440+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b4148de0 con 0x7f00b40c5930 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.441+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b4074730 con 0x7f00b40c5930 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.442+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f00a401c450 con 0x7f00b40c5930 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.442+0000 7f00aaffd700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 0x7f009806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.442+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f00a4089260 con 0x7f00b40c5930 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.442+0000 7f00ba2a9700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 0x7f009806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.443+0000 7f00ba2a9700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 0x7f009806c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007fd0 tx=0x7f00b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.446+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f00a4054f30 con 0x7f00b40c5930 2023-08-18T20:44:31.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.637+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f00b40728a0 con 0x7f00b40c5930 2023-08-18T20:44:31.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:31.998+0000 7f00aaffd700 1 -- 172.21.15.121:0/1923679779 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f00a4058550 con 0x7f00b40c5930 2023-08-18T20:44:32.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 msgr2=0x7f009806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 0x7f009806c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007fd0 tx=0x7f00b0009040 comp rx=0 tx=0).stop 2023-08-18T20:44:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 msgr2=0x7f00b4071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e4b0 tx=0x7f00a40047c0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 shutdown_connections 2023-08-18T20:44:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b414fdb0 0x7f00b4150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00a0004850 0x7f00b41e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f009806a0e0 0x7f009806c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 --2- 172.21.15.121:0/1923679779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b40c5930 0x7f00b4071b50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 >> 172.21.15.121:0/1923679779 conn(0x7f00b406bdc0 msgr2=0x7f00b414e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:32.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 shutdown_connections 2023-08-18T20:44:32.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.001+0000 7f00bc50d700 1 -- 172.21.15.121:0/1923679779 wait complete. 2023-08-18T20:44:32.004 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2023-08-18T20:44:32.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-18T20:44:32.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.143+0000 7f84c147e700 1 Processor -- start 2023-08-18T20:44:32.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.143+0000 7f84c147e700 1 -- start start 2023-08-18T20:44:32.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84c147e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84bc14e6c0 0x7f84bc155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84c147e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 0x7f84bc0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84c147e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc06f920 con 0x7f84bc0c8060 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84c147e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc06e980 con 0x7f84bc14e6c0 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84c147e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc06eb60 con 0x7f84bc0a6d40 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84bc14e6c0 0x7f84bc155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84bb7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84bc0c8060 0x7f84bc0c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48466/0 (socket says 172.21.15.121:48466) 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84bb7fe700 1 -- 172.21.15.121:0/1754912047 learned_addr learned my addr 172.21.15.121:0/1754912047 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84ba7fc700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 0x7f84bc0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 -- 172.21.15.121:0/1754912047 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 msgr2=0x7f84bc0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 0x7f84bc0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 -- 172.21.15.121:0/1754912047 >> v1:172.21.15.121:6789/0 conn(0x7f84bc0c8060 legacy=0x7f84bc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 -- 172.21.15.121:0/1754912047 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc06ee40 con 0x7f84bc14e6c0 2023-08-18T20:44:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84b9ffb700 1 -- 172.21.15.121:0/1754912047 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429030861 0 0) 0x7f84bc06f920 con 0x7f84bc0c8060 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84ba7fc700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 0x7f84bc0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84baffd700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc155070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009840 tx=0x7f84b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2b3a16373b7053 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84b9ffb700 1 -- 172.21.15.121:0/1754912047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011830 con 0x7f84bc14e6c0 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84b9ffb700 1 -- 172.21.15.121:0/1754912047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0011990 con 0x7f84bc14e6c0 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.144+0000 7f84b9ffb700 1 -- 172.21.15.121:0/1754912047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011d20 con 0x7f84bc14e6c0 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 -- 172.21.15.121:0/1754912047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 msgr2=0x7f84bc155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc155070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009840 tx=0x7f84b0009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 -- 172.21.15.121:0/1754912047 shutdown_connections 2023-08-18T20:44:32.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc155070 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 --2- 172.21.15.121:0/1754912047 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0a6d40 0x7f84bc0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 -- 172.21.15.121:0/1754912047 >> 172.21.15.121:0/1754912047 conn(0x7f84bc0a96a0 msgr2=0x7f84bc0a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:32.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 -- 172.21.15.121:0/1754912047 shutdown_connections 2023-08-18T20:44:32.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.145+0000 7f84c147e700 1 -- 172.21.15.121:0/1754912047 wait complete. 2023-08-18T20:44:32.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.146+0000 7f84c147e700 1 Processor -- start 2023-08-18T20:44:32.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.146+0000 7f84c147e700 1 -- start start 2023-08-18T20:44:32.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 0x7f84bc153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 0x7f84bc14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1eed50 con 0x7f84bc14e6c0 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c4d30 con 0x7f84bc0a6d40 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84c147e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0bad90 con 0x7f84bc0c8060 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41890/0 (socket says 172.21.15.121:41890) 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 -- 172.21.15.121:0/399796288 learned_addr learned my addr 172.21.15.121:0/399796288 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84ba7fc700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 0x7f84bc14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84baffd700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 0x7f84bc153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 -- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 msgr2=0x7f84bc14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 0x7f84bc14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 -- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 msgr2=0x7f84bc153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:32.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 0x7f84bc153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84bb7fe700 1 -- 172.21.15.121:0/399796288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00094a0 con 0x7f84bc14e6c0 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84ba7fc700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 0x7f84bc14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.147+0000 7f84baffd700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 0x7f84bc153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84bb7fe700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84b400cba0 tx=0x7f84b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400ab80 con 0x7f84bc14e6c0 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400ad00 con 0x7f84bc14e6c0 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007310 con 0x7f84bc14e6c0 2023-08-18T20:44:32.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0bb220 con 0x7f84bc14e6c0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.148+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0c4f40 con 0x7f84bc14e6c0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.149+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0bab60 con 0x7f84bc14e6c0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.149+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84b4007470 con 0x7f84bc14e6c0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.150+0000 7f84a37fe700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 0x7f84a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.150+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f84b4087e20 con 0x7f84bc14e6c0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.150+0000 7f84baffd700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 0x7f84a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:32.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.150+0000 7f84baffd700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 0x7f84a806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f84b00090b0 tx=0x7f84b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:32.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.154+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f84bc0bab60 con 0x7f84bc14e6c0 2023-08-18T20:44:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:32.343+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f84bc0bab60 con 0x7f84bc14e6c0 2023-08-18T20:44:33.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.005+0000 7f84a37fe700 1 -- 172.21.15.121:0/399796288 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f84bc0bab60 con 0x7f84bc14e6c0 2023-08-18T20:44:33.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.010+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 msgr2=0x7f84a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.010+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 0x7f84a806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f84b00090b0 tx=0x7f84b0008030 comp rx=0 tx=0).stop 2023-08-18T20:44:33.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.010+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 msgr2=0x7f84bc1f12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.010+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84b400cba0 tx=0x7f84b400cf60 comp rx=0 tx=0).stop 2023-08-18T20:44:33.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 shutdown_connections 2023-08-18T20:44:33.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f84a806a0e0 0x7f84a806c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84bc14e6c0 0x7f84bc1f12a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84bc0a6d40 0x7f84bc153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 --2- 172.21.15.121:0/399796288 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84bc0c8060 0x7f84bc14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.014+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 >> 172.21.15.121:0/399796288 conn(0x7f84bc0a96a0 msgr2=0x7f84bc0c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:33.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.016+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 shutdown_connections 2023-08-18T20:44:33.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.016+0000 7f84c147e700 1 -- 172.21.15.121:0/399796288 wait complete. 2023-08-18T20:44:33.018 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2023-08-18T20:44:33.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-18T20:44:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 Processor -- start 2023-08-18T20:44:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 -- start start 2023-08-18T20:44:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b8006fd30 0x7f4b800c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4b801559c0 0x7f4b800c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b801529a0 con 0x7f4b80152450 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b80152c80 con 0x7f4b801559c0 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.164+0000 7f4b86e52700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b80152f60 con 0x7f4b8006fd30 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4b801559c0 0x7f4b800c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7ffff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4b80152450 0x7f4b8014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48478/0 (socket says 172.21.15.121:48478) 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7ffff700 1 -- 172.21.15.121:0/4053575503 learned_addr learned my addr 172.21.15.121:0/4053575503 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b84bee700 1 --2- 172.21.15.121:0/4053575503 >> v2:172.21.15.122:3300/0 conn(0x7f4b8006fd30 0x7f4b800c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 -- 172.21.15.121:0/4053575503 >> v2:172.21.15.122:3300/0 conn(0x7f4b8006fd30 msgr2=0x7f4b800c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 --2- 172.21.15.121:0/4053575503 >> v2:172.21.15.122:3300/0 conn(0x7f4b8006fd30 0x7f4b800c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 -- 172.21.15.121:0/4053575503 >> v1:172.21.15.121:6789/0 conn(0x7f4b80152450 legacy=0x7f4b8014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7f7fe700 1 -- 172.21.15.121:0/4053575503 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649545400 0 0) 0x7f4b801529a0 con 0x7f4b80152450 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 -- 172.21.15.121:0/4053575503 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80153240 con 0x7f4b801559c0 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b853ef700 1 --2- 172.21.15.121:0/4053575503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800c7270 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006eec0 tx=0x7f4b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a55f01f16b9f176 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:33.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7f7fe700 1 -- 172.21.15.121:0/4053575503 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800e070 con 0x7f4b801559c0 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7f7fe700 1 -- 172.21.15.121:0/4053575503 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7800bbd0 con 0x7f4b801559c0 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.165+0000 7f4b7f7fe700 1 -- 172.21.15.121:0/4053575503 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78012430 con 0x7f4b801559c0 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 -- 172.21.15.121:0/4053575503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 msgr2=0x7f4b800c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 --2- 172.21.15.121:0/4053575503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800c7270 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006eec0 tx=0x7f4b7800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 -- 172.21.15.121:0/4053575503 shutdown_connections 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 --2- 172.21.15.121:0/4053575503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800c7270 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 --2- 172.21.15.121:0/4053575503 >> v2:172.21.15.122:3300/0 conn(0x7f4b8006fd30 0x7f4b800c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 -- 172.21.15.121:0/4053575503 >> 172.21.15.121:0/4053575503 conn(0x7f4b800c7bf0 msgr2=0x7f4b800c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:33.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 -- 172.21.15.121:0/4053575503 shutdown_connections 2023-08-18T20:44:33.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.166+0000 7f4b86e52700 1 -- 172.21.15.121:0/4053575503 wait complete. 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.167+0000 7f4b86e52700 1 Processor -- start 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.167+0000 7f4b86e52700 1 -- start start 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 0x7f4b800c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 0x7f4b800bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800beb10 con 0x7f4b801559c0 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800bc0c0 con 0x7f4b8006fd30 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b801e72e0 con 0x7f4b80152450 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41904/0 (socket says 172.21.15.121:41904) 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 -- 172.21.15.121:0/3547920119 learned_addr learned my addr 172.21.15.121:0/3547920119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b7ffff700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 0x7f4b800bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b84bee700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 0x7f4b800c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 -- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 msgr2=0x7f4b800bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 0x7f4b800bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 -- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 msgr2=0x7f4b800c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 0x7f4b800c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 -- 172.21.15.121:0/3547920119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78009a70 con 0x7f4b801559c0 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b84bee700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 0x7f4b800c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b7ffff700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 0x7f4b800bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b853ef700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b370 tx=0x7f4b78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78012430 con 0x7f4b801559c0 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78020070 con 0x7f4b801559c0 2023-08-18T20:44:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78004280 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.168+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b801e7580 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.169+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b801e7b40 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.170+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80074730 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.170+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b780043e0 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.171+0000 7f4b7d7fa700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 0x7f4b6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.171+0000 7f4b84bee700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 0x7f4b6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.171+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4b78022070 con 0x7f4b801559c0 2023-08-18T20:44:33.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.171+0000 7f4b84bee700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 0x7f4b6406c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006fd0 tx=0x7f4b74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:33.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.175+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4b78055b40 con 0x7f4b801559c0 2023-08-18T20:44:33.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:33.410+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b800c2020 con 0x7f4b801559c0 2023-08-18T20:44:34.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.007+0000 7f4b7d7fa700 1 -- 172.21.15.121:0/3547920119 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4b78059160 con 0x7f4b801559c0 2023-08-18T20:44:34.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 msgr2=0x7f4b6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 0x7f4b6406c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006fd0 tx=0x7f4b74008040 comp rx=0 tx=0).stop 2023-08-18T20:44:34.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 msgr2=0x7f4b800bbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b370 tx=0x7f4b78004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 shutdown_connections 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4b6406a0e0 0x7f4b6406c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b801559c0 0x7f4b800bbb80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b8006fd30 0x7f4b800c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 --2- 172.21.15.121:0/3547920119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b80152450 0x7f4b800bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 >> 172.21.15.121:0/3547920119 conn(0x7f4b800c7bf0 msgr2=0x7f4b80154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 shutdown_connections 2023-08-18T20:44:34.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.012+0000 7f4b86e52700 1 -- 172.21.15.121:0/3547920119 wait complete. 2023-08-18T20:44:34.016 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 5 and data pool 6 2023-08-18T20:44:34.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:34.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.164+0000 7fb147941700 1 Processor -- start 2023-08-18T20:44:34.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.164+0000 7fb147941700 1 -- start start 2023-08-18T20:44:34.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb147941700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb1400c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb147941700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb140155970 con 0x7fb14014fb90 2023-08-18T20:44:34.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb147941700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14006e830 con 0x7fb140152250 2023-08-18T20:44:34.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb147941700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14014ff70 con 0x7fb140156510 2023-08-18T20:44:34.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb1456dd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb14014fb90 0x7fb14006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48506/0 (socket says 172.21.15.121:48506) 2023-08-18T20:44:34.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.165+0000 7fb1456dd700 1 -- 172.21.15.121:0/1319985310 learned_addr learned my addr 172.21.15.121:0/1319985310 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:34.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb1400c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635775990 0 0) 0x7fb140155970 con 0x7fb14014fb90 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c0035b0 con 0x7fb14014fb90 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2607763344 0 0) 0x7fb12c0035b0 con 0x7fb14014fb90 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 msgr2=0x7fb1400c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb1400c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 >> v1:172.21.15.122:6789/0 conn(0x7fb140152250 legacy=0x7fb140155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14006df90 con 0x7fb14014fb90 2023-08-18T20:44:34.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fb130001670 con 0x7fb14014fb90 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 >> v1:172.21.15.121:6789/0 conn(0x7fb14014fb90 legacy=0x7fb14006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb12c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c003fe0 0x7fb12c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb12c004d90 0x7fb12c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00bac0 con 0x7fb12c004d90 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00bc30 con 0x7fb12c003fe0 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00bdf0 con 0x7fb140156510 2023-08-18T20:44:34.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb1456dd700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb12c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb144edc700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c003fe0 0x7fb12c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb12c004d90 0x7fb12c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 -- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 msgr2=0x7fb12c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb12c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 -- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c003fe0 msgr2=0x7fb12c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c003fe0 0x7fb12c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb145ede700 1 -- 172.21.15.121:0/1319985310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0035b0 con 0x7fb12c004d90 2023-08-18T20:44:34.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.166+0000 7fb1456dd700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb140156510 0x7fb12c003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb145ede700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb12c004d90 0x7fb12c005210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb140070900 tx=0x7fb12c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70fcb4ddfc7bdb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800ebd0 con 0x7fb12c004d90 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800f040 con 0x7fb12c004d90 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb137fff700 1 -- 172.21.15.121:0/1319985310 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138014480 con 0x7fb12c004d90 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 -- 172.21.15.121:0/1319985310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb12c004d90 msgr2=0x7fb12c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 --2- 172.21.15.121:0/1319985310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb12c004d90 0x7fb12c005210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb140070900 tx=0x7fb12c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:34.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb145ede700 1 -- 172.21.15.121:0/1319985310 reap_dead start 2023-08-18T20:44:34.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 -- 172.21.15.121:0/1319985310 shutdown_connections 2023-08-18T20:44:34.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 -- 172.21.15.121:0/1319985310 >> 172.21.15.121:0/1319985310 conn(0x7fb1400c6b10 msgr2=0x7fb1400c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 -- 172.21.15.121:0/1319985310 shutdown_connections 2023-08-18T20:44:34.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.167+0000 7fb147941700 1 -- 172.21.15.121:0/1319985310 wait complete. 2023-08-18T20:44:34.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.168+0000 7fb147941700 1 Processor -- start 2023-08-18T20:44:34.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 -- start start 2023-08-18T20:44:34.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c004d90 0x7fb1400aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1401e8090 0x7fb140154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400ac730 con 0x7fb14014aa70 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400aa5e0 con 0x7fb12c004d90 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb147941700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400abe60 con 0x7fb1401e8090 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb144edc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb144edc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41936/0 (socket says 172.21.15.121:41936) 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb144edc700 1 -- 172.21.15.121:0/1515422119 learned_addr learned my addr 172.21.15.121:0/1515422119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:34.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb1456dd700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c004d90 0x7fb1400aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.169+0000 7fb145ede700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1401e8090 0x7fb140154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 -- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1401e8090 msgr2=0x7fb140154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1401e8090 0x7fb140154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 -- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c004d90 msgr2=0x7fb1400aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c004d90 0x7fb1400aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 -- 172.21.15.121:0/1515422119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1400ac120 con 0x7fb14014aa70 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb144edc700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00f820 tx=0x7fb13c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0052e0 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c005460 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1400ab1b0 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0038c0 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.170+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1401e7890 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.171+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1401e76f0 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.171+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb13c003a20 con 0x7fb14014aa70 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.172+0000 7fb135ffb700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 0x7fb12406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.172+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb13c088360 con 0x7fb14014aa70 2023-08-18T20:44:34.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.172+0000 7fb1456dd700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 0x7fb12406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.172+0000 7fb1456dd700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 0x7fb12406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb130007d70 tx=0x7fb130007c80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.176+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb1401e76f0 con 0x7fb14014aa70 2023-08-18T20:44:34.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.366+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1401e76f0 con 0x7fb14014aa70 2023-08-18T20:44:34.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.367+0000 7fb135ffb700 1 -- 172.21.15.121:0/1515422119 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18354 (secure 0 0 0) 0x7fb1401e76f0 con 0x7fb14014aa70 2023-08-18T20:44:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:34.368 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":32,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:33.412077+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 msgr2=0x7fb12406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 0x7fb12406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb130007d70 tx=0x7fb130007c80 comp rx=0 tx=0).stop 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 msgr2=0x7fb1400a7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00f820 tx=0x7fb13c00fb30 comp rx=0 tx=0).stop 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 shutdown_connections 2023-08-18T20:44:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1401e8090 0x7fb140154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb12c004d90 0x7fb1400aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb12406a0e0 0x7fb12406c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 --2- 172.21.15.121:0/1515422119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14014aa70 0x7fb1400a7a30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 >> 172.21.15.121:0/1515422119 conn(0x7fb1400c6b10 msgr2=0x7fb1400c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 shutdown_connections 2023-08-18T20:44:34.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.369+0000 7fb147941700 1 -- 172.21.15.121:0/1515422119 wait complete. 2023-08-18T20:44:34.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:34.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.501+0000 7f4df6a49700 1 Processor -- start 2023-08-18T20:44:34.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.501+0000 7f4df6a49700 1 -- start start 2023-08-18T20:44:34.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4df014e950 0x7f4df00c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4df00c19d0 0x7f4df00c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00a6630 con 0x7f4df00c19d0 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00c2260 con 0x7f4df014e950 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df6a49700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0151d90 con 0x7f4df014ed30 2023-08-18T20:44:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4df00c19d0 0x7f4df00c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4df00c19d0 0x7f4df00c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41944/0 (socket says 172.21.15.121:41944) 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 -- 172.21.15.121:0/3070207431 learned_addr learned my addr 172.21.15.121:0/3070207431 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4def7fe700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4deffff700 1 --2- 172.21.15.121:0/3070207431 >> v2:172.21.15.122:3300/0 conn(0x7f4df014e950 0x7f4df00c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 -- 172.21.15.121:0/3070207431 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 msgr2=0x7f4df00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 -- 172.21.15.121:0/3070207431 >> v2:172.21.15.122:3300/0 conn(0x7f4df014e950 msgr2=0x7f4df00c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 --2- 172.21.15.121:0/3070207431 >> v2:172.21.15.122:3300/0 conn(0x7f4df014e950 0x7f4df00c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 -- 172.21.15.121:0/3070207431 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0152070 con 0x7f4df00c19d0 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4df4fe6700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df00c4b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4df00acdc0 tx=0x7f4de800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3201f03972b7c9f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4deeffd700 1 -- 172.21.15.121:0/3070207431 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800e070 con 0x7f4df00c19d0 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4deeffd700 1 -- 172.21.15.121:0/3070207431 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800b910 con 0x7f4df00c19d0 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.502+0000 7f4deeffd700 1 -- 172.21.15.121:0/3070207431 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800bcc0 con 0x7f4df00c19d0 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 -- 172.21.15.121:0/3070207431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 msgr2=0x7f4df00c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df00c4b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4df00acdc0 tx=0x7f4de800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 -- 172.21.15.121:0/3070207431 shutdown_connections 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3070207431 >> v2:172.21.15.122:3300/0 conn(0x7f4df014e950 0x7f4df00c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df00c4b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3070207431 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 -- 172.21.15.121:0/3070207431 >> 172.21.15.121:0/3070207431 conn(0x7f4df00c6b10 msgr2=0x7f4df00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 -- 172.21.15.121:0/3070207431 shutdown_connections 2023-08-18T20:44:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.503+0000 7f4df6a49700 1 -- 172.21.15.121:0/3070207431 wait complete. 2023-08-18T20:44:34.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.504+0000 7f4df6a49700 1 Processor -- start 2023-08-18T20:44:34.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.504+0000 7f4df6a49700 1 -- start start 2023-08-18T20:44:34.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 0x7f4df014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01439c0 con 0x7f4df00c19d0 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df014a8a0 con 0x7f4df014e950 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df6a49700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00ab0f0 con 0x7f4df014ed30 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41946/0 (socket says 172.21.15.121:41946) 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 -- 172.21.15.121:0/3329216046 learned_addr learned my addr 172.21.15.121:0/3329216046 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df4fe6700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4def7fe700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 0x7f4df014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 -- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 msgr2=0x7f4df00c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 -- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 msgr2=0x7f4df014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 0x7f4df014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4deffff700 1 -- 172.21.15.121:0/3329216046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009b30 con 0x7f4df00c19d0 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4df4fe6700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.505+0000 7f4def7fe700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 0x7f4df014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4deffff700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4de400e9b0 tx=0x7f4de400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4009710 con 0x7f4df00c19d0 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400c850 con 0x7f4df00c19d0 2023-08-18T20:44:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df01e9280 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400cbc0 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.506+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df00ab620 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.507+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0074730 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.507+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4de400cd20 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.508+0000 7f4decff9700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 0x7f4ddc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.508+0000 7f4def7fe700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 0x7f4ddc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.508+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4de40885b0 con 0x7f4df00c19d0 2023-08-18T20:44:34.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.508+0000 7f4def7fe700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 0x7f4ddc06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4df01ea1a0 tx=0x7f4de0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.512+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4de40577c0 con 0x7f4df00c19d0 2023-08-18T20:44:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.704+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df00c5ca0 con 0x7f4df00c19d0 2023-08-18T20:44:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.705+0000 7f4decff9700 1 -- 172.21.15.121:0/3329216046 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f4de4057350 con 0x7f4df00c19d0 2023-08-18T20:44:34.706 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:34.706 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":32,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:33.412077+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:34.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 msgr2=0x7f4ddc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 0x7f4ddc06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4df01ea1a0 tx=0x7f4de0008040 comp rx=0 tx=0).stop 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 msgr2=0x7f4df015bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4de400e9b0 tx=0x7f4de400ed70 comp rx=0 tx=0).stop 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 shutdown_connections 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4df014ed30 0x7f4df00c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4ddc06a0e0 0x7f4ddc06c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df00c19d0 0x7f4df015bfc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 --2- 172.21.15.121:0/3329216046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4df014e950 0x7f4df014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 >> 172.21.15.121:0/3329216046 conn(0x7f4df00c6b10 msgr2=0x7f4df014e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 shutdown_connections 2023-08-18T20:44:34.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.707+0000 7f4df6a49700 1 -- 172.21.15.121:0/3329216046 wait complete. 2023-08-18T20:44:34.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-18T20:44:34.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 Processor -- start 2023-08-18T20:44:34.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 -- start start 2023-08-18T20:44:34.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30900c7ca0 0x7f30901543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 0x7f309015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30900ca4a0 con 0x7f3090151b10 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309006c0f0 con 0x7f30900c7ca0 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.843+0000 7f30958eb700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3090158540 con 0x7f3090154900 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30900c7ca0 0x7f30901543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30900c7ca0 0x7f30901543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41954/0 (socket says 172.21.15.121:41954) 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 -- 172.21.15.121:0/2896434190 learned_addr learned my addr 172.21.15.121:0/2896434190 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308f7fe700 1 --2- 172.21.15.121:0/2896434190 >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 0x7f309015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 -- 172.21.15.121:0/2896434190 >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 msgr2=0x7f309015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 --2- 172.21.15.121:0/2896434190 >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 0x7f309015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 -- 172.21.15.121:0/2896434190 >> v1:172.21.15.122:6789/0 conn(0x7f3090151b10 legacy=0x7f30900c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 -- 172.21.15.121:0/2896434190 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090158820 con 0x7f30900c7ca0 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308f7fe700 1 --2- 172.21.15.121:0/2896434190 >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 0x7f309015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308e7fc700 1 --2- 172.21.15.121:0/2896434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30900c7ca0 0x7f30901543c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f309006a330 tx=0x7f3084009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cbeb9ddc876070 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308dffb700 1 -- 172.21.15.121:0/2896434190 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084004230 con 0x7f30900c7ca0 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308dffb700 1 -- 172.21.15.121:0/2896434190 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3084004390 con 0x7f30900c7ca0 2023-08-18T20:44:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.844+0000 7f308dffb700 1 -- 172.21.15.121:0/2896434190 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840036a0 con 0x7f30900c7ca0 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 -- 172.21.15.121:0/2896434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30900c7ca0 msgr2=0x7f30901543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 --2- 172.21.15.121:0/2896434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30900c7ca0 0x7f30901543c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f309006a330 tx=0x7f3084009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 -- 172.21.15.121:0/2896434190 shutdown_connections 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 --2- 172.21.15.121:0/2896434190 >> v2:172.21.15.122:3300/0 conn(0x7f3090154900 0x7f309015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 --2- 172.21.15.121:0/2896434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30900c7ca0 0x7f30901543c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 -- 172.21.15.121:0/2896434190 >> 172.21.15.121:0/2896434190 conn(0x7f3090071bb0 msgr2=0x7f3090071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:34.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 -- 172.21.15.121:0/2896434190 shutdown_connections 2023-08-18T20:44:34.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.845+0000 7f30958eb700 1 -- 172.21.15.121:0/2896434190 wait complete. 2023-08-18T20:44:34.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.846+0000 7f30958eb700 1 Processor -- start 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.846+0000 7f30958eb700 1 -- start start 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30900c7ca0 0x7f3090154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 0x7f309014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901e9140 con 0x7f3090151b10 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309014bfc0 con 0x7f3090154900 2023-08-18T20:44:34.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309014c2a0 con 0x7f30900c7ca0 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41962/0 (socket says 172.21.15.121:41962) 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 -- 172.21.15.121:0/2281535672 learned_addr learned my addr 172.21.15.121:0/2281535672 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308effd700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30900c7ca0 0x7f3090154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308f7fe700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 0x7f309014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 -- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30900c7ca0 msgr2=0x7f3090154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30900c7ca0 0x7f3090154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 -- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 msgr2=0x7f309014dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 0x7f309014dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 -- 172.21.15.121:0/2281535672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084009550 con 0x7f3090151b10 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308f7fe700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 0x7f309014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f308e7fc700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3084009130 tx=0x7f3084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011630 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3084011790 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309014c580 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.847+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011b00 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.848+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3090154550 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.848+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30900ca910 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.849+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f308401b440 con 0x7f3090151b10 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.849+0000 7f3077fff700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 0x7f307c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.850+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3084089c40 con 0x7f3090151b10 2023-08-18T20:44:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.850+0000 7f308effd700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 0x7f307c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.850+0000 7f308effd700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 0x7f307c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3080007fd0 tx=0x7f3080009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:34.853+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f30840555c0 con 0x7f3090151b10 2023-08-18T20:44:35.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:35.093+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30900ca910 con 0x7f3090151b10 2023-08-18T20:44:36.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.020+0000 7f3077fff700 1 -- 172.21.15.121:0/2281535672 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30900ca910 con 0x7f3090151b10 2023-08-18T20:44:36.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 msgr2=0x7f307c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 0x7f307c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3080007fd0 tx=0x7f3080009040 comp rx=0 tx=0).stop 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 msgr2=0x7f309014da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3084009130 tx=0x7f3084004750 comp rx=0 tx=0).stop 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 shutdown_connections 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3090154900 0x7f309014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30900c7ca0 0x7f3090154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f307c06a0e0 0x7f307c06c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 --2- 172.21.15.121:0/2281535672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3090151b10 0x7f309014da60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 >> 172.21.15.121:0/2281535672 conn(0x7f3090071bb0 msgr2=0x7f30901503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:36.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 shutdown_connections 2023-08-18T20:44:36.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.023+0000 7f30958eb700 1 -- 172.21.15.121:0/2281535672 wait complete. 2023-08-18T20:44:36.038 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-18T20:44:36.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-18T20:44:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.167+0000 7f6f7deb6700 1 Processor -- start 2023-08-18T20:44:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.167+0000 7f6f7deb6700 1 -- start start 2023-08-18T20:44:36.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f7deb6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f7806c4f0 0x7f6f780c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f7deb6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f7deb6700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780c15b0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f7deb6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7806d8c0 con 0x7f6f7806c4f0 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f7deb6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780c0c80 con 0x7f6f781505e0 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f7806c4f0 0x7f6f780c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f77fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f77fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:38382/0 (socket says 172.21.15.121:38382) 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f7806c4f0 0x7f6f780c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:51806/0 (socket says 172.21.15.121:51806) 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f77fff700 1 -- 172.21.15.121:0/3042795 learned_addr learned my addr 172.21.15.121:0/3042795 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:36.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 -- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 msgr2=0x7f6f78150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 -- 172.21.15.121:0/3042795 >> v1:172.21.15.122:6789/0 conn(0x7f6f780ab4b0 legacy=0x7f6f7814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f777fe700 1 -- 172.21.15.121:0/3042795 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780c0f60 con 0x7f6f7806c4f0 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.168+0000 7f6f77fff700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f777fe700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7806c4f0 0x7f6f780c0300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009840 tx=0x7f6f6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ba8ba8116726ce server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f767fc700 1 -- 172.21.15.121:0/3042795 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c011830 con 0x7f6f7806c4f0 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f767fc700 1 -- 172.21.15.121:0/3042795 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c011990 con 0x7f6f7806c4f0 2023-08-18T20:44:36.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f767fc700 1 -- 172.21.15.121:0/3042795 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c011d20 con 0x7f6f7806c4f0 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 -- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7806c4f0 msgr2=0x7f6f780c0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7806c4f0 0x7f6f780c0300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009840 tx=0x7f6f6c009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 -- 172.21.15.121:0/3042795 shutdown_connections 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f781505e0 0x7f6f78150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/3042795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7806c4f0 0x7f6f780c0300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 -- 172.21.15.121:0/3042795 >> 172.21.15.121:0/3042795 conn(0x7f6f780a7610 msgr2=0x7f6f780a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 -- 172.21.15.121:0/3042795 shutdown_connections 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.169+0000 7f6f7deb6700 1 -- 172.21.15.121:0/3042795 wait complete. 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 Processor -- start 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 -- start start 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f7806c4f0 0x7f6f780c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f781505e0 0x7f6f781e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780722e0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78152480 con 0x7f6f781505e0 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.171+0000 7f6f7deb6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78072530 con 0x7f6f7806c4f0 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41976/0 (socket says 172.21.15.121:41976) 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 -- 172.21.15.121:0/2734775870 learned_addr learned my addr 172.21.15.121:0/2734775870 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f777fe700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f7806c4f0 0x7f6f780c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f77fff700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f781505e0 0x7f6f781e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 -- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f7806c4f0 msgr2=0x7f6f780c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f7806c4f0 0x7f6f780c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 -- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f781505e0 msgr2=0x7f6f781e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f781505e0 0x7f6f781e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 -- 172.21.15.121:0/2734775870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7000bd40 con 0x7f6f780ab4b0 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f76ffd700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4e0 tx=0x7f6f6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680052d0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68005430 con 0x7f6f780ab4b0 2023-08-18T20:44:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c0094a0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680038c0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.172+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f780ab1a0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.173+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78074730 con 0x7f6f780ab4b0 2023-08-18T20:44:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.174+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f68003a20 con 0x7f6f780ab4b0 2023-08-18T20:44:36.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.174+0000 7f6f5ffff700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 0x7f6f6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:36.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.174+0000 7f6f777fe700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 0x7f6f6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:36.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.174+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f68087840 con 0x7f6f780ab4b0 2023-08-18T20:44:36.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.175+0000 7f6f777fe700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 0x7f6f6406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:36.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.179+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6f68052fc0 con 0x7f6f780ab4b0 2023-08-18T20:44:36.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:36.411+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f780c2eb0 con 0x7f6f780ab4b0 2023-08-18T20:44:37.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.030+0000 7f6f5ffff700 1 -- 172.21.15.121:0/2734775870 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f680565e0 con 0x7f6f780ab4b0 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 msgr2=0x7f6f6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 0x7f6f6406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 msgr2=0x7f6f78148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4e0 tx=0x7f6f6800c7f0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 shutdown_connections 2023-08-18T20:44:37.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f781505e0 0x7f6f781e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f7806c4f0 0x7f6f780c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f6406a0e0 0x7f6f6406c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 --2- 172.21.15.121:0/2734775870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f780ab4b0 0x7f6f78148170 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 >> 172.21.15.121:0/2734775870 conn(0x7f6f780a7610 msgr2=0x7f6f78073590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 shutdown_connections 2023-08-18T20:44:37.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.032+0000 7f6f7deb6700 1 -- 172.21.15.121:0/2734775870 wait complete. 2023-08-18T20:44:37.046 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-18T20:44:37.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:37.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.168+0000 7f32ba71b700 1 Processor -- start 2023-08-18T20:44:37.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.168+0000 7f32ba71b700 1 -- start start 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32ba71b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f32b40c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32ba71b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32b41559c0 0x7f32b40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32ba71b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b41529a0 con 0x7f32b4152450 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32ba71b700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b4152c80 con 0x7f32b41559c0 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32ba71b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4152f60 con 0x7f32b406fd30 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32b37fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f32b4152450 0x7f32b414f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48564/0 (socket says 172.21.15.121:48564) 2023-08-18T20:44:37.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32b37fe700 1 -- 172.21.15.121:0/1815783084 learned_addr learned my addr 172.21.15.121:0/1815783084 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.169+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214526425 0 0) 0x7f32b41529a0 con 0x7f32b4152450 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f329c0035b0 con 0x7f32b4152450 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b3fff700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f32b40c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/1815783084 >> v2:172.21.15.122:3300/0 conn(0x7f32b41559c0 0x7f32b40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881572155 0 0) 0x7f329c0035b0 con 0x7f32b4152450 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 msgr2=0x7f32b40c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f32b40c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 >> v2:172.21.15.122:3300/0 conn(0x7f32b41559c0 msgr2=0x7f32b40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 --2- 172.21.15.121:0/1815783084 >> v2:172.21.15.122:3300/0 conn(0x7f32b41559c0 0x7f32b40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4153240 con 0x7f32b4152450 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f32a4001670 con 0x7f32b4152450 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 >> v1:172.21.15.121:6789/0 conn(0x7f32b4152450 legacy=0x7f32b414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f329c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f329c003ff0 0x7f329c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f329c004d90 0x7f329c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4152c80 con 0x7f329c004d90 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4152f60 con 0x7f329c003ff0 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c00bac0 con 0x7f32b406fd30 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f329c004d90 0x7f329c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b3fff700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f329c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b37fe700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f329c003ff0 0x7f329c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 -- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 msgr2=0x7f329c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b406fd30 0x7f329c003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 -- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f329c003ff0 msgr2=0x7f329c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f329c003ff0 0x7f329c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 -- 172.21.15.121:0/1815783084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c0035b0 con 0x7f329c004d90 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f329c004d90 0x7f329c005210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009f90 tx=0x7f329c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54920ef13013d5a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.170+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00ec30 con 0x7f329c004d90 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00f040 con 0x7f329c004d90 2023-08-18T20:44:37.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32b2ffd700 1 -- 172.21.15.121:0/1815783084 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac014480 con 0x7f329c004d90 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 -- 172.21.15.121:0/1815783084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f329c004d90 msgr2=0x7f329c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 --2- 172.21.15.121:0/1815783084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f329c004d90 0x7f329c005210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009f90 tx=0x7f329c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32b8cb8700 1 -- 172.21.15.121:0/1815783084 reap_dead start 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 -- 172.21.15.121:0/1815783084 shutdown_connections 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 -- 172.21.15.121:0/1815783084 >> 172.21.15.121:0/1815783084 conn(0x7f32b40c7bf0 msgr2=0x7f32b40c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 -- 172.21.15.121:0/1815783084 shutdown_connections 2023-08-18T20:44:37.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.171+0000 7f32ba71b700 1 -- 172.21.15.121:0/1815783084 wait complete. 2023-08-18T20:44:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.172+0000 7f32ba71b700 1 Processor -- start 2023-08-18T20:44:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 -- start start 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f329c004d90 0x7f32b41e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b40a63d0 0x7f32b40a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b406c520 con 0x7f32b406cf30 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b406c800 con 0x7f32b40a63d0 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32ba71b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b406cae0 con 0x7f329c004d90 2023-08-18T20:44:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32b37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32b37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41996/0 (socket says 172.21.15.121:41996) 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32b37fe700 1 -- 172.21.15.121:0/4150814940 learned_addr learned my addr 172.21.15.121:0/4150814940 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32b3fff700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f329c004d90 0x7f32b41e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.173+0000 7f32b8cb8700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b40a63d0 0x7f32b40a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 -- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f329c004d90 msgr2=0x7f32b41e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f329c004d90 0x7f32b41e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 -- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b40a63d0 msgr2=0x7f32b40a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b40a63d0 0x7f32b40a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 -- 172.21.15.121:0/4150814940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b41ec9b0 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b37fe700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000fb0 tx=0x7f32a400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012590 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a40126f0 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b406b710 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012aa0 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.174+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b40becc0 con 0x7f32b406cf30 2023-08-18T20:44:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.175+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b41ecba0 con 0x7f32b406cf30 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.175+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f32a4012c00 con 0x7f32b406cf30 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.176+0000 7f32b0ff9700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 0x7f32a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.176+0000 7f32b3fff700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 0x7f32a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.176+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32a4088220 con 0x7f32b406cf30 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.176+0000 7f32b3fff700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 0x7f32a006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32b40beba0 tx=0x7f32a8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.180+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f32a40539a0 con 0x7f32b406cf30 2023-08-18T20:44:37.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.415+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b406c660 con 0x7f32b406cf30 2023-08-18T20:44:37.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.416+0000 7f32b0ff9700 1 -- 172.21.15.121:0/4150814940 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4884 (secure 0 0 0) 0x7f32b406c660 con 0x7f32b406cf30 2023-08-18T20:44:37.416 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:37.416 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-18T20:44:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 msgr2=0x7f32a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 0x7f32a006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32b40beba0 tx=0x7f32a8009210 comp rx=0 tx=0).stop 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 msgr2=0x7f32b40c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000fb0 tx=0x7f32a400eaf0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 shutdown_connections 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b40a63d0 0x7f32b40a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f329c004d90 0x7f32b41e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f32a006a0e0 0x7f32a006c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 --2- 172.21.15.121:0/4150814940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32b406cf30 0x7f32b40c5bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 >> 172.21.15.121:0/4150814940 conn(0x7f32b40c7bf0 msgr2=0x7f32b40c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 shutdown_connections 2023-08-18T20:44:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.418+0000 7f32ba71b700 1 -- 172.21.15.121:0/4150814940 wait complete. 2023-08-18T20:44:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 15 2023-08-18T20:44:37.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:37.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.549+0000 7f8474ade700 1 Processor -- start 2023-08-18T20:44:37.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.549+0000 7f8474ade700 1 -- start start 2023-08-18T20:44:37.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f8474ade700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8470066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f8474ade700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847006cc30 con 0x7f84700c1030 2023-08-18T20:44:37.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f8474ade700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700c0b80 con 0x7f84700bf550 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f8474ade700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8470155260 con 0x7f84701518e0 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f846dd9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84700c1030 0x7f847006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48584/0 (socket says 172.21.15.121:48584) 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.550+0000 7f846dd9b700 1 -- 172.21.15.121:0/3764816848 learned_addr learned my addr 172.21.15.121:0/3764816848 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846e59c700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8470066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778430556 0 0) 0x7f847006cc30 con 0x7f84700c1030 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84580035b0 con 0x7f84700c1030 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405776353 0 0) 0x7f84580035b0 con 0x7f84700c1030 2023-08-18T20:44:37.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 msgr2=0x7f8470066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8470066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 >> v1:172.21.15.122:6789/0 conn(0x7f84700bf550 legacy=0x7f847015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847006ce80 con 0x7f84700c1030 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f84600017f0 con 0x7f84700c1030 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 >> v1:172.21.15.121:6789/0 conn(0x7f84700c1030 legacy=0x7f847006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8458003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8458003fe0 0x7f8458004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8458004d90 0x7f8458005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470155260 con 0x7f8458004d90 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845800bba0 con 0x7f8458003fe0 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845800bd30 con 0x7f84701518e0 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8458004d90 0x7f8458005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846e59c700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8458003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846dd9b700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8458003fe0 0x7f8458004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 -- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 msgr2=0x7f8458003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84701518e0 0x7f8458003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 -- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8458003fe0 msgr2=0x7f8458004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8458003fe0 0x7f8458004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.551+0000 7f846ed9d700 1 -- 172.21.15.121:0/3764816848 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580035b0 con 0x7f8458004d90 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f846ed9d700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8458004d90 0x7f8458005210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f846800c290 tx=0x7f8458005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d5507f2bde01a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468001e60 con 0x7f8458004d90 2023-08-18T20:44:37.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800cdf0 con 0x7f8458004d90 2023-08-18T20:44:37.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f846d59a700 1 -- 172.21.15.121:0/3764816848 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468012660 con 0x7f8458004d90 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 -- 172.21.15.121:0/3764816848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8458004d90 msgr2=0x7f8458005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 --2- 172.21.15.121:0/3764816848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8458004d90 0x7f8458005210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f846800c290 tx=0x7f8458005880 comp rx=0 tx=0).stop 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f846ed9d700 1 -- 172.21.15.121:0/3764816848 reap_dead start 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 -- 172.21.15.121:0/3764816848 shutdown_connections 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 -- 172.21.15.121:0/3764816848 >> 172.21.15.121:0/3764816848 conn(0x7f84700c2ca0 msgr2=0x7f84700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 -- 172.21.15.121:0/3764816848 shutdown_connections 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.552+0000 7f8474ade700 1 -- 172.21.15.121:0/3764816848 wait complete. 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 Processor -- start 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 -- start start 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 0x7f8470154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84700c59e0 0x7f84701ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700ab610 con 0x7f84701ed290 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700c4e70 con 0x7f84700c59e0 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.554+0000 7f8474ade700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847014bd60 con 0x7f8458004d90 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42018/0 (socket says 172.21.15.121:42018) 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 -- 172.21.15.121:0/4182170300 learned_addr learned my addr 172.21.15.121:0/4182170300 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846e59c700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 0x7f8470154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846dd9b700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84700c59e0 0x7f84701ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 -- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 msgr2=0x7f8470154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 0x7f8470154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 -- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84700c59e0 msgr2=0x7f84701ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84700c59e0 0x7f84701ecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 -- 172.21.15.121:0/4182170300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847014c040 con 0x7f84701ed290 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846e59c700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 0x7f8470154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f846ed9d700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f84580047a0 tx=0x7f8468001600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680050c0 con 0x7f84701ed290 2023-08-18T20:44:37.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468005220 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847014c320 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680055b0 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.555+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84700c5150 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.556+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847014c510 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.557+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8468023070 con 0x7f84701ed290 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.557+0000 7f845effd700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 0x7f845006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.557+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8468089d00 con 0x7f84701ed290 2023-08-18T20:44:37.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.557+0000 7f846e59c700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 0x7f845006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.557+0000 7f846e59c700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 0x7f845006c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8464009c60 tx=0x7f8464008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.561+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8468055480 con 0x7f84701ed290 2023-08-18T20:44:37.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.753+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8470074730 con 0x7f84701ed290 2023-08-18T20:44:37.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.754+0000 7f845effd700 1 -- 172.21.15.121:0/4182170300 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f8468058aa0 con 0x7f84701ed290 2023-08-18T20:44:37.754 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:37.755 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":33,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:35.014973+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:37.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 msgr2=0x7f845006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 0x7f845006c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8464009c60 tx=0x7f8464008040 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 msgr2=0x7f8470149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f84580047a0 tx=0x7f8468001600 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 shutdown_connections 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f845006a0e0 0x7f845006c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84701ed290 0x7f8470149d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8458004d90 0x7f8470154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 --2- 172.21.15.121:0/4182170300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84700c59e0 0x7f84701ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 >> 172.21.15.121:0/4182170300 conn(0x7f84700c2ca0 msgr2=0x7f84700c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 shutdown_connections 2023-08-18T20:44:37.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.756+0000 7f8474ade700 1 -- 172.21.15.121:0/4182170300 wait complete. 2023-08-18T20:44:37.769 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-18T20:44:37.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:37.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.888+0000 7fbba3d65700 1 Processor -- start 2023-08-18T20:44:37.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.888+0000 7fbba3d65700 1 -- start start 2023-08-18T20:44:37.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba3d65700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb9c14f9c0 0x7fbb9c0a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba3d65700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c152210 0x7fbb9c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba3d65700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c0a6270 con 0x7fbb9c0c6500 2023-08-18T20:44:37.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba3d65700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c0bbec0 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba3d65700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0a64a0 con 0x7fbb9c152210 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb9c14f9c0 0x7fbb9c0a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1300700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbb9c0c6500 0x7fbb9c06a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48604/0 (socket says 172.21.15.121:48604) 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1300700 1 -- 172.21.15.121:0/367721057 learned_addr learned my addr 172.21.15.121:0/367721057 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba2302700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c152210 0x7fbb9c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 -- 172.21.15.121:0/367721057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c152210 msgr2=0x7fbb9c1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c152210 0x7fbb9c1526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 -- 172.21.15.121:0/367721057 >> v1:172.21.15.121:6789/0 conn(0x7fbb9c0c6500 legacy=0x7fbb9c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 -- 172.21.15.121:0/367721057 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0bcb00 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.889+0000 7fbba1b01700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c14f9c0 0x7fbb9c0a5d30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009840 tx=0x7fbb8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efcf73107a14e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba0aff700 1 -- 172.21.15.121:0/367721057 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c011830 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba0aff700 1 -- 172.21.15.121:0/367721057 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c011990 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba0aff700 1 -- 172.21.15.121:0/367721057 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c011d20 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 -- 172.21.15.121:0/367721057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c14f9c0 msgr2=0x7fbb9c0a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c14f9c0 0x7fbb9c0a5d30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009840 tx=0x7fbb8c009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:37.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 -- 172.21.15.121:0/367721057 shutdown_connections 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c152210 0x7fbb9c1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 --2- 172.21.15.121:0/367721057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c14f9c0 0x7fbb9c0a5d30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 -- 172.21.15.121:0/367721057 >> 172.21.15.121:0/367721057 conn(0x7fbb9c0c35a0 msgr2=0x7fbb9c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 -- 172.21.15.121:0/367721057 shutdown_connections 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.890+0000 7fbba3d65700 1 -- 172.21.15.121:0/367721057 wait complete. 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.892+0000 7fbba3d65700 1 Processor -- start 2023-08-18T20:44:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.892+0000 7fbba3d65700 1 -- start start 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb9c0c6500 0x7fbb9c06dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c14f9c0 0x7fbb9c1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c146350 con 0x7fbb9c152210 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c14c3d0 con 0x7fbb9c0c6500 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c148630 con 0x7fbb9c14f9c0 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42032/0 (socket says 172.21.15.121:42032) 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 -- 172.21.15.121:0/373466023 learned_addr learned my addr 172.21.15.121:0/373466023 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba1300700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c14f9c0 0x7fbb9c1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba1b01700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb9c0c6500 0x7fbb9c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 -- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c14f9c0 msgr2=0x7fbb9c1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c14f9c0 0x7fbb9c1458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 -- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb9c0c6500 msgr2=0x7fbb9c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb9c0c6500 0x7fbb9c06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:37.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 -- 172.21.15.121:0/373466023 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0094a0 con 0x7fbb9c152210 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba2302700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400cc30 tx=0x7fbb9400a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9400ab70 con 0x7fbb9c152210 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9400acd0 con 0x7fbb9c152210 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c1e7ad0 con 0x7fbb9c152210 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94003c40 con 0x7fbb9c152210 2023-08-18T20:44:37.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.893+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c148b60 con 0x7fbb9c152210 2023-08-18T20:44:37.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.894+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c074730 con 0x7fbb9c152210 2023-08-18T20:44:37.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.895+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb9400f3f0 con 0x7fbb9c152210 2023-08-18T20:44:37.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.895+0000 7fbb927fc700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 0x7fbb8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:37.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.895+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb940886c0 con 0x7fbb9c152210 2023-08-18T20:44:37.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.895+0000 7fbba1b01700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 0x7fbb8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:37.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.895+0000 7fbba1b01700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 0x7fbb8006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0090b0 tx=0x7fbb8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:37.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:37.899+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbb94053e40 con 0x7fbb9c152210 2023-08-18T20:44:37.987 INFO:tasks.ceph.mds.c.smithi121.stderr:2023-08-18T20:44:37.987+0000 7f43faa31700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:44:38.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.086+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb9c0bd0c0 con 0x7fbb8006a0e0 2023-08-18T20:44:38.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.094+0000 7fbb927fc700 1 -- 172.21.15.121:0/373466023 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293033 (secure 0 0 0) 0x7fbb8c011750 con 0x7fbb8006a0e0 2023-08-18T20:44:38.099 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:38.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 msgr2=0x7fbb8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 0x7fbb8006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0090b0 tx=0x7fbb8c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:38.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 msgr2=0x7fbb9c145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400cc30 tx=0x7fbb9400a1f0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 shutdown_connections 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbb8006a0e0 0x7fbb8006c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb9c152210 0x7fbb9c145e10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb9c0c6500 0x7fbb9c06dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 --2- 172.21.15.121:0/373466023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb9c14f9c0 0x7fbb9c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 >> 172.21.15.121:0/373466023 conn(0x7fbb9c0c35a0 msgr2=0x7fbb9c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:38.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 shutdown_connections 2023-08-18T20:44:38.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.098+0000 7fbba3d65700 1 -- 172.21.15.121:0/373466023 wait complete. 2023-08-18T20:44:38.103 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:38.110 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-08-18T20:44:36.923890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220248,"kb_used_data":4044,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754472,"statfs":{"total":773094113280,"available":772868579328,"internally_reserved":0,"allocated":4141056,"data_stored":2346923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925585"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185240+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:35.185240+0000","last_peered":"2023-08-18T20:44:35.185240+0000","last_clean":"2023-08-18T20:44:35.185240+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:35.185240+0000","last_undegraded":"2023-08-18T20:44:35.185240+0000","last_fullsized":"2023-08-18T20:44:35.185240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185015+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:35.185015+0000","last_peered":"2023-08-18T20:44:35.185015+0000","last_clean":"2023-08-18T20:44:35.185015+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:35.185015+0000","last_undegraded":"2023-08-18T20:44:35.185015+0000","last_fullsized":"2023-08-18T20:44:35.185015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:32:32.700486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685832+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:35.685832+0000","last_peered":"2023-08-18T20:44:35.685832+0000","last_clean":"2023-08-18T20:44:35.685832+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:35.685832+0000","last_undegraded":"2023-08-18T20:44:35.685832+0000","last_fullsized":"2023-08-18T20:44:35.685832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021152+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:35.021152+0000","last_peered":"2023-08-18T20:44:35.021152+0000","last_clean":"2023-08-18T20:44:35.021152+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:35.021152+0000","last_undegraded":"2023-08-18T20:44:35.021152+0000","last_fullsized":"2023-08-18T20:44:35.021152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:12:08.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021125+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:35.021125+0000","last_peered":"2023-08-18T20:44:35.021125+0000","last_clean":"2023-08-18T20:44:35.021125+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:35.021125+0000","last_undegraded":"2023-08-18T20:44:35.021125+0000","last_fullsized":"2023-08-18T20:44:35.021125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:32.258779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685871+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:35.685871+0000","last_peered":"2023-08-18T20:44:35.685871+0000","last_clean":"2023-08-18T20:44:35.685871+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:35.685871+0000","last_undegraded":"2023-08-18T20:44:35.685871+0000","last_fullsized":"2023-08-18T20:44:35.685871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:45.836631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184860+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:35.184860+0000","last_peered":"2023-08-18T20:44:35.184860+0000","last_clean":"2023-08-18T20:44:35.184860+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:35.184860+0000","last_undegraded":"2023-08-18T20:44:35.184860+0000","last_fullsized":"2023-08-18T20:44:35.184860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685874+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:35.685874+0000","last_peered":"2023-08-18T20:44:35.685874+0000","last_clean":"2023-08-18T20:44:35.685874+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:35.685874+0000","last_undegraded":"2023-08-18T20:44:35.685874+0000","last_fullsized":"2023-08-18T20:44:35.685874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021908+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:35.021908+0000","last_peered":"2023-08-18T20:44:35.021908+0000","last_clean":"2023-08-18T20:44:35.021908+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.021908+0000","last_undegraded":"2023-08-18T20:44:35.021908+0000","last_fullsized":"2023-08-18T20:44:35.021908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:02:17.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021948+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:35.021948+0000","last_peered":"2023-08-18T20:44:35.021948+0000","last_clean":"2023-08-18T20:44:35.021948+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:35.021948+0000","last_undegraded":"2023-08-18T20:44:35.021948+0000","last_fullsized":"2023-08-18T20:44:35.021948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:54.989567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685639+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:35.685639+0000","last_peered":"2023-08-18T20:44:35.685639+0000","last_clean":"2023-08-18T20:44:35.685639+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:35.685639+0000","last_undegraded":"2023-08-18T20:44:35.685639+0000","last_fullsized":"2023-08-18T20:44:35.685639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:13.931577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021695+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:35.021695+0000","last_peered":"2023-08-18T20:44:35.021695+0000","last_clean":"2023-08-18T20:44:35.021695+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:35.021695+0000","last_undegraded":"2023-08-18T20:44:35.021695+0000","last_fullsized":"2023-08-18T20:44:35.021695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:04:24.273971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686127+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:35.686127+0000","last_peered":"2023-08-18T20:44:35.686127+0000","last_clean":"2023-08-18T20:44:35.686127+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:35.686127+0000","last_undegraded":"2023-08-18T20:44:35.686127+0000","last_fullsized":"2023-08-18T20:44:35.686127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:16.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022446+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:35.022446+0000","last_peered":"2023-08-18T20:44:35.022446+0000","last_clean":"2023-08-18T20:44:35.022446+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:35.022446+0000","last_undegraded":"2023-08-18T20:44:35.022446+0000","last_fullsized":"2023-08-18T20:44:35.022446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:49:17.166598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673718+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:35.673718+0000","last_peered":"2023-08-18T20:44:35.673718+0000","last_clean":"2023-08-18T20:44:35.673718+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:35.673718+0000","last_undegraded":"2023-08-18T20:44:35.673718+0000","last_fullsized":"2023-08-18T20:44:35.673718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674256+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:35.674256+0000","last_peered":"2023-08-18T20:44:35.674256+0000","last_clean":"2023-08-18T20:44:35.674256+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:35.674256+0000","last_undegraded":"2023-08-18T20:44:35.674256+0000","last_fullsized":"2023-08-18T20:44:35.674256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:07.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021198+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:35.021198+0000","last_peered":"2023-08-18T20:44:35.021198+0000","last_clean":"2023-08-18T20:44:35.021198+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:35.021198+0000","last_undegraded":"2023-08-18T20:44:35.021198+0000","last_fullsized":"2023-08-18T20:44:35.021198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:14.550052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022431+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:35.022431+0000","last_peered":"2023-08-18T20:44:35.022431+0000","last_clean":"2023-08-18T20:44:35.022431+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:35.022431+0000","last_undegraded":"2023-08-18T20:44:35.022431+0000","last_fullsized":"2023-08-18T20:44:35.022431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022047+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:35.022047+0000","last_peered":"2023-08-18T20:44:35.022047+0000","last_clean":"2023-08-18T20:44:35.022047+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:35.022047+0000","last_undegraded":"2023-08-18T20:44:35.022047+0000","last_fullsized":"2023-08-18T20:44:35.022047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:55.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686144+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:35.686144+0000","last_peered":"2023-08-18T20:44:35.686144+0000","last_clean":"2023-08-18T20:44:35.686144+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:35.686144+0000","last_undegraded":"2023-08-18T20:44:35.686144+0000","last_fullsized":"2023-08-18T20:44:35.686144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:12:36.239200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673869+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:35.673869+0000","last_peered":"2023-08-18T20:44:35.673869+0000","last_clean":"2023-08-18T20:44:35.673869+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:35.673869+0000","last_undegraded":"2023-08-18T20:44:35.673869+0000","last_fullsized":"2023-08-18T20:44:35.673869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021052+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:35.021052+0000","last_peered":"2023-08-18T20:44:35.021052+0000","last_clean":"2023-08-18T20:44:35.021052+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:35.021052+0000","last_undegraded":"2023-08-18T20:44:35.021052+0000","last_fullsized":"2023-08-18T20:44:35.021052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:10:15.545511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022784+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:35.022784+0000","last_peered":"2023-08-18T20:44:35.022784+0000","last_clean":"2023-08-18T20:44:35.022784+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:35.022784+0000","last_undegraded":"2023-08-18T20:44:35.022784+0000","last_fullsized":"2023-08-18T20:44:35.022784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:36.826792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686401+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:35.686401+0000","last_peered":"2023-08-18T20:44:35.686401+0000","last_clean":"2023-08-18T20:44:35.686401+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:35.686401+0000","last_undegraded":"2023-08-18T20:44:35.686401+0000","last_fullsized":"2023-08-18T20:44:35.686401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022572+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:35.022572+0000","last_peered":"2023-08-18T20:44:35.022572+0000","last_clean":"2023-08-18T20:44:35.022572+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:35.022572+0000","last_undegraded":"2023-08-18T20:44:35.022572+0000","last_fullsized":"2023-08-18T20:44:35.022572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021715+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:35.021715+0000","last_peered":"2023-08-18T20:44:35.021715+0000","last_clean":"2023-08-18T20:44:35.021715+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:35.021715+0000","last_undegraded":"2023-08-18T20:44:35.021715+0000","last_fullsized":"2023-08-18T20:44:35.021715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:37.673955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022145+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:35.022145+0000","last_peered":"2023-08-18T20:44:35.022145+0000","last_clean":"2023-08-18T20:44:35.022145+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:35.022145+0000","last_undegraded":"2023-08-18T20:44:35.022145+0000","last_fullsized":"2023-08-18T20:44:35.022145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022178+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:35.022178+0000","last_peered":"2023-08-18T20:44:35.022178+0000","last_clean":"2023-08-18T20:44:35.022178+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:35.022178+0000","last_undegraded":"2023-08-18T20:44:35.022178+0000","last_fullsized":"2023-08-18T20:44:35.022178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673985+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:35.673985+0000","last_peered":"2023-08-18T20:44:35.673985+0000","last_clean":"2023-08-18T20:44:35.673985+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:35.673985+0000","last_undegraded":"2023-08-18T20:44:35.673985+0000","last_fullsized":"2023-08-18T20:44:35.673985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685586+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:35.685586+0000","last_peered":"2023-08-18T20:44:35.685586+0000","last_clean":"2023-08-18T20:44:35.685586+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:35.685586+0000","last_undegraded":"2023-08-18T20:44:35.685586+0000","last_fullsized":"2023-08-18T20:44:35.685586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674105+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:35.674105+0000","last_peered":"2023-08-18T20:44:35.674105+0000","last_clean":"2023-08-18T20:44:35.674105+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:35.674105+0000","last_undegraded":"2023-08-18T20:44:35.674105+0000","last_fullsized":"2023-08-18T20:44:35.674105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:35.381650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022926+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:35.022926+0000","last_peered":"2023-08-18T20:44:35.022926+0000","last_clean":"2023-08-18T20:44:35.022926+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:35.022926+0000","last_undegraded":"2023-08-18T20:44:35.022926+0000","last_fullsized":"2023-08-18T20:44:35.022926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:39.803589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686382+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:35.686382+0000","last_peered":"2023-08-18T20:44:35.686382+0000","last_clean":"2023-08-18T20:44:35.686382+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:35.686382+0000","last_undegraded":"2023-08-18T20:44:35.686382+0000","last_fullsized":"2023-08-18T20:44:35.686382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:40.808594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686216+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:35.686216+0000","last_peered":"2023-08-18T20:44:35.686216+0000","last_clean":"2023-08-18T20:44:35.686216+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:35.686216+0000","last_undegraded":"2023-08-18T20:44:35.686216+0000","last_fullsized":"2023-08-18T20:44:35.686216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:47.071148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686446+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:35.686446+0000","last_peered":"2023-08-18T20:44:35.686446+0000","last_clean":"2023-08-18T20:44:35.686446+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:35.686446+0000","last_undegraded":"2023-08-18T20:44:35.686446+0000","last_fullsized":"2023-08-18T20:44:35.686446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:57:06.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686469+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:35.686469+0000","last_peered":"2023-08-18T20:44:35.686469+0000","last_clean":"2023-08-18T20:44:35.686469+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:35.686469+0000","last_undegraded":"2023-08-18T20:44:35.686469+0000","last_fullsized":"2023-08-18T20:44:35.686469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:11:37.290795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185136+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:35.185136+0000","last_peered":"2023-08-18T20:44:35.185136+0000","last_clean":"2023-08-18T20:44:35.185136+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:35.185136+0000","last_undegraded":"2023-08-18T20:44:35.185136+0000","last_fullsized":"2023-08-18T20:44:35.185136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:23.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686474+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:35.686474+0000","last_peered":"2023-08-18T20:44:35.686474+0000","last_clean":"2023-08-18T20:44:35.686474+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:35.686474+0000","last_undegraded":"2023-08-18T20:44:35.686474+0000","last_fullsized":"2023-08-18T20:44:35.686474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.149467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685538+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:35.685538+0000","last_peered":"2023-08-18T20:44:35.685538+0000","last_clean":"2023-08-18T20:44:35.685538+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:35.685538+0000","last_undegraded":"2023-08-18T20:44:35.685538+0000","last_fullsized":"2023-08-18T20:44:35.685538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:12:44.118040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021626+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:35.021626+0000","last_peered":"2023-08-18T20:44:35.021626+0000","last_clean":"2023-08-18T20:44:35.021626+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:35.021626+0000","last_undegraded":"2023-08-18T20:44:35.021626+0000","last_fullsized":"2023-08-18T20:44:35.021626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:02.246115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022453+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:35.022453+0000","last_peered":"2023-08-18T20:44:35.022453+0000","last_clean":"2023-08-18T20:44:35.022453+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:35.022453+0000","last_undegraded":"2023-08-18T20:44:35.022453+0000","last_fullsized":"2023-08-18T20:44:35.022453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:00:07.822682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674020+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:35.674020+0000","last_peered":"2023-08-18T20:44:35.674020+0000","last_clean":"2023-08-18T20:44:35.674020+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:35.674020+0000","last_undegraded":"2023-08-18T20:44:35.674020+0000","last_fullsized":"2023-08-18T20:44:35.674020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:22.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686345+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:35.686345+0000","last_peered":"2023-08-18T20:44:35.686345+0000","last_clean":"2023-08-18T20:44:35.686345+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:35.686345+0000","last_undegraded":"2023-08-18T20:44:35.686345+0000","last_fullsized":"2023-08-18T20:44:35.686345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:08:58.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686171+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:35.686171+0000","last_peered":"2023-08-18T20:44:35.686171+0000","last_clean":"2023-08-18T20:44:35.686171+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:35.686171+0000","last_undegraded":"2023-08-18T20:44:35.686171+0000","last_fullsized":"2023-08-18T20:44:35.686171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:38.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185127+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:35.185127+0000","last_peered":"2023-08-18T20:44:35.185127+0000","last_clean":"2023-08-18T20:44:35.185127+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:35.185127+0000","last_undegraded":"2023-08-18T20:44:35.185127+0000","last_fullsized":"2023-08-18T20:44:35.185127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.810386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686003+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:35.686003+0000","last_peered":"2023-08-18T20:44:35.686003+0000","last_clean":"2023-08-18T20:44:35.686003+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:35.686003+0000","last_undegraded":"2023-08-18T20:44:35.686003+0000","last_fullsized":"2023-08-18T20:44:35.686003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:29.096868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021269+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:35.021269+0000","last_peered":"2023-08-18T20:44:35.021269+0000","last_clean":"2023-08-18T20:44:35.021269+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:35.021269+0000","last_undegraded":"2023-08-18T20:44:35.021269+0000","last_fullsized":"2023-08-18T20:44:35.021269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:10:19.922914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185223+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:35.185223+0000","last_peered":"2023-08-18T20:44:35.185223+0000","last_clean":"2023-08-18T20:44:35.185223+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:35.185223+0000","last_undegraded":"2023-08-18T20:44:35.185223+0000","last_fullsized":"2023-08-18T20:44:35.185223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:37.595262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674145+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:35.674145+0000","last_peered":"2023-08-18T20:44:35.674145+0000","last_clean":"2023-08-18T20:44:35.674145+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:35.674145+0000","last_undegraded":"2023-08-18T20:44:35.674145+0000","last_fullsized":"2023-08-18T20:44:35.674145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:38.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021526+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:35.021526+0000","last_peered":"2023-08-18T20:44:35.021526+0000","last_clean":"2023-08-18T20:44:35.021526+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:35.021526+0000","last_undegraded":"2023-08-18T20:44:35.021526+0000","last_fullsized":"2023-08-18T20:44:35.021526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:30:54.763621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686136+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:35.686136+0000","last_peered":"2023-08-18T20:44:35.686136+0000","last_clean":"2023-08-18T20:44:35.686136+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:35.686136+0000","last_undegraded":"2023-08-18T20:44:35.686136+0000","last_fullsized":"2023-08-18T20:44:35.686136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022064+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:35.022064+0000","last_peered":"2023-08-18T20:44:35.022064+0000","last_clean":"2023-08-18T20:44:35.022064+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:35.022064+0000","last_undegraded":"2023-08-18T20:44:35.022064+0000","last_fullsized":"2023-08-18T20:44:35.022064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:21:05.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686532+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:35.686532+0000","last_peered":"2023-08-18T20:44:35.686532+0000","last_clean":"2023-08-18T20:44:35.686532+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:35.686532+0000","last_undegraded":"2023-08-18T20:44:35.686532+0000","last_fullsized":"2023-08-18T20:44:35.686532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:41:34.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185202+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:35.185202+0000","last_peered":"2023-08-18T20:44:35.185202+0000","last_clean":"2023-08-18T20:44:35.185202+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:35.185202+0000","last_undegraded":"2023-08-18T20:44:35.185202+0000","last_fullsized":"2023-08-18T20:44:35.185202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:34.376644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686047+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:35.686047+0000","last_peered":"2023-08-18T20:44:35.686047+0000","last_clean":"2023-08-18T20:44:35.686047+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:35.686047+0000","last_undegraded":"2023-08-18T20:44:35.686047+0000","last_fullsized":"2023-08-18T20:44:35.686047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185166+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:35.185166+0000","last_peered":"2023-08-18T20:44:35.185166+0000","last_clean":"2023-08-18T20:44:35.185166+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:35.185166+0000","last_undegraded":"2023-08-18T20:44:35.185166+0000","last_fullsized":"2023-08-18T20:44:35.185166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184870+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:35.184870+0000","last_peered":"2023-08-18T20:44:35.184870+0000","last_clean":"2023-08-18T20:44:35.184870+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:35.184870+0000","last_undegraded":"2023-08-18T20:44:35.184870+0000","last_fullsized":"2023-08-18T20:44:35.184870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:12.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673788+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:35.673788+0000","last_peered":"2023-08-18T20:44:35.673788+0000","last_clean":"2023-08-18T20:44:35.673788+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:35.673788+0000","last_undegraded":"2023-08-18T20:44:35.673788+0000","last_fullsized":"2023-08-18T20:44:35.673788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022202+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:35.022202+0000","last_peered":"2023-08-18T20:44:35.022202+0000","last_clean":"2023-08-18T20:44:35.022202+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:35.022202+0000","last_undegraded":"2023-08-18T20:44:35.022202+0000","last_fullsized":"2023-08-18T20:44:35.022202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:00.662486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184974+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:35.184974+0000","last_peered":"2023-08-18T20:44:35.184974+0000","last_clean":"2023-08-18T20:44:35.184974+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:35.184974+0000","last_undegraded":"2023-08-18T20:44:35.184974+0000","last_fullsized":"2023-08-18T20:44:35.184974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673938+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:35.673938+0000","last_peered":"2023-08-18T20:44:35.673938+0000","last_clean":"2023-08-18T20:44:35.673938+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:35.673938+0000","last_undegraded":"2023-08-18T20:44:35.673938+0000","last_fullsized":"2023-08-18T20:44:35.673938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:14.990143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185084+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:35.185084+0000","last_peered":"2023-08-18T20:44:35.185084+0000","last_clean":"2023-08-18T20:44:35.185084+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:35.185084+0000","last_undegraded":"2023-08-18T20:44:35.185084+0000","last_fullsized":"2023-08-18T20:44:35.185084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:15.995149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021905+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:35.021905+0000","last_peered":"2023-08-18T20:44:35.021905+0000","last_clean":"2023-08-18T20:44:35.021905+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:35.021905+0000","last_undegraded":"2023-08-18T20:44:35.021905+0000","last_fullsized":"2023-08-18T20:44:35.021905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:28.147788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021887+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:35.021887+0000","last_peered":"2023-08-18T20:44:35.021887+0000","last_clean":"2023-08-18T20:44:35.021887+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:35.021887+0000","last_undegraded":"2023-08-18T20:44:35.021887+0000","last_fullsized":"2023-08-18T20:44:35.021887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:14.155493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686553+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:35.686553+0000","last_peered":"2023-08-18T20:44:35.686553+0000","last_clean":"2023-08-18T20:44:35.686553+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:35.686553+0000","last_undegraded":"2023-08-18T20:44:35.686553+0000","last_fullsized":"2023-08-18T20:44:35.686553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:15:21.504162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686429+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:35.686429+0000","last_peered":"2023-08-18T20:44:35.686429+0000","last_clean":"2023-08-18T20:44:35.686429+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:35.686429+0000","last_undegraded":"2023-08-18T20:44:35.686429+0000","last_fullsized":"2023-08-18T20:44:35.686429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:40.068512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021296+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:35.021296+0000","last_peered":"2023-08-18T20:44:35.021296+0000","last_clean":"2023-08-18T20:44:35.021296+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:35.021296+0000","last_undegraded":"2023-08-18T20:44:35.021296+0000","last_fullsized":"2023-08-18T20:44:35.021296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:47.584015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021527+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:35.021527+0000","last_peered":"2023-08-18T20:44:35.021527+0000","last_clean":"2023-08-18T20:44:35.021527+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:35.021527+0000","last_undegraded":"2023-08-18T20:44:35.021527+0000","last_fullsized":"2023-08-18T20:44:35.021527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:19:55.961983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686207+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:35.686207+0000","last_peered":"2023-08-18T20:44:35.686207+0000","last_clean":"2023-08-18T20:44:35.686207+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:35.686207+0000","last_undegraded":"2023-08-18T20:44:35.686207+0000","last_fullsized":"2023-08-18T20:44:35.686207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:35.821786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673775+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:35.673775+0000","last_peered":"2023-08-18T20:44:35.673775+0000","last_clean":"2023-08-18T20:44:35.673775+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:35.673775+0000","last_undegraded":"2023-08-18T20:44:35.673775+0000","last_fullsized":"2023-08-18T20:44:35.673775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021160+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:35.021160+0000","last_peered":"2023-08-18T20:44:35.021160+0000","last_clean":"2023-08-18T20:44:35.021160+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:35.021160+0000","last_undegraded":"2023-08-18T20:44:35.021160+0000","last_fullsized":"2023-08-18T20:44:35.021160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:54:26.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685666+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:35.685666+0000","last_peered":"2023-08-18T20:44:35.685666+0000","last_clean":"2023-08-18T20:44:35.685666+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:35.685666+0000","last_undegraded":"2023-08-18T20:44:35.685666+0000","last_fullsized":"2023-08-18T20:44:35.685666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:13.854640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021094+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:35.021094+0000","last_peered":"2023-08-18T20:44:35.021094+0000","last_clean":"2023-08-18T20:44:35.021094+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:35.021094+0000","last_undegraded":"2023-08-18T20:44:35.021094+0000","last_fullsized":"2023-08-18T20:44:35.021094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:19:26.408213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021423+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:35.021423+0000","last_peered":"2023-08-18T20:44:35.021423+0000","last_clean":"2023-08-18T20:44:35.021423+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:35.021423+0000","last_undegraded":"2023-08-18T20:44:35.021423+0000","last_fullsized":"2023-08-18T20:44:35.021423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:14:20.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674039+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:35.674039+0000","last_peered":"2023-08-18T20:44:35.674039+0000","last_clean":"2023-08-18T20:44:35.674039+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:35.674039+0000","last_undegraded":"2023-08-18T20:44:35.674039+0000","last_fullsized":"2023-08-18T20:44:35.674039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185023+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:35.185023+0000","last_peered":"2023-08-18T20:44:35.185023+0000","last_clean":"2023-08-18T20:44:35.185023+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.185023+0000","last_undegraded":"2023-08-18T20:44:35.185023+0000","last_fullsized":"2023-08-18T20:44:35.185023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021190+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:35.021190+0000","last_peered":"2023-08-18T20:44:35.021190+0000","last_clean":"2023-08-18T20:44:35.021190+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:35.021190+0000","last_undegraded":"2023-08-18T20:44:35.021190+0000","last_fullsized":"2023-08-18T20:44:35.021190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:08:53.195511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686364+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:35.686364+0000","last_peered":"2023-08-18T20:44:35.686364+0000","last_clean":"2023-08-18T20:44:35.686364+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:35.686364+0000","last_undegraded":"2023-08-18T20:44:35.686364+0000","last_fullsized":"2023-08-18T20:44:35.686364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:12.619573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686008+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:35.686008+0000","last_peered":"2023-08-18T20:44:35.686008+0000","last_clean":"2023-08-18T20:44:35.686008+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:35.686008+0000","last_undegraded":"2023-08-18T20:44:35.686008+0000","last_fullsized":"2023-08-18T20:44:35.686008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:42.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686388+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:35.686388+0000","last_peered":"2023-08-18T20:44:35.686388+0000","last_clean":"2023-08-18T20:44:35.686388+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:35.686388+0000","last_undegraded":"2023-08-18T20:44:35.686388+0000","last_fullsized":"2023-08-18T20:44:35.686388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:58:22.457124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674165+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:35.674165+0000","last_peered":"2023-08-18T20:44:35.674165+0000","last_clean":"2023-08-18T20:44:35.674165+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:35.674165+0000","last_undegraded":"2023-08-18T20:44:35.674165+0000","last_fullsized":"2023-08-18T20:44:35.674165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185235+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:35.185235+0000","last_peered":"2023-08-18T20:44:35.185235+0000","last_clean":"2023-08-18T20:44:35.185235+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:35.185235+0000","last_undegraded":"2023-08-18T20:44:35.185235+0000","last_fullsized":"2023-08-18T20:44:35.185235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185250+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:35.185250+0000","last_peered":"2023-08-18T20:44:35.185250+0000","last_clean":"2023-08-18T20:44:35.185250+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:35.185250+0000","last_undegraded":"2023-08-18T20:44:35.185250+0000","last_fullsized":"2023-08-18T20:44:35.185250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686101+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:35.686101+0000","last_peered":"2023-08-18T20:44:35.686101+0000","last_clean":"2023-08-18T20:44:35.686101+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:35.686101+0000","last_undegraded":"2023-08-18T20:44:35.686101+0000","last_fullsized":"2023-08-18T20:44:35.686101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022060+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:35.022060+0000","last_peered":"2023-08-18T20:44:35.022060+0000","last_clean":"2023-08-18T20:44:35.022060+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:35.022060+0000","last_undegraded":"2023-08-18T20:44:35.022060+0000","last_fullsized":"2023-08-18T20:44:35.022060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:25.883578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685950+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:35.685950+0000","last_peered":"2023-08-18T20:44:35.685950+0000","last_clean":"2023-08-18T20:44:35.685950+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:35.685950+0000","last_undegraded":"2023-08-18T20:44:35.685950+0000","last_fullsized":"2023-08-18T20:44:35.685950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:35.317206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674171+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:35.674171+0000","last_peered":"2023-08-18T20:44:35.674171+0000","last_clean":"2023-08-18T20:44:35.674171+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:35.674171+0000","last_undegraded":"2023-08-18T20:44:35.674171+0000","last_fullsized":"2023-08-18T20:44:35.674171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674222+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:35.674222+0000","last_peered":"2023-08-18T20:44:35.674222+0000","last_clean":"2023-08-18T20:44:35.674222+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:35.674222+0000","last_undegraded":"2023-08-18T20:44:35.674222+0000","last_fullsized":"2023-08-18T20:44:35.674222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:15:17.512476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021406+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:35.021406+0000","last_peered":"2023-08-18T20:44:35.021406+0000","last_clean":"2023-08-18T20:44:35.021406+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:35.021406+0000","last_undegraded":"2023-08-18T20:44:35.021406+0000","last_fullsized":"2023-08-18T20:44:35.021406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:50.840801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673769+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:35.673769+0000","last_peered":"2023-08-18T20:44:35.673769+0000","last_clean":"2023-08-18T20:44:35.673769+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:35.673769+0000","last_undegraded":"2023-08-18T20:44:35.673769+0000","last_fullsized":"2023-08-18T20:44:35.673769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:31:37.239696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022154+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:35.022154+0000","last_peered":"2023-08-18T20:44:35.022154+0000","last_clean":"2023-08-18T20:44:35.022154+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:35.022154+0000","last_undegraded":"2023-08-18T20:44:35.022154+0000","last_fullsized":"2023-08-18T20:44:35.022154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:16:09.185476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674089+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:35.674089+0000","last_peered":"2023-08-18T20:44:35.674089+0000","last_clean":"2023-08-18T20:44:35.674089+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:35.674089+0000","last_undegraded":"2023-08-18T20:44:35.674089+0000","last_fullsized":"2023-08-18T20:44:35.674089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673943+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:35.673943+0000","last_peered":"2023-08-18T20:44:35.673943+0000","last_clean":"2023-08-18T20:44:35.673943+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:35.673943+0000","last_undegraded":"2023-08-18T20:44:35.673943+0000","last_fullsized":"2023-08-18T20:44:35.673943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:06.349596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185071+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:35.185071+0000","last_peered":"2023-08-18T20:44:35.185071+0000","last_clean":"2023-08-18T20:44:35.185071+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:35.185071+0000","last_undegraded":"2023-08-18T20:44:35.185071+0000","last_fullsized":"2023-08-18T20:44:35.185071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685907+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:35.685907+0000","last_peered":"2023-08-18T20:44:35.685907+0000","last_clean":"2023-08-18T20:44:35.685907+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:35.685907+0000","last_undegraded":"2023-08-18T20:44:35.685907+0000","last_fullsized":"2023-08-18T20:44:35.685907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022546+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:35.022546+0000","last_peered":"2023-08-18T20:44:35.022546+0000","last_clean":"2023-08-18T20:44:35.022546+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:35.022546+0000","last_undegraded":"2023-08-18T20:44:35.022546+0000","last_fullsized":"2023-08-18T20:44:35.022546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:11:54.581845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686137+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:35.686137+0000","last_peered":"2023-08-18T20:44:35.686137+0000","last_clean":"2023-08-18T20:44:35.686137+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:35.686137+0000","last_undegraded":"2023-08-18T20:44:35.686137+0000","last_fullsized":"2023-08-18T20:44:35.686137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022271+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:35.022271+0000","last_peered":"2023-08-18T20:44:35.022271+0000","last_clean":"2023-08-18T20:44:35.022271+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:35.022271+0000","last_undegraded":"2023-08-18T20:44:35.022271+0000","last_fullsized":"2023-08-18T20:44:35.022271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022591+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:35.022591+0000","last_peered":"2023-08-18T20:44:35.022591+0000","last_clean":"2023-08-18T20:44:35.022591+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:35.022591+0000","last_undegraded":"2023-08-18T20:44:35.022591+0000","last_fullsized":"2023-08-18T20:44:35.022591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:22:33.873991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685753+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:35.685753+0000","last_peered":"2023-08-18T20:44:35.685753+0000","last_clean":"2023-08-18T20:44:35.685753+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:35.685753+0000","last_undegraded":"2023-08-18T20:44:35.685753+0000","last_fullsized":"2023-08-18T20:44:35.685753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:45.828686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.023009+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:35.023009+0000","last_peered":"2023-08-18T20:44:35.023009+0000","last_clean":"2023-08-18T20:44:35.023009+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:35.023009+0000","last_undegraded":"2023-08-18T20:44:35.023009+0000","last_fullsized":"2023-08-18T20:44:35.023009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:10:42.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":734726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.73999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":143258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":733134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":142710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":149399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":150975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.68200000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":143280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:38.118 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.269+0000 7fe5055b6700 1 Processor -- start 2023-08-18T20:44:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.269+0000 7fe5055b6700 1 -- start start 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe5055b6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe5000c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe5055b6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe5000c1b10 0x7fe5000c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe5055b6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5000c4f40 con 0x7fe5000c0c50 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe5055b6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5000c5e50 con 0x7fe5000c1b10 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe5055b6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000c6120 con 0x7fe5000a6290 2023-08-18T20:44:38.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4feffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe5000c0c50 0x7fe50006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48618/0 (socket says 172.21.15.121:48618) 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4feffd700 1 -- 172.21.15.121:0/4223658659 learned_addr learned my addr 172.21.15.121:0/4223658659 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4fe7fc700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe5000c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4ff7fe700 1 --2- 172.21.15.121:0/4223658659 >> v2:172.21.15.122:3300/0 conn(0x7fe5000c1b10 0x7fe5000c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482753556 0 0) 0x7fe5000c4f40 con 0x7fe5000c0c50 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.270+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e80035b0 con 0x7fe5000c0c50 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936808564 0 0) 0x7fe4e80035b0 con 0x7fe5000c0c50 2023-08-18T20:44:38.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 msgr2=0x7fe5000c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe5000c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 >> v2:172.21.15.122:3300/0 conn(0x7fe5000c1b10 msgr2=0x7fe5000c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 --2- 172.21.15.121:0/4223658659 >> v2:172.21.15.122:3300/0 conn(0x7fe5000c1b10 0x7fe5000c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5001551f0 con 0x7fe5000c0c50 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fe4f4001670 con 0x7fe5000c0c50 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 >> v1:172.21.15.121:6789/0 conn(0x7fe5000c0c50 legacy=0x7fe50006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4e8003a70 0x7fe4e8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe4e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4e8004d90 0x7fe4e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000c5e50 con 0x7fe4e8003a70 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000c6120 con 0x7fe4e8004d90 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e800ba10 con 0x7fe5000a6290 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4e8003a70 0x7fe4e8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fe7fc700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe4e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4ff7fe700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4e8004d90 0x7fe4e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 -- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 msgr2=0x7fe4e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5000a6290 0x7fe4e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 -- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4e8004d90 msgr2=0x7fe4e8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4e8004d90 0x7fe4e8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 -- 172.21.15.121:0/4223658659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80035b0 con 0x7fe4e8003a70 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4feffd700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4e8003a70 0x7fe4e8003e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c320 tx=0x7fe4e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3606875a75272a60 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400ce60 con 0x7fe4e8003a70 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f4005960 con 0x7fe4e8003a70 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.271+0000 7fe4fdffb700 1 -- 172.21.15.121:0/4223658659 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4005cf0 con 0x7fe4e8003a70 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 -- 172.21.15.121:0/4223658659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4e8003a70 msgr2=0x7fe4e8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 --2- 172.21.15.121:0/4223658659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4e8003a70 0x7fe4e8003e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c320 tx=0x7fe4e8005880 comp rx=0 tx=0).stop 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe4ff7fe700 1 -- 172.21.15.121:0/4223658659 reap_dead start 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 -- 172.21.15.121:0/4223658659 shutdown_connections 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 -- 172.21.15.121:0/4223658659 >> 172.21.15.121:0/4223658659 conn(0x7fe5000c6b10 msgr2=0x7fe5000c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 -- 172.21.15.121:0/4223658659 shutdown_connections 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.272+0000 7fe5055b6700 1 -- 172.21.15.121:0/4223658659 wait complete. 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.273+0000 7fe5055b6700 1 Processor -- start 2023-08-18T20:44:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.273+0000 7fe5055b6700 1 -- start start 2023-08-18T20:44:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4e8003a70 0x7fe50014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5001ecb50 0x7fe50014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50014edd0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50014f150 con 0x7fe5001ecb50 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe5055b6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50014f680 con 0x7fe4e8003a70 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42048/0 (socket says 172.21.15.121:42048) 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 -- 172.21.15.121:0/1832052004 learned_addr learned my addr 172.21.15.121:0/1832052004 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4ff7fe700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5001ecb50 0x7fe50014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4feffd700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4e8003a70 0x7fe50014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 -- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4e8003a70 msgr2=0x7fe50014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4e8003a70 0x7fe50014d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 -- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5001ecb50 msgr2=0x7fe50014bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5001ecb50 0x7fe50014bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.274+0000 7fe4fe7fc700 1 -- 172.21.15.121:0/1832052004 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5001ed520 con 0x7fe5000ac7a0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe4fe7fc700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0011a00 tx=0x7fe4f0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000f940 con 0x7fe5000ac7a0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000faa0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000fe30 con 0x7fe5000ac7a0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50014f3a0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.275+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5001dad20 con 0x7fe5000ac7a0 2023-08-18T20:44:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.276+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50014d1d0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.276+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4f0014440 con 0x7fe5000ac7a0 2023-08-18T20:44:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.277+0000 7fe4e77fe700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 0x7fe4ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.277+0000 7fe4feffd700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 0x7fe4ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.277+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4f0088cb0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.277+0000 7fe4feffd700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 0x7fe4ec06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4008fd0 tx=0x7fe4f400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.281+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe4f00544e0 con 0x7fe5000ac7a0 2023-08-18T20:44:38.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.465+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5000c6680 con 0x7fe4ec06a0e0 2023-08-18T20:44:38.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.473+0000 7fe4e77fe700 1 -- 172.21.15.121:0/1832052004 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293033 (secure 0 0 0) 0x7fe4f400cde0 con 0x7fe4ec06a0e0 2023-08-18T20:44:38.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:38.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 msgr2=0x7fe4ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 0x7fe4ec06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4008fd0 tx=0x7fe4f400a000 comp rx=0 tx=0).stop 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 msgr2=0x7fe5000a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0011a00 tx=0x7fe4f0011dc0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 shutdown_connections 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5001ecb50 0x7fe50014bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4e8003a70 0x7fe50014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe4ec06a0e0 0x7fe4ec06c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 --2- 172.21.15.121:0/1832052004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5000ac7a0 0x7fe5000a9b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 >> 172.21.15.121:0/1832052004 conn(0x7fe5000c6b10 msgr2=0x7fe500154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:38.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 shutdown_connections 2023-08-18T20:44:38.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.476+0000 7fe5055b6700 1 -- 172.21.15.121:0/1832052004 wait complete. 2023-08-18T20:44:38.479 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:38.488 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-08-18T20:44:36.923890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220248,"kb_used_data":4044,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754472,"statfs":{"total":773094113280,"available":772868579328,"internally_reserved":0,"allocated":4141056,"data_stored":2346923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925585"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185240+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:35.185240+0000","last_peered":"2023-08-18T20:44:35.185240+0000","last_clean":"2023-08-18T20:44:35.185240+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:35.185240+0000","last_undegraded":"2023-08-18T20:44:35.185240+0000","last_fullsized":"2023-08-18T20:44:35.185240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185015+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:35.185015+0000","last_peered":"2023-08-18T20:44:35.185015+0000","last_clean":"2023-08-18T20:44:35.185015+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:35.185015+0000","last_undegraded":"2023-08-18T20:44:35.185015+0000","last_fullsized":"2023-08-18T20:44:35.185015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:32:32.700486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685832+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:35.685832+0000","last_peered":"2023-08-18T20:44:35.685832+0000","last_clean":"2023-08-18T20:44:35.685832+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:35.685832+0000","last_undegraded":"2023-08-18T20:44:35.685832+0000","last_fullsized":"2023-08-18T20:44:35.685832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021152+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:35.021152+0000","last_peered":"2023-08-18T20:44:35.021152+0000","last_clean":"2023-08-18T20:44:35.021152+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:35.021152+0000","last_undegraded":"2023-08-18T20:44:35.021152+0000","last_fullsized":"2023-08-18T20:44:35.021152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:12:08.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021125+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:35.021125+0000","last_peered":"2023-08-18T20:44:35.021125+0000","last_clean":"2023-08-18T20:44:35.021125+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:35.021125+0000","last_undegraded":"2023-08-18T20:44:35.021125+0000","last_fullsized":"2023-08-18T20:44:35.021125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:32.258779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685871+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:35.685871+0000","last_peered":"2023-08-18T20:44:35.685871+0000","last_clean":"2023-08-18T20:44:35.685871+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:35.685871+0000","last_undegraded":"2023-08-18T20:44:35.685871+0000","last_fullsized":"2023-08-18T20:44:35.685871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:45.836631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184860+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:35.184860+0000","last_peered":"2023-08-18T20:44:35.184860+0000","last_clean":"2023-08-18T20:44:35.184860+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:35.184860+0000","last_undegraded":"2023-08-18T20:44:35.184860+0000","last_fullsized":"2023-08-18T20:44:35.184860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685874+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:35.685874+0000","last_peered":"2023-08-18T20:44:35.685874+0000","last_clean":"2023-08-18T20:44:35.685874+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:35.685874+0000","last_undegraded":"2023-08-18T20:44:35.685874+0000","last_fullsized":"2023-08-18T20:44:35.685874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021908+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:35.021908+0000","last_peered":"2023-08-18T20:44:35.021908+0000","last_clean":"2023-08-18T20:44:35.021908+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.021908+0000","last_undegraded":"2023-08-18T20:44:35.021908+0000","last_fullsized":"2023-08-18T20:44:35.021908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:02:17.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021948+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:35.021948+0000","last_peered":"2023-08-18T20:44:35.021948+0000","last_clean":"2023-08-18T20:44:35.021948+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:35.021948+0000","last_undegraded":"2023-08-18T20:44:35.021948+0000","last_fullsized":"2023-08-18T20:44:35.021948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:54.989567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685639+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:35.685639+0000","last_peered":"2023-08-18T20:44:35.685639+0000","last_clean":"2023-08-18T20:44:35.685639+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:35.685639+0000","last_undegraded":"2023-08-18T20:44:35.685639+0000","last_fullsized":"2023-08-18T20:44:35.685639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:13.931577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021695+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:35.021695+0000","last_peered":"2023-08-18T20:44:35.021695+0000","last_clean":"2023-08-18T20:44:35.021695+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:35.021695+0000","last_undegraded":"2023-08-18T20:44:35.021695+0000","last_fullsized":"2023-08-18T20:44:35.021695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:04:24.273971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686127+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:35.686127+0000","last_peered":"2023-08-18T20:44:35.686127+0000","last_clean":"2023-08-18T20:44:35.686127+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:35.686127+0000","last_undegraded":"2023-08-18T20:44:35.686127+0000","last_fullsized":"2023-08-18T20:44:35.686127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:16.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022446+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:35.022446+0000","last_peered":"2023-08-18T20:44:35.022446+0000","last_clean":"2023-08-18T20:44:35.022446+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:35.022446+0000","last_undegraded":"2023-08-18T20:44:35.022446+0000","last_fullsized":"2023-08-18T20:44:35.022446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:49:17.166598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673718+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:35.673718+0000","last_peered":"2023-08-18T20:44:35.673718+0000","last_clean":"2023-08-18T20:44:35.673718+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:35.673718+0000","last_undegraded":"2023-08-18T20:44:35.673718+0000","last_fullsized":"2023-08-18T20:44:35.673718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674256+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:35.674256+0000","last_peered":"2023-08-18T20:44:35.674256+0000","last_clean":"2023-08-18T20:44:35.674256+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:35.674256+0000","last_undegraded":"2023-08-18T20:44:35.674256+0000","last_fullsized":"2023-08-18T20:44:35.674256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:07.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021198+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:35.021198+0000","last_peered":"2023-08-18T20:44:35.021198+0000","last_clean":"2023-08-18T20:44:35.021198+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:35.021198+0000","last_undegraded":"2023-08-18T20:44:35.021198+0000","last_fullsized":"2023-08-18T20:44:35.021198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:14.550052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022431+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:35.022431+0000","last_peered":"2023-08-18T20:44:35.022431+0000","last_clean":"2023-08-18T20:44:35.022431+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:35.022431+0000","last_undegraded":"2023-08-18T20:44:35.022431+0000","last_fullsized":"2023-08-18T20:44:35.022431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022047+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:35.022047+0000","last_peered":"2023-08-18T20:44:35.022047+0000","last_clean":"2023-08-18T20:44:35.022047+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:35.022047+0000","last_undegraded":"2023-08-18T20:44:35.022047+0000","last_fullsized":"2023-08-18T20:44:35.022047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:55.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686144+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:35.686144+0000","last_peered":"2023-08-18T20:44:35.686144+0000","last_clean":"2023-08-18T20:44:35.686144+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:35.686144+0000","last_undegraded":"2023-08-18T20:44:35.686144+0000","last_fullsized":"2023-08-18T20:44:35.686144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:12:36.239200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673869+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:35.673869+0000","last_peered":"2023-08-18T20:44:35.673869+0000","last_clean":"2023-08-18T20:44:35.673869+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:35.673869+0000","last_undegraded":"2023-08-18T20:44:35.673869+0000","last_fullsized":"2023-08-18T20:44:35.673869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021052+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:35.021052+0000","last_peered":"2023-08-18T20:44:35.021052+0000","last_clean":"2023-08-18T20:44:35.021052+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:35.021052+0000","last_undegraded":"2023-08-18T20:44:35.021052+0000","last_fullsized":"2023-08-18T20:44:35.021052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:10:15.545511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022784+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:35.022784+0000","last_peered":"2023-08-18T20:44:35.022784+0000","last_clean":"2023-08-18T20:44:35.022784+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:35.022784+0000","last_undegraded":"2023-08-18T20:44:35.022784+0000","last_fullsized":"2023-08-18T20:44:35.022784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:36.826792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686401+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:35.686401+0000","last_peered":"2023-08-18T20:44:35.686401+0000","last_clean":"2023-08-18T20:44:35.686401+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:35.686401+0000","last_undegraded":"2023-08-18T20:44:35.686401+0000","last_fullsized":"2023-08-18T20:44:35.686401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022572+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:35.022572+0000","last_peered":"2023-08-18T20:44:35.022572+0000","last_clean":"2023-08-18T20:44:35.022572+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:35.022572+0000","last_undegraded":"2023-08-18T20:44:35.022572+0000","last_fullsized":"2023-08-18T20:44:35.022572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021715+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:35.021715+0000","last_peered":"2023-08-18T20:44:35.021715+0000","last_clean":"2023-08-18T20:44:35.021715+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:35.021715+0000","last_undegraded":"2023-08-18T20:44:35.021715+0000","last_fullsized":"2023-08-18T20:44:35.021715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:37.673955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022145+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:35.022145+0000","last_peered":"2023-08-18T20:44:35.022145+0000","last_clean":"2023-08-18T20:44:35.022145+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:35.022145+0000","last_undegraded":"2023-08-18T20:44:35.022145+0000","last_fullsized":"2023-08-18T20:44:35.022145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022178+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:35.022178+0000","last_peered":"2023-08-18T20:44:35.022178+0000","last_clean":"2023-08-18T20:44:35.022178+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:35.022178+0000","last_undegraded":"2023-08-18T20:44:35.022178+0000","last_fullsized":"2023-08-18T20:44:35.022178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673985+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:35.673985+0000","last_peered":"2023-08-18T20:44:35.673985+0000","last_clean":"2023-08-18T20:44:35.673985+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:35.673985+0000","last_undegraded":"2023-08-18T20:44:35.673985+0000","last_fullsized":"2023-08-18T20:44:35.673985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685586+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:35.685586+0000","last_peered":"2023-08-18T20:44:35.685586+0000","last_clean":"2023-08-18T20:44:35.685586+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:35.685586+0000","last_undegraded":"2023-08-18T20:44:35.685586+0000","last_fullsized":"2023-08-18T20:44:35.685586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674105+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:35.674105+0000","last_peered":"2023-08-18T20:44:35.674105+0000","last_clean":"2023-08-18T20:44:35.674105+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:35.674105+0000","last_undegraded":"2023-08-18T20:44:35.674105+0000","last_fullsized":"2023-08-18T20:44:35.674105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:35.381650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022926+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:35.022926+0000","last_peered":"2023-08-18T20:44:35.022926+0000","last_clean":"2023-08-18T20:44:35.022926+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:35.022926+0000","last_undegraded":"2023-08-18T20:44:35.022926+0000","last_fullsized":"2023-08-18T20:44:35.022926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:39.803589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686382+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:35.686382+0000","last_peered":"2023-08-18T20:44:35.686382+0000","last_clean":"2023-08-18T20:44:35.686382+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:35.686382+0000","last_undegraded":"2023-08-18T20:44:35.686382+0000","last_fullsized":"2023-08-18T20:44:35.686382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:40.808594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686216+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:35.686216+0000","last_peered":"2023-08-18T20:44:35.686216+0000","last_clean":"2023-08-18T20:44:35.686216+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:35.686216+0000","last_undegraded":"2023-08-18T20:44:35.686216+0000","last_fullsized":"2023-08-18T20:44:35.686216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:47.071148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686446+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:35.686446+0000","last_peered":"2023-08-18T20:44:35.686446+0000","last_clean":"2023-08-18T20:44:35.686446+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:35.686446+0000","last_undegraded":"2023-08-18T20:44:35.686446+0000","last_fullsized":"2023-08-18T20:44:35.686446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:57:06.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686469+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:35.686469+0000","last_peered":"2023-08-18T20:44:35.686469+0000","last_clean":"2023-08-18T20:44:35.686469+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:35.686469+0000","last_undegraded":"2023-08-18T20:44:35.686469+0000","last_fullsized":"2023-08-18T20:44:35.686469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:11:37.290795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185136+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:35.185136+0000","last_peered":"2023-08-18T20:44:35.185136+0000","last_clean":"2023-08-18T20:44:35.185136+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:35.185136+0000","last_undegraded":"2023-08-18T20:44:35.185136+0000","last_fullsized":"2023-08-18T20:44:35.185136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:23.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686474+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:35.686474+0000","last_peered":"2023-08-18T20:44:35.686474+0000","last_clean":"2023-08-18T20:44:35.686474+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:35.686474+0000","last_undegraded":"2023-08-18T20:44:35.686474+0000","last_fullsized":"2023-08-18T20:44:35.686474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.149467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685538+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:35.685538+0000","last_peered":"2023-08-18T20:44:35.685538+0000","last_clean":"2023-08-18T20:44:35.685538+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:35.685538+0000","last_undegraded":"2023-08-18T20:44:35.685538+0000","last_fullsized":"2023-08-18T20:44:35.685538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:12:44.118040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021626+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:35.021626+0000","last_peered":"2023-08-18T20:44:35.021626+0000","last_clean":"2023-08-18T20:44:35.021626+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:35.021626+0000","last_undegraded":"2023-08-18T20:44:35.021626+0000","last_fullsized":"2023-08-18T20:44:35.021626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:02.246115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022453+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:35.022453+0000","last_peered":"2023-08-18T20:44:35.022453+0000","last_clean":"2023-08-18T20:44:35.022453+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:35.022453+0000","last_undegraded":"2023-08-18T20:44:35.022453+0000","last_fullsized":"2023-08-18T20:44:35.022453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:00:07.822682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674020+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:35.674020+0000","last_peered":"2023-08-18T20:44:35.674020+0000","last_clean":"2023-08-18T20:44:35.674020+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:35.674020+0000","last_undegraded":"2023-08-18T20:44:35.674020+0000","last_fullsized":"2023-08-18T20:44:35.674020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:22.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686345+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:35.686345+0000","last_peered":"2023-08-18T20:44:35.686345+0000","last_clean":"2023-08-18T20:44:35.686345+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:35.686345+0000","last_undegraded":"2023-08-18T20:44:35.686345+0000","last_fullsized":"2023-08-18T20:44:35.686345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:08:58.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686171+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:35.686171+0000","last_peered":"2023-08-18T20:44:35.686171+0000","last_clean":"2023-08-18T20:44:35.686171+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:35.686171+0000","last_undegraded":"2023-08-18T20:44:35.686171+0000","last_fullsized":"2023-08-18T20:44:35.686171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:38.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185127+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:35.185127+0000","last_peered":"2023-08-18T20:44:35.185127+0000","last_clean":"2023-08-18T20:44:35.185127+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:35.185127+0000","last_undegraded":"2023-08-18T20:44:35.185127+0000","last_fullsized":"2023-08-18T20:44:35.185127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.810386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686003+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:35.686003+0000","last_peered":"2023-08-18T20:44:35.686003+0000","last_clean":"2023-08-18T20:44:35.686003+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:35.686003+0000","last_undegraded":"2023-08-18T20:44:35.686003+0000","last_fullsized":"2023-08-18T20:44:35.686003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:29.096868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021269+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:35.021269+0000","last_peered":"2023-08-18T20:44:35.021269+0000","last_clean":"2023-08-18T20:44:35.021269+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:35.021269+0000","last_undegraded":"2023-08-18T20:44:35.021269+0000","last_fullsized":"2023-08-18T20:44:35.021269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:10:19.922914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185223+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:35.185223+0000","last_peered":"2023-08-18T20:44:35.185223+0000","last_clean":"2023-08-18T20:44:35.185223+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:35.185223+0000","last_undegraded":"2023-08-18T20:44:35.185223+0000","last_fullsized":"2023-08-18T20:44:35.185223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:37.595262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674145+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:35.674145+0000","last_peered":"2023-08-18T20:44:35.674145+0000","last_clean":"2023-08-18T20:44:35.674145+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:35.674145+0000","last_undegraded":"2023-08-18T20:44:35.674145+0000","last_fullsized":"2023-08-18T20:44:35.674145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:38.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021526+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:35.021526+0000","last_peered":"2023-08-18T20:44:35.021526+0000","last_clean":"2023-08-18T20:44:35.021526+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:35.021526+0000","last_undegraded":"2023-08-18T20:44:35.021526+0000","last_fullsized":"2023-08-18T20:44:35.021526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:30:54.763621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686136+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:35.686136+0000","last_peered":"2023-08-18T20:44:35.686136+0000","last_clean":"2023-08-18T20:44:35.686136+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:35.686136+0000","last_undegraded":"2023-08-18T20:44:35.686136+0000","last_fullsized":"2023-08-18T20:44:35.686136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022064+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:35.022064+0000","last_peered":"2023-08-18T20:44:35.022064+0000","last_clean":"2023-08-18T20:44:35.022064+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:35.022064+0000","last_undegraded":"2023-08-18T20:44:35.022064+0000","last_fullsized":"2023-08-18T20:44:35.022064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:21:05.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686532+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:35.686532+0000","last_peered":"2023-08-18T20:44:35.686532+0000","last_clean":"2023-08-18T20:44:35.686532+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:35.686532+0000","last_undegraded":"2023-08-18T20:44:35.686532+0000","last_fullsized":"2023-08-18T20:44:35.686532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:41:34.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"32'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185202+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:35.185202+0000","last_peered":"2023-08-18T20:44:35.185202+0000","last_clean":"2023-08-18T20:44:35.185202+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:35.185202+0000","last_undegraded":"2023-08-18T20:44:35.185202+0000","last_fullsized":"2023-08-18T20:44:35.185202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:34.376644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686047+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:35.686047+0000","last_peered":"2023-08-18T20:44:35.686047+0000","last_clean":"2023-08-18T20:44:35.686047+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:35.686047+0000","last_undegraded":"2023-08-18T20:44:35.686047+0000","last_fullsized":"2023-08-18T20:44:35.686047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185166+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:35.185166+0000","last_peered":"2023-08-18T20:44:35.185166+0000","last_clean":"2023-08-18T20:44:35.185166+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:35.185166+0000","last_undegraded":"2023-08-18T20:44:35.185166+0000","last_fullsized":"2023-08-18T20:44:35.185166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184870+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:35.184870+0000","last_peered":"2023-08-18T20:44:35.184870+0000","last_clean":"2023-08-18T20:44:35.184870+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:35.184870+0000","last_undegraded":"2023-08-18T20:44:35.184870+0000","last_fullsized":"2023-08-18T20:44:35.184870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:12.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673788+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:35.673788+0000","last_peered":"2023-08-18T20:44:35.673788+0000","last_clean":"2023-08-18T20:44:35.673788+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:35.673788+0000","last_undegraded":"2023-08-18T20:44:35.673788+0000","last_fullsized":"2023-08-18T20:44:35.673788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022202+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:35.022202+0000","last_peered":"2023-08-18T20:44:35.022202+0000","last_clean":"2023-08-18T20:44:35.022202+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:35.022202+0000","last_undegraded":"2023-08-18T20:44:35.022202+0000","last_fullsized":"2023-08-18T20:44:35.022202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:00.662486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184974+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:35.184974+0000","last_peered":"2023-08-18T20:44:35.184974+0000","last_clean":"2023-08-18T20:44:35.184974+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:35.184974+0000","last_undegraded":"2023-08-18T20:44:35.184974+0000","last_fullsized":"2023-08-18T20:44:35.184974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673938+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:35.673938+0000","last_peered":"2023-08-18T20:44:35.673938+0000","last_clean":"2023-08-18T20:44:35.673938+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:35.673938+0000","last_undegraded":"2023-08-18T20:44:35.673938+0000","last_fullsized":"2023-08-18T20:44:35.673938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:14.990143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185084+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:35.185084+0000","last_peered":"2023-08-18T20:44:35.185084+0000","last_clean":"2023-08-18T20:44:35.185084+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:35.185084+0000","last_undegraded":"2023-08-18T20:44:35.185084+0000","last_fullsized":"2023-08-18T20:44:35.185084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:15.995149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021905+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:35.021905+0000","last_peered":"2023-08-18T20:44:35.021905+0000","last_clean":"2023-08-18T20:44:35.021905+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:35.021905+0000","last_undegraded":"2023-08-18T20:44:35.021905+0000","last_fullsized":"2023-08-18T20:44:35.021905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:28.147788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021887+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:35.021887+0000","last_peered":"2023-08-18T20:44:35.021887+0000","last_clean":"2023-08-18T20:44:35.021887+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:35.021887+0000","last_undegraded":"2023-08-18T20:44:35.021887+0000","last_fullsized":"2023-08-18T20:44:35.021887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:14.155493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686553+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:35.686553+0000","last_peered":"2023-08-18T20:44:35.686553+0000","last_clean":"2023-08-18T20:44:35.686553+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:35.686553+0000","last_undegraded":"2023-08-18T20:44:35.686553+0000","last_fullsized":"2023-08-18T20:44:35.686553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:15:21.504162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686429+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:35.686429+0000","last_peered":"2023-08-18T20:44:35.686429+0000","last_clean":"2023-08-18T20:44:35.686429+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:35.686429+0000","last_undegraded":"2023-08-18T20:44:35.686429+0000","last_fullsized":"2023-08-18T20:44:35.686429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:40.068512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021296+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:35.021296+0000","last_peered":"2023-08-18T20:44:35.021296+0000","last_clean":"2023-08-18T20:44:35.021296+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:35.021296+0000","last_undegraded":"2023-08-18T20:44:35.021296+0000","last_fullsized":"2023-08-18T20:44:35.021296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:47.584015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021527+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:35.021527+0000","last_peered":"2023-08-18T20:44:35.021527+0000","last_clean":"2023-08-18T20:44:35.021527+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:35.021527+0000","last_undegraded":"2023-08-18T20:44:35.021527+0000","last_fullsized":"2023-08-18T20:44:35.021527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:19:55.961983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686207+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:35.686207+0000","last_peered":"2023-08-18T20:44:35.686207+0000","last_clean":"2023-08-18T20:44:35.686207+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:35.686207+0000","last_undegraded":"2023-08-18T20:44:35.686207+0000","last_fullsized":"2023-08-18T20:44:35.686207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:35.821786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673775+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:35.673775+0000","last_peered":"2023-08-18T20:44:35.673775+0000","last_clean":"2023-08-18T20:44:35.673775+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:35.673775+0000","last_undegraded":"2023-08-18T20:44:35.673775+0000","last_fullsized":"2023-08-18T20:44:35.673775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021160+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:35.021160+0000","last_peered":"2023-08-18T20:44:35.021160+0000","last_clean":"2023-08-18T20:44:35.021160+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:35.021160+0000","last_undegraded":"2023-08-18T20:44:35.021160+0000","last_fullsized":"2023-08-18T20:44:35.021160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:54:26.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685666+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:35.685666+0000","last_peered":"2023-08-18T20:44:35.685666+0000","last_clean":"2023-08-18T20:44:35.685666+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:35.685666+0000","last_undegraded":"2023-08-18T20:44:35.685666+0000","last_fullsized":"2023-08-18T20:44:35.685666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:13.854640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021094+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:35.021094+0000","last_peered":"2023-08-18T20:44:35.021094+0000","last_clean":"2023-08-18T20:44:35.021094+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:35.021094+0000","last_undegraded":"2023-08-18T20:44:35.021094+0000","last_fullsized":"2023-08-18T20:44:35.021094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:19:26.408213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021423+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:35.021423+0000","last_peered":"2023-08-18T20:44:35.021423+0000","last_clean":"2023-08-18T20:44:35.021423+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:35.021423+0000","last_undegraded":"2023-08-18T20:44:35.021423+0000","last_fullsized":"2023-08-18T20:44:35.021423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:14:20.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674039+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:35.674039+0000","last_peered":"2023-08-18T20:44:35.674039+0000","last_clean":"2023-08-18T20:44:35.674039+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:35.674039+0000","last_undegraded":"2023-08-18T20:44:35.674039+0000","last_fullsized":"2023-08-18T20:44:35.674039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185023+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:35.185023+0000","last_peered":"2023-08-18T20:44:35.185023+0000","last_clean":"2023-08-18T20:44:35.185023+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.185023+0000","last_undegraded":"2023-08-18T20:44:35.185023+0000","last_fullsized":"2023-08-18T20:44:35.185023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021190+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:35.021190+0000","last_peered":"2023-08-18T20:44:35.021190+0000","last_clean":"2023-08-18T20:44:35.021190+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:35.021190+0000","last_undegraded":"2023-08-18T20:44:35.021190+0000","last_fullsized":"2023-08-18T20:44:35.021190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:08:53.195511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686364+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:35.686364+0000","last_peered":"2023-08-18T20:44:35.686364+0000","last_clean":"2023-08-18T20:44:35.686364+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:35.686364+0000","last_undegraded":"2023-08-18T20:44:35.686364+0000","last_fullsized":"2023-08-18T20:44:35.686364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:12.619573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686008+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:35.686008+0000","last_peered":"2023-08-18T20:44:35.686008+0000","last_clean":"2023-08-18T20:44:35.686008+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:35.686008+0000","last_undegraded":"2023-08-18T20:44:35.686008+0000","last_fullsized":"2023-08-18T20:44:35.686008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:42.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686388+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:35.686388+0000","last_peered":"2023-08-18T20:44:35.686388+0000","last_clean":"2023-08-18T20:44:35.686388+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:35.686388+0000","last_undegraded":"2023-08-18T20:44:35.686388+0000","last_fullsized":"2023-08-18T20:44:35.686388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:58:22.457124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674165+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:35.674165+0000","last_peered":"2023-08-18T20:44:35.674165+0000","last_clean":"2023-08-18T20:44:35.674165+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:35.674165+0000","last_undegraded":"2023-08-18T20:44:35.674165+0000","last_fullsized":"2023-08-18T20:44:35.674165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185235+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:35.185235+0000","last_peered":"2023-08-18T20:44:35.185235+0000","last_clean":"2023-08-18T20:44:35.185235+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:35.185235+0000","last_undegraded":"2023-08-18T20:44:35.185235+0000","last_fullsized":"2023-08-18T20:44:35.185235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185250+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:35.185250+0000","last_peered":"2023-08-18T20:44:35.185250+0000","last_clean":"2023-08-18T20:44:35.185250+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:35.185250+0000","last_undegraded":"2023-08-18T20:44:35.185250+0000","last_fullsized":"2023-08-18T20:44:35.185250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686101+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:35.686101+0000","last_peered":"2023-08-18T20:44:35.686101+0000","last_clean":"2023-08-18T20:44:35.686101+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:35.686101+0000","last_undegraded":"2023-08-18T20:44:35.686101+0000","last_fullsized":"2023-08-18T20:44:35.686101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022060+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:35.022060+0000","last_peered":"2023-08-18T20:44:35.022060+0000","last_clean":"2023-08-18T20:44:35.022060+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:35.022060+0000","last_undegraded":"2023-08-18T20:44:35.022060+0000","last_fullsized":"2023-08-18T20:44:35.022060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:25.883578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685950+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:35.685950+0000","last_peered":"2023-08-18T20:44:35.685950+0000","last_clean":"2023-08-18T20:44:35.685950+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:35.685950+0000","last_undegraded":"2023-08-18T20:44:35.685950+0000","last_fullsized":"2023-08-18T20:44:35.685950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:35.317206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674171+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:35.674171+0000","last_peered":"2023-08-18T20:44:35.674171+0000","last_clean":"2023-08-18T20:44:35.674171+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:35.674171+0000","last_undegraded":"2023-08-18T20:44:35.674171+0000","last_fullsized":"2023-08-18T20:44:35.674171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674222+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:35.674222+0000","last_peered":"2023-08-18T20:44:35.674222+0000","last_clean":"2023-08-18T20:44:35.674222+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:35.674222+0000","last_undegraded":"2023-08-18T20:44:35.674222+0000","last_fullsized":"2023-08-18T20:44:35.674222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:15:17.512476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021406+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:35.021406+0000","last_peered":"2023-08-18T20:44:35.021406+0000","last_clean":"2023-08-18T20:44:35.021406+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:35.021406+0000","last_undegraded":"2023-08-18T20:44:35.021406+0000","last_fullsized":"2023-08-18T20:44:35.021406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:50.840801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673769+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:35.673769+0000","last_peered":"2023-08-18T20:44:35.673769+0000","last_clean":"2023-08-18T20:44:35.673769+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:35.673769+0000","last_undegraded":"2023-08-18T20:44:35.673769+0000","last_fullsized":"2023-08-18T20:44:35.673769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:31:37.239696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022154+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:35.022154+0000","last_peered":"2023-08-18T20:44:35.022154+0000","last_clean":"2023-08-18T20:44:35.022154+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:35.022154+0000","last_undegraded":"2023-08-18T20:44:35.022154+0000","last_fullsized":"2023-08-18T20:44:35.022154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:16:09.185476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674089+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:35.674089+0000","last_peered":"2023-08-18T20:44:35.674089+0000","last_clean":"2023-08-18T20:44:35.674089+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:35.674089+0000","last_undegraded":"2023-08-18T20:44:35.674089+0000","last_fullsized":"2023-08-18T20:44:35.674089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673943+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:35.673943+0000","last_peered":"2023-08-18T20:44:35.673943+0000","last_clean":"2023-08-18T20:44:35.673943+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:35.673943+0000","last_undegraded":"2023-08-18T20:44:35.673943+0000","last_fullsized":"2023-08-18T20:44:35.673943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:06.349596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185071+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:35.185071+0000","last_peered":"2023-08-18T20:44:35.185071+0000","last_clean":"2023-08-18T20:44:35.185071+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:35.185071+0000","last_undegraded":"2023-08-18T20:44:35.185071+0000","last_fullsized":"2023-08-18T20:44:35.185071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685907+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:35.685907+0000","last_peered":"2023-08-18T20:44:35.685907+0000","last_clean":"2023-08-18T20:44:35.685907+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:35.685907+0000","last_undegraded":"2023-08-18T20:44:35.685907+0000","last_fullsized":"2023-08-18T20:44:35.685907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022546+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:35.022546+0000","last_peered":"2023-08-18T20:44:35.022546+0000","last_clean":"2023-08-18T20:44:35.022546+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:35.022546+0000","last_undegraded":"2023-08-18T20:44:35.022546+0000","last_fullsized":"2023-08-18T20:44:35.022546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:11:54.581845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686137+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:35.686137+0000","last_peered":"2023-08-18T20:44:35.686137+0000","last_clean":"2023-08-18T20:44:35.686137+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:35.686137+0000","last_undegraded":"2023-08-18T20:44:35.686137+0000","last_fullsized":"2023-08-18T20:44:35.686137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022271+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:35.022271+0000","last_peered":"2023-08-18T20:44:35.022271+0000","last_clean":"2023-08-18T20:44:35.022271+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:35.022271+0000","last_undegraded":"2023-08-18T20:44:35.022271+0000","last_fullsized":"2023-08-18T20:44:35.022271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022591+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:35.022591+0000","last_peered":"2023-08-18T20:44:35.022591+0000","last_clean":"2023-08-18T20:44:35.022591+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:35.022591+0000","last_undegraded":"2023-08-18T20:44:35.022591+0000","last_fullsized":"2023-08-18T20:44:35.022591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:22:33.873991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685753+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:35.685753+0000","last_peered":"2023-08-18T20:44:35.685753+0000","last_clean":"2023-08-18T20:44:35.685753+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:35.685753+0000","last_undegraded":"2023-08-18T20:44:35.685753+0000","last_fullsized":"2023-08-18T20:44:35.685753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:45.828686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.023009+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:35.023009+0000","last_peered":"2023-08-18T20:44:35.023009+0000","last_clean":"2023-08-18T20:44:35.023009+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:35.023009+0000","last_undegraded":"2023-08-18T20:44:35.023009+0000","last_fullsized":"2023-08-18T20:44:35.023009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:10:42.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":734726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.73999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":143258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":733134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":142710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":149399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":150975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.68200000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":143280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:38.495 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-18T20:44:38.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-18T20:44:38.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.655+0000 7f80e79cb700 1 Processor -- start 2023-08-18T20:44:38.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 -- start start 2023-08-18T20:44:38.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e01518e0 0x7f80e0066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f80e00c1030 0x7f80e006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f80e006b7f0 0x7f80e00bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e006cc30 con 0x7f80e006b7f0 2023-08-18T20:44:38.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00c0b80 con 0x7f80e00c1030 2023-08-18T20:44:38.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e79cb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0155260 con 0x7f80e01518e0 2023-08-18T20:44:38.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.656+0000 7f80e5f68700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f80e006b7f0 0x7f80e00bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f80e006b7f0 0x7f80e00bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42060/0 (socket says 172.21.15.121:42060) 2023-08-18T20:44:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 -- 172.21.15.121:0/1990550517 learned_addr learned my addr 172.21.15.121:0/1990550517 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e4f66700 1 --2- 172.21.15.121:0/1990550517 >> v2:172.21.15.122:3300/0 conn(0x7f80e00c1030 0x7f80e006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5767700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e01518e0 0x7f80e0066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 -- 172.21.15.121:0/1990550517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e01518e0 msgr2=0x7f80e0066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e01518e0 0x7f80e0066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 -- 172.21.15.121:0/1990550517 >> v2:172.21.15.122:3300/0 conn(0x7f80e00c1030 msgr2=0x7f80e006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 --2- 172.21.15.121:0/1990550517 >> v2:172.21.15.122:3300/0 conn(0x7f80e00c1030 0x7f80e006b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 -- 172.21.15.121:0/1990550517 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e006ce80 con 0x7f80e006b7f0 2023-08-18T20:44:38.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80e5f68700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e006b7f0 0x7f80e00bf550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f80e00ac450 tx=0x7f80d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f258c4c77de1d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80d7fff700 1 -- 172.21.15.121:0/1990550517 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800e070 con 0x7f80e006b7f0 2023-08-18T20:44:38.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80d7fff700 1 -- 172.21.15.121:0/1990550517 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d800b910 con 0x7f80e006b7f0 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.657+0000 7f80d7fff700 1 -- 172.21.15.121:0/1990550517 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800bcc0 con 0x7f80e006b7f0 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 -- 172.21.15.121:0/1990550517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e006b7f0 msgr2=0x7f80e00bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e006b7f0 0x7f80e00bf550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f80e00ac450 tx=0x7f80d800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 -- 172.21.15.121:0/1990550517 shutdown_connections 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e006b7f0 0x7f80e00bf550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 --2- 172.21.15.121:0/1990550517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e01518e0 0x7f80e0066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 --2- 172.21.15.121:0/1990550517 >> v2:172.21.15.122:3300/0 conn(0x7f80e00c1030 0x7f80e006b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 -- 172.21.15.121:0/1990550517 >> 172.21.15.121:0/1990550517 conn(0x7f80e00c2ca0 msgr2=0x7f80e00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 -- 172.21.15.121:0/1990550517 shutdown_connections 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.658+0000 7f80e79cb700 1 -- 172.21.15.121:0/1990550517 wait complete. 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.659+0000 7f80e79cb700 1 Processor -- start 2023-08-18T20:44:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.659+0000 7f80e79cb700 1 -- start start 2023-08-18T20:44:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e006b7f0 0x7f80e01560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80e01518e0 0x7f80e00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01de090 con 0x7f80e00c1030 2023-08-18T20:44:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01ea6a0 con 0x7f80e01518e0 2023-08-18T20:44:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e79cb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00a91b0 con 0x7f80e006b7f0 2023-08-18T20:44:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e4f66700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e4f66700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42066/0 (socket says 172.21.15.121:42066) 2023-08-18T20:44:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e4f66700 1 -- 172.21.15.121:0/402055641 learned_addr learned my addr 172.21.15.121:0/402055641 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e5767700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e006b7f0 0x7f80e01560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.660+0000 7f80e5f68700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80e01518e0 0x7f80e00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 -- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e006b7f0 msgr2=0x7f80e01560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e006b7f0 0x7f80e01560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 -- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80e01518e0 msgr2=0x7f80e00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80e01518e0 0x7f80e00c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 -- 172.21.15.121:0/402055641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009b30 con 0x7f80e00c1030 2023-08-18T20:44:38.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e4f66700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e9b0 tx=0x7f80dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc005a20 con 0x7f80e00c1030 2023-08-18T20:44:38.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc005b80 con 0x7f80e00c1030 2023-08-18T20:44:38.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e00aafd0 con 0x7f80e00c1030 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00c5e0 con 0x7f80e00c1030 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.661+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e00ab590 con 0x7f80e00c1030 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.662+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e006e460 con 0x7f80e00c1030 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.662+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80dc00c740 con 0x7f80e00c1030 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.663+0000 7f80d5ffb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 0x7f80c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:38.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.663+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80dc088560 con 0x7f80e00c1030 2023-08-18T20:44:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.663+0000 7f80e5767700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 0x7f80c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.663+0000 7f80e5767700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 0x7f80c406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009b40 tx=0x7f80d0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.667+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f80dc057770 con 0x7f80e00c1030 2023-08-18T20:44:38.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.930+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80e00ab720 con 0x7f80e00c1030 2023-08-18T20:44:38.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.933+0000 7f80d5ffb700 1 -- 172.21.15.121:0/402055641 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f80dc057300 con 0x7f80e00c1030 2023-08-18T20:44:38.934 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2023-08-18T20:44:38.934 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ== 2023-08-18T20:44:38.934 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2023-08-18T20:44:38.934 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2023-08-18T20:44:38.934 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-18T20:44:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 msgr2=0x7f80c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 0x7f80c406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009b40 tx=0x7f80d0009210 comp rx=0 tx=0).stop 2023-08-18T20:44:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 msgr2=0x7f80e01ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e9b0 tx=0x7f80dc00ecc0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 shutdown_connections 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80e01518e0 0x7f80e00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80e006b7f0 0x7f80e01560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80c406a0e0 0x7f80c406c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 --2- 172.21.15.121:0/402055641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e00c1030 0x7f80e01ea160 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 >> 172.21.15.121:0/402055641 conn(0x7f80e00c2ca0 msgr2=0x7f80e00bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:38.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 shutdown_connections 2023-08-18T20:44:38.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:38.936+0000 7f80e79cb700 1 -- 172.21.15.121:0/402055641 wait complete. 2023-08-18T20:44:38.938 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2023-08-18T20:44:38.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.069+0000 7f98d99bf700 1 Processor -- start 2023-08-18T20:44:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.069+0000 7f98d99bf700 1 -- start start 2023-08-18T20:44:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d99bf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f98d406a510 0x7f98d40c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d99bf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d4151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d99bf700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40c21f0 con 0x7f98d4151ec0 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d99bf700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40c2ba0 con 0x7f98d406a510 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d99bf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c6300 con 0x7f98d40c1cf0 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d2ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f98d406a510 0x7f98d40c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d37fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f98d4151ec0 0x7f98d4157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48652/0 (socket says 172.21.15.121:48652) 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d37fe700 1 -- 172.21.15.121:0/2076907003 learned_addr learned my addr 172.21.15.121:0/2076907003 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.070+0000 7f98d27fc700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d4151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d2ffd700 1 -- 172.21.15.121:0/2076907003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 msgr2=0x7f98d4151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d2ffd700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d4151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d2ffd700 1 -- 172.21.15.121:0/2076907003 >> v1:172.21.15.121:6789/0 conn(0x7f98d4151ec0 legacy=0x7f98d4157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d1ffb700 1 -- 172.21.15.121:0/2076907003 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075990650 0 0) 0x7f98d40c21f0 con 0x7f98d4151ec0 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d2ffd700 1 -- 172.21.15.121:0/2076907003 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40c5b20 con 0x7f98d406a510 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d2ffd700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c5490 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009840 tx=0x7f98c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9615475ac5ac96cc server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d1ffb700 1 -- 172.21.15.121:0/2076907003 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011830 con 0x7f98d406a510 2023-08-18T20:44:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d1ffb700 1 -- 172.21.15.121:0/2076907003 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8011990 con 0x7f98d406a510 2023-08-18T20:44:39.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d1ffb700 1 -- 172.21.15.121:0/2076907003 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011d20 con 0x7f98d406a510 2023-08-18T20:44:39.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 -- 172.21.15.121:0/2076907003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 msgr2=0x7f98d40c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c5490 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009840 tx=0x7f98c8009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 -- 172.21.15.121:0/2076907003 shutdown_connections 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c5490 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 --2- 172.21.15.121:0/2076907003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d4151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.071+0000 7f98d99bf700 1 -- 172.21.15.121:0/2076907003 >> 172.21.15.121:0/2076907003 conn(0x7f98d40c6b10 msgr2=0x7f98d40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.072+0000 7f98d99bf700 1 -- 172.21.15.121:0/2076907003 shutdown_connections 2023-08-18T20:44:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.072+0000 7f98d99bf700 1 -- 172.21.15.121:0/2076907003 wait complete. 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.073+0000 7f98d99bf700 1 Processor -- start 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.073+0000 7f98d99bf700 1 -- start start 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.073+0000 7f98d99bf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.073+0000 7f98d99bf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d41eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.073+0000 7f98d99bf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d4151ec0 0x7f98d414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d99bf700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d41ecef0 con 0x7f98d406a510 2023-08-18T20:44:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d99bf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40a9fe0 con 0x7f98d4151ec0 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d99bf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d41e9df0 con 0x7f98d40c1cf0 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42076/0 (socket says 172.21.15.121:42076) 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 -- 172.21.15.121:0/3564232727 learned_addr learned my addr 172.21.15.121:0/3564232727 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d27fc700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d41eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 -- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 msgr2=0x7f98d41eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d41eaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 -- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d4151ec0 msgr2=0x7f98d414ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d4151ec0 0x7f98d414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 -- 172.21.15.121:0/3564232727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80094a0 con 0x7f98d406a510 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d2ffd700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80036a0 con 0x7f98d406a510 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c801e070 con 0x7f98d406a510 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8003a60 con 0x7f98d406a510 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d41ecc10 con 0x7f98d406a510 2023-08-18T20:44:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.074+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d41e9a80 con 0x7f98d406a510 2023-08-18T20:44:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.075+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d41e9600 con 0x7f98d406a510 2023-08-18T20:44:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.076+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98c8003bc0 con 0x7f98d406a510 2023-08-18T20:44:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.076+0000 7f98bbfff700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.076+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98c80895b0 con 0x7f98d406a510 2023-08-18T20:44:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.076+0000 7f98d27fc700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.076+0000 7f98d27fc700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 0x7f98c006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98d40acf80 tx=0x7f98c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.080+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f98d41e9600 con 0x7f98d406a510 2023-08-18T20:44:39.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.310+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98d41e9600 con 0x7f98d406a510 2023-08-18T20:44:39.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.311+0000 7f98bbfff700 1 -- 172.21.15.121:0/3564232727 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4884 (secure 0 0 0) 0x7f98d41e9600 con 0x7f98d406a510 2023-08-18T20:44:39.312 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:39.312 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-18T20:44:39.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 msgr2=0x7f98c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 0x7f98c006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98d40acf80 tx=0x7f98c4008040 comp rx=0 tx=0).stop 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 msgr2=0x7f98d40c00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8004750 comp rx=0 tx=0).stop 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 shutdown_connections 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d4151ec0 0x7f98d414ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d406a510 0x7f98d40c00f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 --2- 172.21.15.121:0/3564232727 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d40c1cf0 0x7f98d41eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 >> 172.21.15.121:0/3564232727 conn(0x7f98d40c6b10 msgr2=0x7f98d414fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 shutdown_connections 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.313+0000 7f98d99bf700 1 -- 172.21.15.121:0/3564232727 wait complete. 2023-08-18T20:44:39.315 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 15 2023-08-18T20:44:39.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-18T20:44:33.412388+0000', 'modified': '2023-08-18T20:44:37.025083+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5028': {'gid': 5028, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6837/1099144439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 1099144439}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1099144439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-18T20:44:39.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-18T20:44:39.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-18T20:44:39.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.853+0000 7f8297ab2700 1 Processor -- start 2023-08-18T20:44:39.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 -- start start 2023-08-18T20:44:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82900c6120 0x7f82900bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 0x7f82900bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290151be0 con 0x7f82900c6560 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829014ed20 con 0x7f82900c6120 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.854+0000 7f8297ab2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c20d0 con 0x7f82900c5130 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82900c6120 0x7f82900bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829604f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 0x7f82900bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82900c6120 0x7f82900bbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:51922/0 (socket says 172.21.15.121:51922) 2023-08-18T20:44:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 -- 172.21.15.121:0/1882729388 learned_addr learned my addr 172.21.15.121:0/1882729388 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 -- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 msgr2=0x7f82900bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 0x7f82900bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 -- 172.21.15.121:0/1882729388 >> v1:172.21.15.122:6789/0 conn(0x7f82900c6560 legacy=0x7f82900c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 -- 172.21.15.121:0/1882729388 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900c23b0 con 0x7f82900c6120 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829604f700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 0x7f82900bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.855+0000 7f829584e700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c6120 0x7f82900bbd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f828000bb90 tx=0x7f828000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e526c05514d20e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f829484c700 1 -- 172.21.15.121:0/1882729388 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000dd30 con 0x7f82900c6120 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f829484c700 1 -- 172.21.15.121:0/1882729388 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000de90 con 0x7f82900c6120 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f829484c700 1 -- 172.21.15.121:0/1882729388 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280010690 con 0x7f82900c6120 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 -- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c6120 msgr2=0x7f82900bbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c6120 0x7f82900bbd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f828000bb90 tx=0x7f828000bea0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 -- 172.21.15.121:0/1882729388 shutdown_connections 2023-08-18T20:44:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c5130 0x7f82900bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 --2- 172.21.15.121:0/1882729388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c6120 0x7f82900bbd80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 -- 172.21.15.121:0/1882729388 >> 172.21.15.121:0/1882729388 conn(0x7f82900c35a0 msgr2=0x7f82900c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 -- 172.21.15.121:0/1882729388 shutdown_connections 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.856+0000 7f8297ab2700 1 -- 172.21.15.121:0/1882729388 wait complete. 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.857+0000 7f8297ab2700 1 Processor -- start 2023-08-18T20:44:39.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.857+0000 7f8297ab2700 1 -- start start 2023-08-18T20:44:39.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 0x7f8290071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c6120 0x7f8290153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290071840 con 0x7f82900c6560 2023-08-18T20:44:39.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290071210 con 0x7f82900c5130 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f8297ab2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900bdbd0 con 0x7f82900c6120 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f829604f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f829604f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42092/0 (socket says 172.21.15.121:42092) 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f829604f700 1 -- 172.21.15.121:0/817595854 learned_addr learned my addr 172.21.15.121:0/817595854 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f829584e700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 0x7f8290071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.858+0000 7f829504d700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c6120 0x7f8290153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 -- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c6120 msgr2=0x7f8290153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c6120 0x7f8290153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 -- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 msgr2=0x7f8290071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 0x7f8290071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 -- 172.21.15.121:0/817595854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009a70 con 0x7f82900c6560 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829584e700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 0x7f8290071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f829604f700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f828800efc0 tx=0x7f828800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f82867fc700 1 -- 172.21.15.121:0/817595854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288009d70 con 0x7f82900c6560 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f82867fc700 1 -- 172.21.15.121:0/817595854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800f040 con 0x7f82900c6560 2023-08-18T20:44:39.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828000b7f0 con 0x7f82900c6560 2023-08-18T20:44:39.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f82867fc700 1 -- 172.21.15.121:0/817595854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288014480 con 0x7f82900c6560 2023-08-18T20:44:39.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.859+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82900721f0 con 0x7f82900c6560 2023-08-18T20:44:39.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.863+0000 7f82a3c4db80 1 Processor -- start 2023-08-18T20:44:39.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.863+0000 7f82867fc700 1 -- 172.21.15.121:0/817595854 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f82880145e0 con 0x7f82900c6560 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.863+0000 7f82a3c4db80 1 -- start start 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82867fc700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 0x7f827406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82867fc700 1 -- 172.21.15.121:0/817595854 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82880890f0 con 0x7f82900c6560 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 0x7f827406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf570b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf570a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf56685e0 con 0x55ccf574ced0 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf5665f00 con 0x55ccf570b600 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccf56617f0 con 0x55ccf5710800 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 0x7f827406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f829006e6c0 tx=0x7f828c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42100/0 (socket says 172.21.15.121:42100) 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 -- 172.21.15.121:0/4119493234 learned_addr learned my addr 172.21.15.121:0/4119493234 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829604f700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf570a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829584e700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf570b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 -- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 msgr2=0x55ccf570a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf570a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 -- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 msgr2=0x55ccf570b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf570b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829504d700 1 -- 172.21.15.121:0/4119493234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccf54e15e0 con 0x55ccf574ced0 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.864+0000 7f829604f700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf570a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:39.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f829584e700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf570b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f829504d700 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f828c014790 tx=0x7f828c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653380ea9bdcf356 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82737fe700 1 -- 172.21.15.121:0/4119493234 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c005320 con 0x55ccf574ced0 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82737fe700 1 -- 172.21.15.121:0/4119493234 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005480 con 0x55ccf574ced0 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82737fe700 1 -- 172.21.15.121:0/4119493234 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c003880 con 0x55ccf574ced0 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 -- 172.21.15.121:0/4119493234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 msgr2=0x55ccf57102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f828c014790 tx=0x7f828c011000 comp rx=0 tx=0).stop 2023-08-18T20:44:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 -- 172.21.15.121:0/4119493234 shutdown_connections 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf570a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf570b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/4119493234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57102c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 -- 172.21.15.121:0/4119493234 >> 172.21.15.121:0/4119493234 conn(0x55ccf563c900 msgr2=0x55ccf570e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.865+0000 7f82a3c4db80 1 -- 172.21.15.121:0/4119493234 shutdown_connections 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.866+0000 7f82a3c4db80 1 -- 172.21.15.121:0/4119493234 wait complete. 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.866+0000 7f82a3c4db80 1 -- start start 2023-08-18T20:44:39.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.866+0000 7f82a3c4db80 1 Processor -- start 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf570b600 0x55ccf57638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf574ced0 0x55ccf5727dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf55ffa70 con 0x55ccf5710800 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf55ff770 con 0x55ccf574ced0 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccf54e38d0 con 0x55ccf570b600 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f82a3c4db80 10 client.0 _ll_register_callbacks cb 0x55ccf5549a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:44:39.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42104/0 (socket says 172.21.15.121:42104) 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 -- 172.21.15.121:0/2721171563 learned_addr learned my addr 172.21.15.121:0/2721171563 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829584e700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf570b600 0x55ccf57638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829604f700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf574ced0 0x55ccf5727dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 -- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf570b600 msgr2=0x55ccf57638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf570b600 0x55ccf57638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 -- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf574ced0 msgr2=0x55ccf5727dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf574ced0 0x55ccf5727dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.867+0000 7f829504d700 1 -- 172.21.15.121:0/2721171563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c00f040 con 0x55ccf5710800 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.868+0000 7f829504d700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f828c000f60 tx=0x7f828c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bd3abe49c32ef0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.868+0000 7f8270ff9700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.868+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c005320 con 0x55ccf5710800 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.868+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f828c004cd0 con 0x55ccf5710800 2023-08-18T20:44:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.868+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccf5702cb0 con 0x55ccf5710800 2023-08-18T20:44:39.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828c004e90 con 0x55ccf5710800 2023-08-18T20:44:39.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 10 client.5217 fetch_fsmap learned FSMap version 15 2023-08-18T20:44:39.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ccf548dd90 con 0x55ccf5710800 2023-08-18T20:44:39.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ccf5702cb0 con 0x55ccf5710800 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f828c02a410 con 0x55ccf5710800 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 10 client.5217 fetch_fsmap finished waiting for FSMap version 15 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 10 client.5217 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 20 client.5217 populate_metadata read hostname 'smithi121' 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf5733ea0 0x55ccf5730e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 4 client.5217 mds_command: new command op to 5028 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-18T20:44:39.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 --> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccf565a7d0 con 0x55ccf5733ea0 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f829584e700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf5733ea0 0x55ccf5730e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f8270ff9700 10 client.5217 ms_handle_connect on v2:172.21.15.121:6835/1099144439 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.870+0000 7f829584e700 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf5733ea0 0x55ccf5730e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653d42939cc96fe server_cookie=ec14830a3cffc32f in_seq=0 out_seq=0 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f8270ff9700 1 -- 172.21.15.121:0/2721171563 <== mds.0 v2:172.21.15.121:6835/1099144439 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ccf565a7d0 con 0x55ccf5733ea0 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f8270ff9700 10 client.5217 handle_command_reply: tid=0 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 client.5217 shutdown 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 msgr2=0x55ccf572f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f828c000f60 tx=0x7f828c000ed0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 shutdown_connections 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf574ced0 0x55ccf5727dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf5733ea0 0x55ccf5730e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf570b600 0x55ccf57638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/2721171563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf5710800 0x55ccf572f450 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f8270ff9700 0 client.5217 ms_handle_reset on v2:172.21.15.121:6835/1099144439 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 >> 172.21.15.121:0/2721171563 conn(0x55ccf563c900 msgr2=0x55ccf570a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 shutdown_connections 2023-08-18T20:44:39.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.871+0000 7f82a3c4db80 1 -- 172.21.15.121:0/2721171563 wait complete. 2023-08-18T20:44:39.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.872+0000 7f82a3c4db80 20 client.5217 trim_cache size 0 max 16384 2023-08-18T20:44:39.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 Processor -- start 2023-08-18T20:44:39.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 -- start start 2023-08-18T20:44:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf5710800 0x55ccf574be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf574ced0 0x55ccf574f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf570cc50 con 0x55ccf570b600 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf572af90 con 0x55ccf5710800 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccf5733a80 con 0x55ccf574ced0 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.889+0000 7f829584e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42110/0 (socket says 172.21.15.121:42110) 2023-08-18T20:44:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 -- 172.21.15.121:0/209093009 learned_addr learned my addr 172.21.15.121:0/209093009 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 -- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf574ced0 msgr2=0x55ccf574f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf574ced0 0x55ccf574f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 -- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf5710800 msgr2=0x55ccf574be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf5710800 0x55ccf574be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 -- 172.21.15.121:0/209093009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccf5476c10 con 0x55ccf570b600 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f829584e700 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8280015000 tx=0x7f8280012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1884c49306f8664b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f8273fff700 1 -- 172.21.15.121:0/209093009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828001f070 con 0x55ccf570b600 2023-08-18T20:44:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f8273fff700 1 -- 172.21.15.121:0/209093009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280020040 con 0x55ccf570b600 2023-08-18T20:44:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.890+0000 7f8273fff700 1 -- 172.21.15.121:0/209093009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280026bc0 con 0x55ccf570b600 2023-08-18T20:44:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- 172.21.15.121:0/209093009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 msgr2=0x55ccf5734920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8280015000 tx=0x7f8280012000 comp rx=0 tx=0).stop 2023-08-18T20:44:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- 172.21.15.121:0/209093009 shutdown_connections 2023-08-18T20:44:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf574ced0 0x55ccf574f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf570b600 0x55ccf5734920 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/209093009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf5710800 0x55ccf574be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- 172.21.15.121:0/209093009 >> 172.21.15.121:0/209093009 conn(0x55ccf563c900 msgr2=0x55ccf572ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- 172.21.15.121:0/209093009 shutdown_connections 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- 172.21.15.121:0/209093009 wait complete. 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 -- start start 2023-08-18T20:44:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.891+0000 7f82a3c4db80 1 Processor -- start 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf574fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf57b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf5732f00 con 0x55ccf574ced0 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccf5733690 con 0x55ccf570b600 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccf57b7c40 con 0x55ccf5710800 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f82a3c4db80 10 client.0 _ll_register_callbacks cb 0x7f828c014630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:44:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42120/0 (socket says 172.21.15.121:42120) 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 -- 172.21.15.121:0/3985084272 learned_addr learned my addr 172.21.15.121:0/3985084272 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829584e700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf574fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829504d700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf57b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 -- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 msgr2=0x55ccf57b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf57b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 -- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 msgr2=0x55ccf574fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf574fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.892+0000 7f829604f700 1 -- 172.21.15.121:0/3985084272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82900c23b0 con 0x55ccf574ced0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f829604f700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8288054a30 tx=0x7f8288057fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e5acc3a7ce4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288060240 con 0x55ccf574ced0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f828805fdb0 con 0x55ccf574ced0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f828c005480 con 0x55ccf574ced0 2023-08-18T20:44:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8288087250 con 0x55ccf574ced0 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 10 client.5223 fetch_fsmap learned FSMap version 15 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ccf54b4200 con 0x55ccf574ced0 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005480 con 0x55ccf574ced0 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f828806baf0 con 0x55ccf574ced0 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 10 client.5223 fetch_fsmap finished waiting for FSMap version 15 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 10 client.5223 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 20 client.5223 populate_metadata read hostname 'smithi121' 2023-08-18T20:44:39.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf57b4970 0x55ccf57ba620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 4 client.5223 mds_command: new command op to 5028 tid=0[{"prefix": "status"}] 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 --> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ccf561b000 con 0x55ccf57b4970 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f829584e700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf57b4970 0x55ccf57ba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f8270ff9700 10 client.5223 ms_handle_connect on v2:172.21.15.121:6835/1099144439 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.893+0000 7f829584e700 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf57b4970 0x55ccf57ba620 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43acd5830166b25 server_cookie=17e8288eb5dd4083 in_seq=0 out_seq=0 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8270ff9700 1 -- 172.21.15.121:0/3985084272 <== mds.0 v2:172.21.15.121:6835/1099144439 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ccf561b000 con 0x55ccf57b4970 2023-08-18T20:44:39.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8270ff9700 10 client.5223 handle_command_reply: tid=0 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 client.5223 shutdown 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 msgr2=0x55ccf57b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8288054a30 tx=0x7f8288057fa0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 shutdown_connections 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ccf574ced0 0x55ccf57b4360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ccf570b600 0x55ccf574fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.121:6835/1099144439,v1:172.21.15.121:6837/1099144439] conn(0x55ccf57b4970 0x55ccf57ba620 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 --2- 172.21.15.121:0/3985084272 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ccf5710800 0x55ccf57b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 >> 172.21.15.121:0/3985084272 conn(0x55ccf563c900 msgr2=0x55ccf574be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8270ff9700 0 client.5223 ms_handle_reset on v2:172.21.15.121:6835/1099144439 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 shutdown_connections 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 1 -- 172.21.15.121:0/3985084272 wait complete. 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f82a3c4db80 20 client.5223 trim_cache size 0 max 16384 2023-08-18T20:44:39.904 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "4755cd5f-6734-4b3f-8f96-cd10dcf8d04c", 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5028, 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2023-08-18T20:44:39.905 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 5.8904074729999998, 2023-08-18T20:44:39.906 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 15, 2023-08-18T20:44:39.906 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 33, 2023-08-18T20:44:39.906 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 33, 2023-08-18T20:44:39.906 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 13.765256259999999 2023-08-18T20:44:39.906 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-08-18T20:44:39.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 msgr2=0x7f827406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 0x7f827406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f829006e6c0 tx=0x7f828c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:39.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 msgr2=0x7f82901e8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.894+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f828800efc0 tx=0x7f828800c3a0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 shutdown_connections 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f827406a0e0 0x7f827406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900c6560 0x7f82901e8b30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82900c5130 0x7f8290071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 --2- 172.21.15.121:0/817595854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82900c6120 0x7f8290153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 >> 172.21.15.121:0/817595854 conn(0x7f82900c35a0 msgr2=0x7f8290073560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:39.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 shutdown_connections 2023-08-18T20:44:39.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:39.895+0000 7f8297ab2700 1 -- 172.21.15.121:0/817595854 wait complete. 2023-08-18T20:44:39.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:44:40.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.028+0000 7f68a86c0700 1 Processor -- start 2023-08-18T20:44:40.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.028+0000 7f68a86c0700 1 -- start start 2023-08-18T20:44:40.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a86c0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68a00c1cf0 0x7f68a00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a86c0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a0157c10 0x7f68a01580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a86c0700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00c21f0 con 0x7f68a006a510 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a86c0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00c2ba0 con 0x7f68a00c1cf0 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a86c0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00c6300 con 0x7f68a0157c10 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a5c5b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68a00c1cf0 0x7f68a00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a5c5b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68a00c1cf0 0x7f68a00c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42124/0 (socket says 172.21.15.121:42124) 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a5c5b700 1 -- 172.21.15.121:0/322829957 learned_addr learned my addr 172.21.15.121:0/322829957 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.029+0000 7f68a6c5d700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a0157c10 0x7f68a01580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a5c5b700 1 -- 172.21.15.121:0/322829957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a0157c10 msgr2=0x7f68a01580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a5c5b700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a0157c10 0x7f68a01580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a5c5b700 1 -- 172.21.15.121:0/322829957 >> v1:172.21.15.122:6789/0 conn(0x7f68a006a510 legacy=0x7f68a0151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a5c5b700 1 -- 172.21.15.121:0/322829957 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00c5b20 con 0x7f68a00c1cf0 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a5c5b700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c1cf0 0x7f68a00c5490 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f689c0098f0 tx=0x7f689c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab7a99af4e42485 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a545a700 1 -- 172.21.15.121:0/322829957 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c004230 con 0x7f68a00c1cf0 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a545a700 1 -- 172.21.15.121:0/322829957 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c004390 con 0x7f68a00c1cf0 2023-08-18T20:44:40.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a545a700 1 -- 172.21.15.121:0/322829957 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0036a0 con 0x7f68a00c1cf0 2023-08-18T20:44:40.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a86c0700 1 -- 172.21.15.121:0/322829957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c1cf0 msgr2=0x7f68a00c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a86c0700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c1cf0 0x7f68a00c5490 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f689c0098f0 tx=0x7f689c009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a86c0700 1 -- 172.21.15.121:0/322829957 shutdown_connections 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a86c0700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a0157c10 0x7f68a01580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.030+0000 7f68a86c0700 1 --2- 172.21.15.121:0/322829957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c1cf0 0x7f68a00c5490 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.031+0000 7f68a86c0700 1 -- 172.21.15.121:0/322829957 >> 172.21.15.121:0/322829957 conn(0x7f68a00c6b10 msgr2=0x7f68a00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.031+0000 7f68a86c0700 1 -- 172.21.15.121:0/322829957 shutdown_connections 2023-08-18T20:44:40.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.031+0000 7f68a86c0700 1 -- 172.21.15.121:0/322829957 wait complete. 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 Processor -- start 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 -- start start 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a006a510 0x7f68a006d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68a00c1cf0 0x7f68a014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01ea670 con 0x7f68a0157c10 2023-08-18T20:44:40.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01530f0 con 0x7f68a00c1cf0 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a86c0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00acb30 con 0x7f68a006a510 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.032+0000 7f68a6c5d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42132/0 (socket says 172.21.15.121:42132) 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 -- 172.21.15.121:0/3020173247 learned_addr learned my addr 172.21.15.121:0/3020173247 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a645c700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a006a510 0x7f68a006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a5c5b700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68a00c1cf0 0x7f68a014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 -- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a006a510 msgr2=0x7f68a006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a006a510 0x7f68a006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 -- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68a00c1cf0 msgr2=0x7f68a014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68a00c1cf0 0x7f68a014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 -- 172.21.15.121:0/3020173247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c009550 con 0x7f68a0157c10 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a6c5d700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6898007e60 tx=0x7f689800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800ed30 con 0x7f68a0157c10 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898014420 con 0x7f68a0157c10 2023-08-18T20:44:40.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a01e99f0 con 0x7f68a0157c10 2023-08-18T20:44:40.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980147d0 con 0x7f68a0157c10 2023-08-18T20:44:40.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.033+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01e9fb0 con 0x7f68a0157c10 2023-08-18T20:44:40.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.034+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a01ea7b0 con 0x7f68a0157c10 2023-08-18T20:44:40.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.035+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6898014930 con 0x7f68a0157c10 2023-08-18T20:44:40.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.035+0000 7f6896ffd700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 0x7f688406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:40.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.035+0000 7f68a645c700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 0x7f688406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:40.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.035+0000 7f68a645c700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 0x7f688406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6890007fd0 tx=0x7f6890007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:40.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.036+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f689805bcf0 con 0x7f68a0157c10 2023-08-18T20:44:40.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.041+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f68a01ea7b0 con 0x7f68a0157c10 2023-08-18T20:44:40.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.275+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68a01ea7b0 con 0x7f68a0157c10 2023-08-18T20:44:40.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.275+0000 7f6896ffd700 1 -- 172.21.15.121:0/3020173247 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68a01ea7b0 con 0x7f68a0157c10 2023-08-18T20:44:40.276 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:44:40.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 msgr2=0x7f688406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:40.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 0x7f688406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6890007fd0 tx=0x7f6890007ec0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 msgr2=0x7f68a014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6898007e60 tx=0x7f689800e3c0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 shutdown_connections 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f688406a0e0 0x7f688406c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a0157c10 0x7f68a014e1d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68a006a510 0x7f68a006d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 --2- 172.21.15.121:0/3020173247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68a00c1cf0 0x7f68a014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:40.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 >> 172.21.15.121:0/3020173247 conn(0x7f68a00c6b10 msgr2=0x7f68a0156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:40.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 shutdown_connections 2023-08-18T20:44:40.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:40.278+0000 7f68a86c0700 1 -- 172.21.15.121:0/3020173247 wait complete. 2023-08-18T20:44:40.290 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-18T20:44:40.290 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:44:40.291 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-08-18T20:44:40.291 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-18T20:44:40.291 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:40.291 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-18T20:44:40.292 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:44:40.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:44:40.292 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:44:40.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.293 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-08-18T20:44:40.310 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:44:40.310 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:40.311 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:44:40.312 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 41765sec preferred_lft 41765sec 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::163e:4bc7:1f2c:54ec/64 scope link noprefixroute 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::1003:76ff:feee:6c32/64 scope link 2023-08-18T20:44:40.313 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.314 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:44:40.314 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-18T20:44:40.314 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::a40b:53ff:feca:cd68/64 scope link 2023-08-18T20:44:40.314 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:40.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.315 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:44:40.375 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-08-18T20:44:40.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.377 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-08-18T20:44:40.436 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-08-18T20:44:40.436 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:44:40.436 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:44:40.437 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:44:40.437 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:44:40.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.438 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:44:40.438 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:44:40.438 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:44:40.438 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:44:40.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:44:40.439 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:44:40.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.542 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-08-18T20:44:40.559 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-18T20:44:40.560 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:44:40.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-08-18T20:44:40.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:40.627 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:40.683 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:44:40.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:40.684 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:40.740 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-18T20:44:40.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:40.826 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:40.826 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:40.850 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:40.850 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:40.850 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:40.850 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:40.850 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:40.851 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:40.851 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:40.851 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:40.931 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:40.931 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:40.931 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:40.931 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:44:40.932 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:44:40.933 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:44:40.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:44:40.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:40.961 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:41.043 INFO:teuthology.orchestra.run.smithi121.stdout:client4844 2023-08-18T20:44:41.044 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:44:41.045 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:41.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:44:41.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 Processor -- start 2023-08-18T20:44:41.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 -- start start 2023-08-18T20:44:41.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd05406a510 0x7fd0540c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd0540c1cf0 0x7fd054151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c21f0 con 0x7fd054151ec0 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540c2ba0 con 0x7fd0540c1cf0 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.260+0000 7fd05c606700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540c6300 con 0x7fd05406a510 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd0540c1cf0 0x7fd054151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd05aba3700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd054151ec0 0x7fd054157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48726/0 (socket says 172.21.15.121:48726) 2023-08-18T20:44:41.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd05aba3700 1 -- 172.21.15.121:0/2986240894 learned_addr learned my addr 172.21.15.121:0/2986240894 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 -- 172.21.15.121:0/2986240894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd05406a510 msgr2=0x7fd0540c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd05a3a2700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd05406a510 0x7fd0540c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd05406a510 0x7fd0540c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd0593a0700 1 -- 172.21.15.121:0/2986240894 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507386085 0 0) 0x7fd0540c21f0 con 0x7fd054151ec0 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 -- 172.21.15.121:0/2986240894 >> v1:172.21.15.121:6789/0 conn(0x7fd054151ec0 legacy=0x7fd054157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 -- 172.21.15.121:0/2986240894 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540c5b20 con 0x7fd0540c1cf0 2023-08-18T20:44:41.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd059ba1700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0540c1cf0 0x7fd054151980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd050009840 tx=0x7fd050009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413bd424f8db498f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:41.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd0593a0700 1 -- 172.21.15.121:0/2986240894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050011830 con 0x7fd0540c1cf0 2023-08-18T20:44:41.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd0593a0700 1 -- 172.21.15.121:0/2986240894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050011990 con 0x7fd0540c1cf0 2023-08-18T20:44:41.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.261+0000 7fd0593a0700 1 -- 172.21.15.121:0/2986240894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050011d20 con 0x7fd0540c1cf0 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 -- 172.21.15.121:0/2986240894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0540c1cf0 msgr2=0x7fd054151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0540c1cf0 0x7fd054151980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd050009840 tx=0x7fd050009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 -- 172.21.15.121:0/2986240894 shutdown_connections 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd05406a510 0x7fd0540c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 --2- 172.21.15.121:0/2986240894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0540c1cf0 0x7fd054151980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 -- 172.21.15.121:0/2986240894 >> 172.21.15.121:0/2986240894 conn(0x7fd0540c6b10 msgr2=0x7fd0540c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 -- 172.21.15.121:0/2986240894 shutdown_connections 2023-08-18T20:44:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.262+0000 7fd05c606700 1 -- 172.21.15.121:0/2986240894 wait complete. 2023-08-18T20:44:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.263+0000 7fd05c606700 1 Processor -- start 2023-08-18T20:44:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.263+0000 7fd05c606700 1 -- start start 2023-08-18T20:44:41.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0540c1cf0 0x7fd0540abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd054151ec0 0x7fd0541e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054099b00 con 0x7fd05406a510 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054150fa0 con 0x7fd0540c1cf0 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05c606700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540a5e70 con 0x7fd054151ec0 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05a3a2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05a3a2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42146/0 (socket says 172.21.15.121:42146) 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05a3a2700 1 -- 172.21.15.121:0/3379316384 learned_addr learned my addr 172.21.15.121:0/3379316384 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd05aba3700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd054151ec0 0x7fd0541e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.264+0000 7fd059ba1700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0540c1cf0 0x7fd0540abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 -- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd054151ec0 msgr2=0x7fd0541e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd054151ec0 0x7fd0541e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 -- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0540c1cf0 msgr2=0x7fd0540abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0540c1cf0 0x7fd0540abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 -- 172.21.15.121:0/3379316384 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500094a0 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05a3a2700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c7f0 tx=0x7fd04400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011800 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044011960 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd054099da0 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011d10 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.265+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0540a6150 con 0x7fd05406a510 2023-08-18T20:44:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.266+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0541e9770 con 0x7fd05406a510 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.267+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd044024430 con 0x7fd05406a510 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.267+0000 7fd04affd700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 0x7fd03806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.267+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd044088930 con 0x7fd05406a510 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.267+0000 7fd059ba1700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 0x7fd03806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.268+0000 7fd059ba1700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 0x7fd03806c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0500090b0 tx=0x7fd050008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.271+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd044054090 con 0x7fd05406a510 2023-08-18T20:44:41.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.506+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd05406f060 con 0x7fd05406a510 2023-08-18T20:44:41.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.506+0000 7fd04affd700 1 -- 172.21.15.121:0/3379316384 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0440576b0 con 0x7fd05406a510 2023-08-18T20:44:41.507 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:44:41.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 msgr2=0x7fd03806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 0x7fd03806c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0500090b0 tx=0x7fd050008030 comp rx=0 tx=0).stop 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 msgr2=0x7fd0540a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c7f0 tx=0x7fd04400cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 shutdown_connections 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd054151ec0 0x7fd0541e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd03806a0e0 0x7fd03806c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd05406a510 0x7fd0540a4fb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 --2- 172.21.15.121:0/3379316384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0540c1cf0 0x7fd0540abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:41.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 >> 172.21.15.121:0/3379316384 conn(0x7fd0540c6b10 msgr2=0x7fd05406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:41.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 shutdown_connections 2023-08-18T20:44:41.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:41.508+0000 7fd05c606700 1 -- 172.21.15.121:0/3379316384 wait complete. 2023-08-18T20:44:41.520 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-18T20:44:41.521 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:44:41.521 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-08-18T20:44:41.521 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-18T20:44:41.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:41.522 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-18T20:44:41.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:44:41.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:44:41.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:44:41.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.523 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-08-18T20:44:41.544 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:41.545 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:44:41.546 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42171sec preferred_lft 42171sec 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc56:1d53:8eb3:4926/64 scope link noprefixroute 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c41:ffff:fe33:4b6a/64 scope link 2023-08-18T20:44:41.547 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.548 INFO:teuthology.orchestra.run.smithi122.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:44:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-18T20:44:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::e4bf:e4ff:fe4b:8325/64 scope link 2023-08-18T20:44:41.548 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:44:41.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.549 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:44:41.613 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:44:41.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.615 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-08-18T20:44:41.675 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-08-18T20:44:41.675 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:44:41.675 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:44:41.675 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:44:41.675 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:44:41.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.676 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:44:41.676 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:44:41.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:44:41.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:44:41.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:44:41.678 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:44:41.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.785 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:44:41.802 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-18T20:44:41.802 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:44:41.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.803 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-08-18T20:44:41.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:41.870 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:41.926 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:44:41.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:44:41.927 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:41.983 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-18T20:44:41.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:41.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:42.070 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:42.070 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:42.094 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:42.094 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:42.167 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:44:42.167 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:44:42.167 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:44:42.168 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:44:42.169 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:44:42.169 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:44:42.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:42.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:44:42.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:44:42.197 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:44:42.268 INFO:teuthology.orchestra.run.smithi122.stdout:client5241 2023-08-18T20:44:42.269 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:42.269 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:42.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-08-18T20:44:42.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.448+0000 7f0e8645c700 1 Processor -- start 2023-08-18T20:44:42.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.448+0000 7f0e8645c700 1 -- start start 2023-08-18T20:44:42.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e8645c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e8645c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800ac7b0 con 0x7f0e800c7c50 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e8645c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800ac100 con 0x7f0e800bd3e0 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e8645c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8014b3a0 con 0x7f0e8014afc0 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e849f9700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0e800c7c50 0x7f0e80158300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48738/0 (socket says 172.21.15.121:48738) 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e849f9700 1 -- 172.21.15.121:0/3392185338 learned_addr learned my addr 172.21.15.121:0/3392185338 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:42.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/3392185338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976096366 0 0) 0x7f0e800ac7b0 con 0x7f0e800c7c50 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c0035b0 con 0x7f0e800c7c50 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749915995 0 0) 0x7f0e800ac100 con 0x7f0e800bd3e0 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e800ac7b0 con 0x7f0e800bd3e0 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7ffff700 1 -- 172.21.15.121:0/3392185338 >> v1:172.21.15.122:6789/0 conn(0x7f0e800bd3e0 legacy=0x7f0e80157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7ffff700 1 -- 172.21.15.121:0/3392185338 >> v1:172.21.15.121:6789/0 conn(0x7f0e800c7c50 legacy=0x7f0e80158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.449+0000 7f0e7ffff700 1 -- 172.21.15.121:0/3392185338 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80155260 con 0x7f0e8014afc0 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/3392185338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c46d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009870 tx=0x7f0e68009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c720047bf1901c96 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011830 con 0x7f0e8014afc0 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68011990 con 0x7f0e8014afc0 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e7effd700 1 -- 172.21.15.121:0/3392185338 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011d00 con 0x7f0e8014afc0 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 -- 172.21.15.121:0/3392185338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 msgr2=0x7f0e800c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 --2- 172.21.15.121:0/3392185338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c46d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009870 tx=0x7f0e68009b80 comp rx=0 tx=0).stop 2023-08-18T20:44:42.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 -- 172.21.15.121:0/3392185338 shutdown_connections 2023-08-18T20:44:42.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 --2- 172.21.15.121:0/3392185338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c46d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 -- 172.21.15.121:0/3392185338 >> 172.21.15.121:0/3392185338 conn(0x7f0e800c9d50 msgr2=0x7f0e800ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:42.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 -- 172.21.15.121:0/3392185338 shutdown_connections 2023-08-18T20:44:42.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.450+0000 7f0e8645c700 1 -- 172.21.15.121:0/3392185338 wait complete. 2023-08-18T20:44:42.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.451+0000 7f0e8645c700 1 Processor -- start 2023-08-18T20:44:42.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 -- start start 2023-08-18T20:44:42.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 0x7f0e800af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800ae5c0 con 0x7f0e800c7c50 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e801eadf0 con 0x7f0e800bd3e0 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e8645c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80151850 con 0x7f0e8014afc0 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42160/0 (socket says 172.21.15.121:42160) 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.452+0000 7f0e7f7fe700 1 -- 172.21.15.121:0/4146099141 learned_addr learned my addr 172.21.15.121:0/4146099141 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 0x7f0e800af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e849f9700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 -- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 msgr2=0x7f0e800c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 -- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 msgr2=0x7f0e800af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 0x7f0e800af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 -- 172.21.15.121:0/4146099141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680094a0 con 0x7f0e800c7c50 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 0x7f0e800af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7f7fe700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c490 tx=0x7f0e7000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700052d0 con 0x7f0e800c7c50 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70005450 con 0x7f0e800c7c50 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e80151af0 con 0x7f0e800c7c50 2023-08-18T20:44:42.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700038c0 con 0x7f0e800c7c50 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.453+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800c3710 con 0x7f0e800c7c50 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.454+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e800ae700 con 0x7f0e800c7c50 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.454+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e70003a20 con 0x7f0e800c7c50 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.455+0000 7f0e7cff9700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.455+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e70087950 con 0x7f0e800c7c50 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.455+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.455+0000 7f0e7ffff700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009bc0 tx=0x7f0e68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.459+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0e800ae700 con 0x7f0e800c7c50 2023-08-18T20:44:42.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.727+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f0e800ae700 con 0x7f0e800c7c50 2023-08-18T20:44:42.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.728+0000 7f0e7cff9700 1 -- 172.21.15.121:0/4146099141 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v9) v1 ==== 84+0+0 (secure 0 0 0) 0x7f0e800ae700 con 0x7f0e800c7c50 2023-08-18T20:44:42.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 msgr2=0x7f0e6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009bc0 tx=0x7f0e68008030 comp rx=0 tx=0).stop 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 msgr2=0x7f0e801ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c490 tx=0x7f0e7000c850 comp rx=0 tx=0).stop 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 shutdown_connections 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e8014afc0 0x7f0e800c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e800bd3e0 0x7f0e800af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 --2- 172.21.15.121:0/4146099141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e800c7c50 0x7f0e801ea8b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 >> 172.21.15.121:0/4146099141 conn(0x7f0e800c9d50 msgr2=0x7f0e80155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:42.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 shutdown_connections 2023-08-18T20:44:42.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.730+0000 7f0e8645c700 1 -- 172.21.15.121:0/4146099141 wait complete. 2023-08-18T20:44:42.743 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:42.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.862+0000 7efd6192e700 1 Processor -- start 2023-08-18T20:44:42.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.862+0000 7efd6192e700 1 -- start start 2023-08-18T20:44:42.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.862+0000 7efd6192e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.862+0000 7efd6192e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd5c155980 0x7efd5c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd6192e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0c4700 con 0x7efd5c0c0990 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd6192e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c06ccf0 con 0x7efd5c155980 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd6192e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0c4cc0 con 0x7efd5c151bb0 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd5c155980 0x7efd5c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd5c155980 0x7efd5c1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42170/0 (socket says 172.21.15.121:42170) 2023-08-18T20:44:42.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 -- 172.21.15.121:0/3572203029 learned_addr learned my addr 172.21.15.121:0/3572203029 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5a7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efd5c0c0990 0x7efd5c06c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48748/0 (socket says 172.21.15.121:48748) 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5affd700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 -- 172.21.15.121:0/3572203029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 msgr2=0x7efd5c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 -- 172.21.15.121:0/3572203029 >> v1:172.21.15.121:6789/0 conn(0x7efd5c0c0990 legacy=0x7efd5c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 -- 172.21.15.121:0/3572203029 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c151f90 con 0x7efd5c155980 2023-08-18T20:44:42.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5affd700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd59ffb700 1 -- 172.21.15.121:0/3572203029 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490850012 0 0) 0x7efd5c0c4700 con 0x7efd5c0c0990 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd5b7fe700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c155980 0x7efd5c1544f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e50 tx=0x7efd5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13cfef0d21a7c31 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd59ffb700 1 -- 172.21.15.121:0/3572203029 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400e070 con 0x7efd5c155980 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd59ffb700 1 -- 172.21.15.121:0/3572203029 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400b9c0 con 0x7efd5c155980 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.863+0000 7efd59ffb700 1 -- 172.21.15.121:0/3572203029 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400bd70 con 0x7efd5c155980 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 -- 172.21.15.121:0/3572203029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c155980 msgr2=0x7efd5c1544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c155980 0x7efd5c1544f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e50 tx=0x7efd5400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:42.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 -- 172.21.15.121:0/3572203029 shutdown_connections 2023-08-18T20:44:42.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c155980 0x7efd5c1544f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 --2- 172.21.15.121:0/3572203029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 -- 172.21.15.121:0/3572203029 >> 172.21.15.121:0/3572203029 conn(0x7efd5c0a7ae0 msgr2=0x7efd5c0a7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:42.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 -- 172.21.15.121:0/3572203029 shutdown_connections 2023-08-18T20:44:42.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.864+0000 7efd6192e700 1 -- 172.21.15.121:0/3572203029 wait complete. 2023-08-18T20:44:42.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.865+0000 7efd6192e700 1 Processor -- start 2023-08-18T20:44:42.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.865+0000 7efd6192e700 1 -- start start 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 0x7efd5c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0be0e0 con 0x7efd5c0c0990 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0bfc20 con 0x7efd5c155980 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd6192e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c072580 con 0x7efd5c151bb0 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42172/0 (socket says 172.21.15.121:42172) 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 -- 172.21.15.121:0/524425069 learned_addr learned my addr 172.21.15.121:0/524425069 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5b7fe700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 0x7efd5c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5a7fc700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 -- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 msgr2=0x7efd5c0bd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0bd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 -- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 msgr2=0x7efd5c150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:42.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 0x7efd5c150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 -- 172.21.15.121:0/524425069 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009b30 con 0x7efd5c0c0990 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5b7fe700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 0x7efd5c150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5a7fc700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0bd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd5affd700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c750 tx=0x7efd4c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c011800 con 0x7efd5c0c0990 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.866+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c011960 con 0x7efd5c0c0990 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.867+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0bf2f0 con 0x7efd5c0c0990 2023-08-18T20:44:42.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.867+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c011cd0 con 0x7efd5c0c0990 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.867+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c0bf8b0 con 0x7efd5c0c0990 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.867+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c074730 con 0x7efd5c0c0990 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.868+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd4c021350 con 0x7efd5c0c0990 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.868+0000 7efd43fff700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 0x7efd4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.868+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd4c088500 con 0x7efd5c0c0990 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.868+0000 7efd5a7fc700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 0x7efd4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:42.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.869+0000 7efd5a7fc700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 0x7efd4806c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b9080 tx=0x7efd50007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:42.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:42.872+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efd4c053be0 con 0x7efd5c0c0990 2023-08-18T20:44:43.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.064+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5c0c55c0 con 0x7efd5c0c0990 2023-08-18T20:44:43.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.065+0000 7efd43fff700 1 -- 172.21.15.121:0/524425069 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18341 (secure 0 0 0) 0x7efd4c057200 con 0x7efd5c0c0990 2023-08-18T20:44:43.066 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:43.066 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":33,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:35.014973+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:43.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.067+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 msgr2=0x7efd4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.067+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 0x7efd4806c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b9080 tx=0x7efd50007d30 comp rx=0 tx=0).stop 2023-08-18T20:44:43.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.067+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 msgr2=0x7efd5c071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.067+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c750 tx=0x7efd4c00cb10 comp rx=0 tx=0).stop 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 shutdown_connections 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd5c155980 0x7efd5c150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd4806a0e0 0x7efd4806c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0c0990 0x7efd5c071d50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 --2- 172.21.15.121:0/524425069 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd5c151bb0 0x7efd5c0bd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 >> 172.21.15.121:0/524425069 conn(0x7efd5c0a7ae0 msgr2=0x7efd5c153310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 shutdown_connections 2023-08-18T20:44:43.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.068+0000 7efd6192e700 1 -- 172.21.15.121:0/524425069 wait complete. 2023-08-18T20:44:43.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:44:31.655910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:44:32.362264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:43.081 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.203+0000 7f4be51cf700 1 Processor -- start 2023-08-18T20:44:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.203+0000 7f4be51cf700 1 -- start start 2023-08-18T20:44:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4be006a7e0 0x7f4be00c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4be00a6290 0x7f4be00c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00c5e50 con 0x7f4be00a6290 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00c4f40 con 0x7f4be006a7e0 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4be51cf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00c6120 con 0x7f4be00c0c50 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4be00a6290 0x7f4be00c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4be00a6290 0x7f4be00c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42184/0 (socket says 172.21.15.121:42184) 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 -- 172.21.15.121:0/3550805053 learned_addr learned my addr 172.21.15.121:0/3550805053 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bded9d700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bde59c700 1 --2- 172.21.15.121:0/3550805053 >> v2:172.21.15.122:3300/0 conn(0x7f4be006a7e0 0x7f4be00c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 -- 172.21.15.121:0/3550805053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 msgr2=0x7f4be006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 -- 172.21.15.121:0/3550805053 >> v2:172.21.15.122:3300/0 conn(0x7f4be006a7e0 msgr2=0x7f4be00c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 --2- 172.21.15.121:0/3550805053 >> v2:172.21.15.122:3300/0 conn(0x7f4be006a7e0 0x7f4be00c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bdf59e700 1 -- 172.21.15.121:0/3550805053 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be01551f0 con 0x7f4be00a6290 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.204+0000 7f4bded9d700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:43.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4bdf59e700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be00c5910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4be0067580 tx=0x7f4bd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338c554d36380914 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4bddd9b700 1 -- 172.21.15.121:0/3550805053 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800e070 con 0x7f4be00a6290 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4bddd9b700 1 -- 172.21.15.121:0/3550805053 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800b9c0 con 0x7f4be00a6290 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4bddd9b700 1 -- 172.21.15.121:0/3550805053 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800bd70 con 0x7f4be00a6290 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 -- 172.21.15.121:0/3550805053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 msgr2=0x7f4be00c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be00c5910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4be0067580 tx=0x7f4bd800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 -- 172.21.15.121:0/3550805053 shutdown_connections 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be00c5910 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 --2- 172.21.15.121:0/3550805053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 --2- 172.21.15.121:0/3550805053 >> v2:172.21.15.122:3300/0 conn(0x7f4be006a7e0 0x7f4be00c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 -- 172.21.15.121:0/3550805053 >> 172.21.15.121:0/3550805053 conn(0x7f4be00c6b10 msgr2=0x7f4be00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 -- 172.21.15.121:0/3550805053 shutdown_connections 2023-08-18T20:44:43.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.205+0000 7f4be51cf700 1 -- 172.21.15.121:0/3550805053 wait complete. 2023-08-18T20:44:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 Processor -- start 2023-08-18T20:44:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 -- start start 2023-08-18T20:44:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be006a7e0 0x7f4be006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be014a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be014a7d0 con 0x7f4be00a6290 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be006d390 con 0x7f4be006a7e0 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4be51cf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be006d060 con 0x7f4be00c0c50 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.207+0000 7f4bde59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42188/0 (socket says 172.21.15.121:42188) 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 -- 172.21.15.121:0/121447009 learned_addr learned my addr 172.21.15.121:0/121447009 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bdf59e700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 -- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 msgr2=0x7f4be014a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be014a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bded9d700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be006a7e0 0x7f4be006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 -- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be006a7e0 msgr2=0x7f4be006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be006a7e0 0x7f4be006d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 -- 172.21.15.121:0/121447009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8009b30 con 0x7f4be00a6290 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bde59c700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000e840 tx=0x7f4bd000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0013610 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0013770 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be00a9ba0 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0013b00 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.208+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00aa160 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.209+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be004e620 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.209+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4bd0013c60 con 0x7f4be00a6290 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.210+0000 7f4bc77fe700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 0x7f4bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.210+0000 7f4bded9d700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 0x7f4bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.210+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bd0088100 con 0x7f4be00a6290 2023-08-18T20:44:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.210+0000 7f4bded9d700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 0x7f4bcc06c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d8b0 tx=0x7f4bd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.214+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4bd0053880 con 0x7f4be00a6290 2023-08-18T20:44:43.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.403+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4be00c6650 con 0x7f4be00a6290 2023-08-18T20:44:43.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.403+0000 7f4bc77fe700 1 -- 172.21.15.121:0/121447009 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4bd0009440 con 0x7f4be00a6290 2023-08-18T20:44:43.404 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 msgr2=0x7f4bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 0x7f4bcc06c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d8b0 tx=0x7f4bd4008040 comp rx=0 tx=0).stop 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 msgr2=0x7f4be0149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000e840 tx=0x7f4bd000ec00 comp rx=0 tx=0).stop 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 shutdown_connections 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4be00c0c50 0x7f4be014a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be006a7e0 0x7f4be006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4bcc06a0e0 0x7f4bcc06c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 --2- 172.21.15.121:0/121447009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00a6290 0x7f4be0149d50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 >> 172.21.15.121:0/121447009 conn(0x7f4be00c6b10 msgr2=0x7f4be0070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 shutdown_connections 2023-08-18T20:44:43.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.405+0000 7f4be51cf700 1 -- 172.21.15.121:0/121447009 wait complete. 2023-08-18T20:44:43.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:43.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.539+0000 7ff0e3c3a700 1 Processor -- start 2023-08-18T20:44:43.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 -- start start 2023-08-18T20:44:43.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0dc152450 0x7ff0dc14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc1529a0 con 0x7ff0dc06fd30 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc152c80 con 0x7ff0dc152450 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e3c3a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc152f60 con 0x7ff0dc0c7440 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e21d7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0dc152450 0x7ff0dc14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e21d7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0dc152450 0x7ff0dc14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42198/0 (socket says 172.21.15.121:42198) 2023-08-18T20:44:43.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.540+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3612566321 learned_addr learned my addr 172.21.15.121:0/3612566321 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e11d5700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3612566321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 msgr2=0x7ff0dc14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e21d7700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3612566321 >> v1:172.21.15.122:6789/0 conn(0x7ff0dc06fd30 legacy=0x7ff0dc0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3612566321 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc153240 con 0x7ff0dc152450 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e21d7700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14f8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e50 tx=0x7ff0d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db8df67d1c484db server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e09d4700 1 -- 172.21.15.121:0/3612566321 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e070 con 0x7ff0dc152450 2023-08-18T20:44:43.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e09d4700 1 -- 172.21.15.121:0/3612566321 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400b910 con 0x7ff0dc152450 2023-08-18T20:44:43.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.541+0000 7ff0e09d4700 1 -- 172.21.15.121:0/3612566321 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400bcc0 con 0x7ff0dc152450 2023-08-18T20:44:43.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3612566321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 msgr2=0x7ff0dc14f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14f8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e50 tx=0x7ff0d400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:43.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3612566321 shutdown_connections 2023-08-18T20:44:43.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14f8f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3612566321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3612566321 >> 172.21.15.121:0/3612566321 conn(0x7ff0dc0c7bf0 msgr2=0x7ff0dc0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3612566321 shutdown_connections 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.542+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3612566321 wait complete. 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.543+0000 7ff0e3c3a700 1 Processor -- start 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.543+0000 7ff0e3c3a700 1 -- start start 2023-08-18T20:44:43.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 0x7ff0dc0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc154270 con 0x7ff0dc152450 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc14c780 con 0x7ff0dc06fd30 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc14c500 con 0x7ff0dc0c7440 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42204/0 (socket says 172.21.15.121:42204) 2023-08-18T20:44:43.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3523792129 learned_addr learned my addr 172.21.15.121:0/3523792129 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e11d5700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e19d6700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 0x7ff0dc0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 msgr2=0x7ff0dc14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 msgr2=0x7ff0dc0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 0x7ff0dc0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 -- 172.21.15.121:0/3523792129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009b30 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e19d6700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 0x7ff0dc0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e21d7700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc072af0 tx=0x7ff0d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40048b0 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d40099b0 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc153f90 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d401c680 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.544+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0aac20 con 0x7ff0dc152450 2023-08-18T20:44:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.545+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc0adb80 con 0x7ff0dc152450 2023-08-18T20:44:43.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.546+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0d401c7e0 con 0x7ff0dc152450 2023-08-18T20:44:43.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.546+0000 7ff0d27fc700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 0x7ff0c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.546+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d408a140 con 0x7ff0dc152450 2023-08-18T20:44:43.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.546+0000 7ff0e19d6700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 0x7ff0c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.546+0000 7ff0e19d6700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 0x7ff0c006c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0adab0 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.550+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff0d40558c0 con 0x7ff0dc152450 2023-08-18T20:44:43.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.739+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0dc06da60 con 0x7ff0dc152450 2023-08-18T20:44:43.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.739+0000 7ff0d27fc700 1 -- 172.21.15.121:0/3523792129 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0d4058ee0 con 0x7ff0dc152450 2023-08-18T20:44:43.740 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:43.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 msgr2=0x7ff0c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 0x7ff0c006c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0adab0 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2023-08-18T20:44:43.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 msgr2=0x7ff0dc14bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc072af0 tx=0x7ff0d4004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 shutdown_connections 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff0c006a0e0 0x7ff0c006c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc152450 0x7ff0dc14bfc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0dc06fd30 0x7ff0dc0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 --2- 172.21.15.121:0/3523792129 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0dc0c7440 0x7ff0dc14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 >> 172.21.15.121:0/3523792129 conn(0x7ff0dc0c7bf0 msgr2=0x7ff0dc1548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.741+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 shutdown_connections 2023-08-18T20:44:43.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.742+0000 7ff0e3c3a700 1 -- 172.21.15.121:0/3523792129 wait complete. 2023-08-18T20:44:43.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:43.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.876+0000 7f42c1faf700 1 Processor -- start 2023-08-18T20:44:43.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.876+0000 7f42c1faf700 1 -- start start 2023-08-18T20:44:43.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42c1faf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f42bc0c1cf0 0x7f42bc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42c1faf700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc0c21f0 con 0x7f42bc06a510 2023-08-18T20:44:43.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42c1faf700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc0c5b20 con 0x7f42bc157c10 2023-08-18T20:44:43.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42c1faf700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc0c2ba0 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42baffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f42bc0c1cf0 0x7f42bc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42bb7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f42bc06a510 0x7f42bc151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48790/0 (socket says 172.21.15.121:48790) 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42bb7fe700 1 -- 172.21.15.121:0/3172892730 learned_addr learned my addr 172.21.15.121:0/3172892730 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42baffd700 1 -- 172.21.15.121:0/3172892730 >> v1:172.21.15.122:6789/0 conn(0x7f42bc157c10 legacy=0x7f42bc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42baffd700 1 -- 172.21.15.121:0/3172892730 >> v1:172.21.15.121:6789/0 conn(0x7f42bc06a510 legacy=0x7f42bc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42baffd700 1 -- 172.21.15.121:0/3172892730 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0c6510 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.877+0000 7f42ba7fc700 1 -- 172.21.15.121:0/3172892730 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779140485 0 0) 0x7f42bc0c21f0 con 0x7f42bc06a510 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42baffd700 1 --2- 172.21.15.121:0/3172892730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc0c5490 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009840 tx=0x7f42ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2939679a4a9c6e19 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42ba7fc700 1 -- 172.21.15.121:0/3172892730 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac011830 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42ba7fc700 1 -- 172.21.15.121:0/3172892730 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac011990 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42ba7fc700 1 -- 172.21.15.121:0/3172892730 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac011d20 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 -- 172.21.15.121:0/3172892730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc0c1cf0 msgr2=0x7f42bc0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3172892730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc0c5490 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009840 tx=0x7f42ac009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 -- 172.21.15.121:0/3172892730 shutdown_connections 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3172892730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc0c5490 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 -- 172.21.15.121:0/3172892730 >> 172.21.15.121:0/3172892730 conn(0x7f42bc0c6b10 msgr2=0x7f42bc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:43.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 -- 172.21.15.121:0/3172892730 shutdown_connections 2023-08-18T20:44:43.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.878+0000 7f42c1faf700 1 -- 172.21.15.121:0/3172892730 wait complete. 2023-08-18T20:44:43.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.879+0000 7f42c1faf700 1 Processor -- start 2023-08-18T20:44:43.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 -- start start 2023-08-18T20:44:43.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc06a510 0x7f42bc0a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0ac140 con 0x7f42bc157c10 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc152950 con 0x7f42bc0c1cf0 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42c1faf700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0ac9c0 con 0x7f42bc06a510 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42bbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42bbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42218/0 (socket says 172.21.15.121:42218) 2023-08-18T20:44:43.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.880+0000 7f42bbfff700 1 -- 172.21.15.121:0/3517331422 learned_addr learned my addr 172.21.15.121:0/3517331422 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 -- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc06a510 msgr2=0x7f42bc0a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc06a510 0x7f42bc0a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 -- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0c1cf0 msgr2=0x7f42bc154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42baffd700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:43.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 -- 172.21.15.121:0/3517331422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0094a0 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42bbfff700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f42b400cc50 tx=0x7f42b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400ad80 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400ce50 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc0ac3e0 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4003c40 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.881+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc0a7d50 con 0x7f42bc157c10 2023-08-18T20:44:43.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.882+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc06b220 con 0x7f42bc157c10 2023-08-18T20:44:43.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.882+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42b40050d0 con 0x7f42bc157c10 2023-08-18T20:44:43.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.883+0000 7f42a3fff700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 0x7f42a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:43.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.883+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42b4088620 con 0x7f42bc157c10 2023-08-18T20:44:43.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.883+0000 7f42bb7fe700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 0x7f42a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:43.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.883+0000 7f42bb7fe700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 0x7f42a806c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:43.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:43.887+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f42b4053da0 con 0x7f42bc157c10 2023-08-18T20:44:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.077+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42bc074730 con 0x7f42bc157c10 2023-08-18T20:44:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.077+0000 7f42a3fff700 1 -- 172.21.15.121:0/3517331422 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42b40573c0 con 0x7f42bc157c10 2023-08-18T20:44:44.078 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:44.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 msgr2=0x7f42a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 0x7f42a806c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0007a50 comp rx=0 tx=0).stop 2023-08-18T20:44:44.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 msgr2=0x7f42bc14e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f42b400cc50 tx=0x7f42b400a340 comp rx=0 tx=0).stop 2023-08-18T20:44:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 shutdown_connections 2023-08-18T20:44:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f42a806a0e0 0x7f42a806c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42bc157c10 0x7f42bc14e2e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc06a510 0x7f42bc0a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 --2- 172.21.15.121:0/3517331422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0c1cf0 0x7f42bc154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 >> 172.21.15.121:0/3517331422 conn(0x7f42bc0c6b10 msgr2=0x7f42bc156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 shutdown_connections 2023-08-18T20:44:44.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.079+0000 7f42c1faf700 1 -- 172.21.15.121:0/3517331422 wait complete. 2023-08-18T20:44:44.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:44.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.213+0000 7fcbabd34700 1 Processor -- start 2023-08-18T20:44:44.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.213+0000 7fcbabd34700 1 -- start start 2023-08-18T20:44:44.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcbabd34700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcba40a6290 0x7fcba40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcbabd34700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcba40c1b10 0x7fcba40c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcbabd34700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40c4f40 con 0x7fcba40c0c50 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcbabd34700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40c5e50 con 0x7fcba40a6290 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcbabd34700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40c6120 con 0x7fcba40c1b10 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcba92cf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcba40a6290 0x7fcba40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcba92cf700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcba40a6290 0x7fcba40c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42224/0 (socket says 172.21.15.121:42224) 2023-08-18T20:44:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.214+0000 7fcba92cf700 1 -- 172.21.15.121:0/4131687231 learned_addr learned my addr 172.21.15.121:0/4131687231 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:44.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba92cf700 1 -- 172.21.15.121:0/4131687231 >> v2:172.21.15.122:3300/0 conn(0x7fcba40c1b10 msgr2=0x7fcba40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba92cf700 1 --2- 172.21.15.121:0/4131687231 >> v2:172.21.15.122:3300/0 conn(0x7fcba40c1b10 0x7fcba40c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba92cf700 1 -- 172.21.15.121:0/4131687231 >> v1:172.21.15.122:6789/0 conn(0x7fcba40c0c50 legacy=0x7fcba406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba92cf700 1 -- 172.21.15.121:0/4131687231 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba41551f0 con 0x7fcba40a6290 2023-08-18T20:44:44.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba92cf700 1 --2- 172.21.15.121:0/4131687231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba40c53d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcba406ec20 tx=0x7fcba0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58fbf878ab5dea server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba8ace700 1 -- 172.21.15.121:0/4131687231 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0004230 con 0x7fcba40a6290 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba8ace700 1 -- 172.21.15.121:0/4131687231 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0004390 con 0x7fcba40a6290 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcba8ace700 1 -- 172.21.15.121:0/4131687231 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00036a0 con 0x7fcba40a6290 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 -- 172.21.15.121:0/4131687231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 msgr2=0x7fcba40c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 --2- 172.21.15.121:0/4131687231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba40c53d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcba406ec20 tx=0x7fcba0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 -- 172.21.15.121:0/4131687231 shutdown_connections 2023-08-18T20:44:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 --2- 172.21.15.121:0/4131687231 >> v2:172.21.15.122:3300/0 conn(0x7fcba40c1b10 0x7fcba40c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 --2- 172.21.15.121:0/4131687231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba40c53d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.215+0000 7fcbabd34700 1 -- 172.21.15.121:0/4131687231 >> 172.21.15.121:0/4131687231 conn(0x7fcba40c6b10 msgr2=0x7fcba40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.216+0000 7fcbabd34700 1 -- 172.21.15.121:0/4131687231 shutdown_connections 2023-08-18T20:44:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.216+0000 7fcbabd34700 1 -- 172.21.15.121:0/4131687231 wait complete. 2023-08-18T20:44:44.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 Processor -- start 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 -- start start 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcba40c0c50 0x7fcba4154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcba40c1b10 0x7fcba41507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ac0e0 con 0x7fcba40a6290 2023-08-18T20:44:44.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4157db0 con 0x7fcba40c0c50 2023-08-18T20:44:44.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcbabd34700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41edae0 con 0x7fcba40c1b10 2023-08-18T20:44:44.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcba9ad0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcba9ad0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42228/0 (socket says 172.21.15.121:42228) 2023-08-18T20:44:44.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.217+0000 7fcba9ad0700 1 -- 172.21.15.121:0/2934404107 learned_addr learned my addr 172.21.15.121:0/2934404107 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:44.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 -- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcba40c1b10 msgr2=0x7fcba41507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcba40c1b10 0x7fcba41507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 -- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcba40c0c50 msgr2=0x7fcba4154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcba40c0c50 0x7fcba4154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 -- 172.21.15.121:0/2934404107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0009550 con 0x7fcba40a6290 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcba9ad0700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c4a0 tx=0x7fcb9400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb940054e0 con 0x7fcba40a6290 2023-08-18T20:44:44.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94003680 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40aba60 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94003a30 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.218+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba40abd00 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.219+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba41545b0 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.219+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb94003b90 con 0x7fcba40a6290 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.220+0000 7fcb9a7fc700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 0x7fcb8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.220+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb94087a20 con 0x7fcba40a6290 2023-08-18T20:44:44.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.220+0000 7fcba92cf700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 0x7fcb8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.220+0000 7fcba92cf700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 0x7fcb8806c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcba40ab4c0 tx=0x7fcba0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.224+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fcb94056c30 con 0x7fcba40a6290 2023-08-18T20:44:44.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.413+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcba4074730 con 0x7fcba40a6290 2023-08-18T20:44:44.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.413+0000 7fcb9a7fc700 1 -- 172.21.15.121:0/2934404107 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb940170a0 con 0x7fcba40a6290 2023-08-18T20:44:44.414 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:44.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 msgr2=0x7fcb8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 0x7fcb8806c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcba40ab4c0 tx=0x7fcba0010000 comp rx=0 tx=0).stop 2023-08-18T20:44:44.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 msgr2=0x7fcba41ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c4a0 tx=0x7fcb9400c860 comp rx=0 tx=0).stop 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 shutdown_connections 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcba40c1b10 0x7fcba41507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fcb8806a0e0 0x7fcb8806c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcba40a6290 0x7fcba41ed5a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 --2- 172.21.15.121:0/2934404107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcba40c0c50 0x7fcba4154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 >> 172.21.15.121:0/2934404107 conn(0x7fcba40c6b10 msgr2=0x7fcba40a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 shutdown_connections 2023-08-18T20:44:44.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.415+0000 7fcbabd34700 1 -- 172.21.15.121:0/2934404107 wait complete. 2023-08-18T20:44:44.428 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-18T20:44:44.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.547+0000 7f5ef8dbc700 1 Processor -- start 2023-08-18T20:44:44.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.547+0000 7f5ef8dbc700 1 -- start start 2023-08-18T20:44:44.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef8dbc700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ef40a6290 0x7f5ef40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef8dbc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5ef40c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef8dbc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40c4f40 con 0x7f5ef40c0c50 2023-08-18T20:44:44.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef8dbc700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40c5e50 con 0x7f5ef40a6290 2023-08-18T20:44:44.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef8dbc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c6120 con 0x7f5ef40c1b10 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef259c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5ef40c0c50 0x7f5ef406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48818/0 (socket says 172.21.15.121:48818) 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef259c700 1 -- 172.21.15.121:0/2063491725 learned_addr learned my addr 172.21.15.121:0/2063491725 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef2d9d700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5ef40c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2063491725 >> v2:172.21.15.122:3300/0 conn(0x7f5ef40a6290 0x7f5ef40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168461751 0 0) 0x7f5ef40c4f40 con 0x7f5ef40c0c50 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.548+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5edc0035b0 con 0x7f5ef40c0c50 2023-08-18T20:44:44.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860285156 0 0) 0x7f5edc0035b0 con 0x7f5ef40c0c50 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 msgr2=0x7f5ef40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5ef40c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 >> v2:172.21.15.122:3300/0 conn(0x7f5ef40a6290 msgr2=0x7f5ef40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 --2- 172.21.15.121:0/2063491725 >> v2:172.21.15.122:3300/0 conn(0x7f5ef40a6290 0x7f5ef40c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef41551f0 con 0x7f5ef40c0c50 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f5ee8001670 con 0x7f5ef40c0c50 2023-08-18T20:44:44.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 >> v1:172.21.15.121:6789/0 conn(0x7f5ef40c0c50 legacy=0x7f5ef406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5edc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5edc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5edc004d90 0x7f5edc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c5e50 con 0x7f5edc003ff0 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c6120 con 0x7f5edc004d90 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc00ba40 con 0x7f5ef40c1b10 2023-08-18T20:44:44.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5edc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef259c700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5edc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef2d9d700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5edc004d90 0x7f5edc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 -- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 msgr2=0x7f5edc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef40c1b10 0x7f5edc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 -- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5edc004d90 msgr2=0x7f5edc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5edc004d90 0x7f5edc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 -- 172.21.15.121:0/2063491725 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0035b0 con 0x7f5edc003ff0 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef2d9d700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5edc004d90 0x7f5edc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5edc004850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009b60 tx=0x7f5edc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04f0d38aad9ce5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400e6c0 con 0x7f5edc003ff0 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400e820 con 0x7f5edc003ff0 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.549+0000 7f5ef159a700 1 -- 172.21.15.121:0/2063491725 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400eb90 con 0x7f5edc003ff0 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2063491725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 msgr2=0x7f5edc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2063491725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5edc004850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009b60 tx=0x7f5edc005880 comp rx=0 tx=0).stop 2023-08-18T20:44:44.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef2d9d700 1 -- 172.21.15.121:0/2063491725 reap_dead start 2023-08-18T20:44:44.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2063491725 shutdown_connections 2023-08-18T20:44:44.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2063491725 >> 172.21.15.121:0/2063491725 conn(0x7f5ef40c6b10 msgr2=0x7f5ef40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2063491725 shutdown_connections 2023-08-18T20:44:44.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.550+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2063491725 wait complete. 2023-08-18T20:44:44.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.551+0000 7f5ef8dbc700 1 Processor -- start 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.551+0000 7f5ef8dbc700 1 -- start start 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef4152b40 0x7f5ef414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ef4152300 0x7f5ef414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40aa640 con 0x7f5edc003ff0 2023-08-18T20:44:44.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef414ab90 con 0x7f5ef4152300 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef8dbc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41ed6d0 con 0x7f5ef4152b40 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42250/0 (socket says 172.21.15.121:42250) 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 -- 172.21.15.121:0/2061164646 learned_addr learned my addr 172.21.15.121:0/2061164646 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef2d9d700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ef4152300 0x7f5ef414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef4152b40 0x7f5ef414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 -- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef4152b40 msgr2=0x7f5ef414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef4152b40 0x7f5ef414a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 -- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ef4152300 msgr2=0x7f5ef414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ef4152300 0x7f5ef414a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 -- 172.21.15.121:0/2061164646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef41ed9b0 con 0x7f5edc003ff0 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.552+0000 7f5ef259c700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8007310 tx=0x7f5ee8007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.553+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800f660 con 0x7f5edc003ff0 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.553+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800f820 con 0x7f5edc003ff0 2023-08-18T20:44:44.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.553+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef41530a0 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.553+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800fbd0 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.553+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef4153660 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.554+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4074730 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.554+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ee800fd30 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.554+0000 7f5ee2ffd700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 0x7f5ed406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.554+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ee8088440 con 0x7f5edc003ff0 2023-08-18T20:44:44.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.554+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 0x7f5ed406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.555+0000 7f5ef1d9b700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 0x7f5ed406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40090b0 tx=0x7f5ee4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.559+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5ee8053bc0 con 0x7f5edc003ff0 2023-08-18T20:44:44.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.749+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5ef40c4a10 con 0x7f5edc003ff0 2023-08-18T20:44:44.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.749+0000 7f5ee2ffd700 1 -- 172.21.15.121:0/2061164646 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+268 (secure 0 0 0) 0x7f5ee80571e0 con 0x7f5edc003ff0 2023-08-18T20:44:44.750 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:44.750 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2023-08-18T20:44:44.750 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2023-08-18T20:44:44.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 5, 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_metadata" 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 6, 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_data" 2023-08-18T20:44:44.752 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:44:44.753 INFO:teuthology.orchestra.run.smithi121.stdout:] 2023-08-18T20:44:44.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 msgr2=0x7f5ed406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 0x7f5ed406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40090b0 tx=0x7f5ee4008030 comp rx=0 tx=0).stop 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 msgr2=0x7f5ef41ece00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8007310 tx=0x7f5ee8007620 comp rx=0 tx=0).stop 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 shutdown_connections 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ef4152300 0x7f5ef414a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5ed406a0e0 0x7f5ed406c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5edc003ff0 0x7f5ef41ece00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 --2- 172.21.15.121:0/2061164646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ef4152b40 0x7f5ef414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 >> 172.21.15.121:0/2061164646 conn(0x7f5ef40c6b10 msgr2=0x7f5ef40c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.751+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 shutdown_connections 2023-08-18T20:44:44.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.752+0000 7f5ef8dbc700 1 -- 172.21.15.121:0/2061164646 wait complete. 2023-08-18T20:44:44.764 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-08-18T20:44:44.764 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-08-18T20:44:44.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.887+0000 7fb673a61700 1 Processor -- start 2023-08-18T20:44:44.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 -- start start 2023-08-18T20:44:44.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb66c151660 0x7fb66c154660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb66c0c0300 0x7fb66c06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c151a40 con 0x7fb66c06d2d0 2023-08-18T20:44:44.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0c0ac0 con 0x7fb66c151660 2023-08-18T20:44:44.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.888+0000 7fb673a61700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0c5290 con 0x7fb66c0c0300 2023-08-18T20:44:44.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb66c151660 0x7fb66c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb671ffe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb66c06d2d0 0x7fb66c0c3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48840/0 (socket says 172.21.15.121:48840) 2023-08-18T20:44:44.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb671ffe700 1 -- 172.21.15.121:0/1499133306 learned_addr learned my addr 172.21.15.121:0/1499133306 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:44.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb66c151660 0x7fb66c154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42256/0 (socket says 172.21.15.121:42256) 2023-08-18T20:44:44.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 -- 172.21.15.121:0/1499133306 >> v2:172.21.15.122:3300/0 conn(0x7fb66c0c0300 msgr2=0x7fb66c06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb670ffc700 1 --2- 172.21.15.121:0/1499133306 >> v2:172.21.15.122:3300/0 conn(0x7fb66c0c0300 0x7fb66c06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 --2- 172.21.15.121:0/1499133306 >> v2:172.21.15.122:3300/0 conn(0x7fb66c0c0300 0x7fb66c06c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 -- 172.21.15.121:0/1499133306 >> v1:172.21.15.121:6789/0 conn(0x7fb66c06d2d0 legacy=0x7fb66c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb663fff700 1 -- 172.21.15.121:0/1499133306 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665288694 0 0) 0x7fb66c151a40 con 0x7fb66c06d2d0 2023-08-18T20:44:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 -- 172.21.15.121:0/1499133306 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c06d940 con 0x7fb66c151660 2023-08-18T20:44:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb6717fd700 1 --2- 172.21.15.121:0/1499133306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c151660 0x7fb66c154660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0c3020 tx=0x7fb65c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e8d85dde086349 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb663fff700 1 -- 172.21.15.121:0/1499133306 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011830 con 0x7fb66c151660 2023-08-18T20:44:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb663fff700 1 -- 172.21.15.121:0/1499133306 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c011990 con 0x7fb66c151660 2023-08-18T20:44:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.889+0000 7fb663fff700 1 -- 172.21.15.121:0/1499133306 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011d20 con 0x7fb66c151660 2023-08-18T20:44:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 -- 172.21.15.121:0/1499133306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c151660 msgr2=0x7fb66c154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 --2- 172.21.15.121:0/1499133306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c151660 0x7fb66c154660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0c3020 tx=0x7fb65c009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:44.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 -- 172.21.15.121:0/1499133306 shutdown_connections 2023-08-18T20:44:44.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 --2- 172.21.15.121:0/1499133306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c151660 0x7fb66c154660 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 --2- 172.21.15.121:0/1499133306 >> v2:172.21.15.122:3300/0 conn(0x7fb66c0c0300 0x7fb66c06c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 -- 172.21.15.121:0/1499133306 >> 172.21.15.121:0/1499133306 conn(0x7fb66c0a7610 msgr2=0x7fb66c0a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:44.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 -- 172.21.15.121:0/1499133306 shutdown_connections 2023-08-18T20:44:44.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.890+0000 7fb673a61700 1 -- 172.21.15.121:0/1499133306 wait complete. 2023-08-18T20:44:44.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.891+0000 7fb673a61700 1 Processor -- start 2023-08-18T20:44:44.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.891+0000 7fb673a61700 1 -- start start 2023-08-18T20:44:44.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 0x7fb66c0bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.898 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 0x7fb66c1e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1ed100 con 0x7fb66c0c0300 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1ed3e0 con 0x7fb66c151660 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0aa290 con 0x7fb66c06d2d0 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42262/0 (socket says 172.21.15.121:42262) 2023-08-18T20:44:44.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 -- 172.21.15.121:0/2394360148 learned_addr learned my addr 172.21.15.121:0/2394360148 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb6717fd700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 0x7fb66c0bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb671ffe700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 0x7fb66c1e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 -- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 msgr2=0x7fb66c0bef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 0x7fb66c0bef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 -- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 msgr2=0x7fb66c1e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 0x7fb66c1e93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:44.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 -- 172.21.15.121:0/2394360148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0094a0 con 0x7fb66c0c0300 2023-08-18T20:44:44.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb671ffe700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 0x7fb66c1e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:44.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb6717fd700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 0x7fb66c0bef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:44.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb670ffc700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c7f0 tx=0x7fb66800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011800 con 0x7fb66c0c0300 2023-08-18T20:44:44.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668011960 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011cf0 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.892+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0aa570 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.893+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0bf440 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.894+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c1e91f0 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.894+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb668018360 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.894+0000 7fb661ffb700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 0x7fb65006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.894+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb668088500 con 0x7fb66c0c0300 2023-08-18T20:44:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.894+0000 7fb6717fd700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 0x7fb65006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:44.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.895+0000 7fb6717fd700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 0x7fb65006c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:44.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:44.899+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb668057690 con 0x7fb66c0c0300 2023-08-18T20:44:45.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:45.091+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb66c0c4c50 con 0x7fb66c0c0300 2023-08-18T20:44:46.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.059+0000 7fb661ffb700 1 -- 172.21.15.121:0/2394360148 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v34) v1 ==== 140+0+0 (secure 0 0 0) 0x7fb668057220 con 0x7fb66c0c0300 2023-08-18T20:44:46.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 msgr2=0x7fb65006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 0x7fb65006c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c040 comp rx=0 tx=0).stop 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 msgr2=0x7fb66c147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c7f0 tx=0x7fb66800cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 shutdown_connections 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb66c151660 0x7fb66c1e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb66c06d2d0 0x7fb66c0bef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb65006a0e0 0x7fb65006c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 --2- 172.21.15.121:0/2394360148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb66c0c0300 0x7fb66c147e70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 >> 172.21.15.121:0/2394360148 conn(0x7fb66c0a7610 msgr2=0x7fb66c1536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 shutdown_connections 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.063+0000 7fb673a61700 1 -- 172.21.15.121:0/2394360148 wait complete. 2023-08-18T20:44:46.065 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_metadata' created 2023-08-18T20:44:46.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-18T20:44:46.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.211+0000 7f20932e7700 1 Processor -- start 2023-08-18T20:44:46.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.211+0000 7f20932e7700 1 -- start start 2023-08-18T20:44:46.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f20932e7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 0x7f208c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f20932e7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f208c152450 0x7f208c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f20932e7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c1529a0 con 0x7f208c1559c0 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f20932e7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208c152c80 con 0x7f208c152450 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f20932e7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c152f60 con 0x7f208c06fd30 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f208c152450 0x7f208c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f208c152450 0x7f208c0c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42268/0 (socket says 172.21.15.121:42268) 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2091884700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f208c1559c0 0x7f208c14f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48852/0 (socket says 172.21.15.121:48852) 2023-08-18T20:44:46.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 -- 172.21.15.121:0/1567430543 learned_addr learned my addr 172.21.15.121:0/1567430543 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 -- 172.21.15.121:0/1567430543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 msgr2=0x7f208c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2091083700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 0x7f208c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2083fff700 1 -- 172.21.15.121:0/1567430543 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320310472 0 0) 0x7f208c1529a0 con 0x7f208c1559c0 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 0x7f208c0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 -- 172.21.15.121:0/1567430543 >> v1:172.21.15.121:6789/0 conn(0x7f208c1559c0 legacy=0x7f208c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 -- 172.21.15.121:0/1567430543 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c153240 con 0x7f208c152450 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2091083700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 0x7f208c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2090882700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c152450 0x7f208c0c7270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098f0 tx=0x7f207c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18448c469798fa6c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2083fff700 1 -- 172.21.15.121:0/1567430543 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00b8a0 con 0x7f208c152450 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2083fff700 1 -- 172.21.15.121:0/1567430543 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c00ba00 con 0x7f208c152450 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.212+0000 7f2083fff700 1 -- 172.21.15.121:0/1567430543 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00bd90 con 0x7f208c152450 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 -- 172.21.15.121:0/1567430543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c152450 msgr2=0x7f208c0c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c152450 0x7f208c0c7270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098f0 tx=0x7f207c009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 -- 172.21.15.121:0/1567430543 shutdown_connections 2023-08-18T20:44:46.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c06fd30 0x7f208c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 --2- 172.21.15.121:0/1567430543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c152450 0x7f208c0c7270 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 -- 172.21.15.121:0/1567430543 >> 172.21.15.121:0/1567430543 conn(0x7f208c0c7bf0 msgr2=0x7f208c0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:46.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 -- 172.21.15.121:0/1567430543 shutdown_connections 2023-08-18T20:44:46.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.213+0000 7f20932e7700 1 -- 172.21.15.121:0/1567430543 wait complete. 2023-08-18T20:44:46.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.214+0000 7f20932e7700 1 Processor -- start 2023-08-18T20:44:46.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.214+0000 7f20932e7700 1 -- start start 2023-08-18T20:44:46.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 0x7f208c1e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f208c1559c0 0x7f208c1e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c1ebd20 con 0x7f208c06fd30 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0ad210 con 0x7f208c1559c0 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0ad4f0 con 0x7f208c152450 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42272/0 (socket says 172.21.15.121:42272) 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 -- 172.21.15.121:0/4188968020 learned_addr learned my addr 172.21.15.121:0/4188968020 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:46.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2090882700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 0x7f208c1e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091884700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f208c1559c0 0x7f208c1e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 -- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 msgr2=0x7f208c1e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 0x7f208c1e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 -- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f208c1559c0 msgr2=0x7f208c1e52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f208c1559c0 0x7f208c1e52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 -- 172.21.15.121:0/4188968020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009550 con 0x7f208c06fd30 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2090882700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 0x7f208c1e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:46.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2091083700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f208800c7f0 tx=0x7f208800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011800 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088011960 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c0ab060 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.215+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011d10 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.216+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c0bb820 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.217+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c070110 con 0x7f208c06fd30 2023-08-18T20:44:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.217+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2088018360 con 0x7f208c06fd30 2023-08-18T20:44:46.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.217+0000 7f2081ffb700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 0x7f207006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:46.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.217+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f20880886a0 con 0x7f208c06fd30 2023-08-18T20:44:46.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.217+0000 7f2090882700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 0x7f207006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:46.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.218+0000 7f2090882700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 0x7f207006c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098f0 tx=0x7f207c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:46.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.222+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f20880576a0 con 0x7f208c06fd30 2023-08-18T20:44:46.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:46.412+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f208c074730 con 0x7f208c06fd30 2023-08-18T20:44:47.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.061+0000 7f2081ffb700 1 -- 172.21.15.121:0/4188968020 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v35) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2088057230 con 0x7f208c06fd30 2023-08-18T20:44:47.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 msgr2=0x7f207006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 0x7f207006c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098f0 tx=0x7f207c008030 comp rx=0 tx=0).stop 2023-08-18T20:44:47.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 msgr2=0x7f208c0c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f208800c7f0 tx=0x7f208800cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 shutdown_connections 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f208c1559c0 0x7f208c1e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f207006a0e0 0x7f207006c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c06fd30 0x7f208c0c0c90 secure :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f208800c7f0 tx=0x7f208800cbb0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.068+0000 7f20932e7700 1 --2- 172.21.15.121:0/4188968020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f208c152450 0x7f208c1e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.069+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 >> 172.21.15.121:0/4188968020 conn(0x7f208c0c7bf0 msgr2=0x7f208c1550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:47.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.070+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 shutdown_connections 2023-08-18T20:44:47.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.070+0000 7f20932e7700 1 -- 172.21.15.121:0/4188968020 wait complete. 2023-08-18T20:44:47.076 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_data' created 2023-08-18T20:44:47.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-08-18T20:44:47.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.218+0000 7f9711a51700 1 Processor -- start 2023-08-18T20:44:47.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.218+0000 7f9711a51700 1 -- start start 2023-08-18T20:44:47.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9711a51700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f970c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9711a51700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0ca4a0 con 0x7f970c151b10 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9711a51700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c06c0f0 con 0x7f970c154900 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9711a51700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c158540 con 0x7f970c0c7ca0 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f970affd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f970c151b10 0x7f970c0c4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48862/0 (socket says 172.21.15.121:48862) 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f970affd700 1 -- 172.21.15.121:0/2085800755 learned_addr learned my addr 172.21.15.121:0/2085800755 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:47.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225211474 0 0) 0x7f970c0ca4a0 con 0x7f970c151b10 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f970a7fc700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f970c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.219+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f40035b0 con 0x7f970c151b10 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344190950 0 0) 0x7f96f40035b0 con 0x7f970c151b10 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 msgr2=0x7f970c1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f970c1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 >> v1:172.21.15.122:6789/0 conn(0x7f970c154900 legacy=0x7f970c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c158820 con 0x7f970c151b10 2023-08-18T20:44:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f9700001670 con 0x7f970c151b10 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 >> v1:172.21.15.121:6789/0 conn(0x7f970c151b10 legacy=0x7f970c0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f4003a30 0x7f96f4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f96f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f96f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c158540 con 0x7f96f4004d90 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f400bb40 con 0x7f96f4003a30 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f400bd00 con 0x7f970c0c7ca0 2023-08-18T20:44:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f96f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970affd700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f4003a30 0x7f96f4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970a7fc700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f96f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 -- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 msgr2=0x7f96f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c0c7ca0 0x7f96f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 -- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f4003a30 msgr2=0x7f96f4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96f4003a30 0x7f96f4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 -- 172.21.15.121:0/2085800755 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40035b0 con 0x7f96f4004d90 2023-08-18T20:44:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f970b7fe700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f96f4005210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f970400c240 tx=0x7f96f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ca317ee3c6b420 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704001df0 con 0x7f96f4004d90 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400cda0 con 0x7f96f4004d90 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.220+0000 7f9709ffb700 1 -- 172.21.15.121:0/2085800755 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704003c40 con 0x7f96f4004d90 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 -- 172.21.15.121:0/2085800755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 msgr2=0x7f96f4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 --2- 172.21.15.121:0/2085800755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f96f4005210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f970400c240 tx=0x7f96f4005880 comp rx=0 tx=0).stop 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f970b7fe700 1 -- 172.21.15.121:0/2085800755 reap_dead start 2023-08-18T20:44:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 -- 172.21.15.121:0/2085800755 shutdown_connections 2023-08-18T20:44:47.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 -- 172.21.15.121:0/2085800755 >> 172.21.15.121:0/2085800755 conn(0x7f970c071bb0 msgr2=0x7f970c071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:47.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 -- 172.21.15.121:0/2085800755 shutdown_connections 2023-08-18T20:44:47.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.221+0000 7f9711a51700 1 -- 172.21.15.121:0/2085800755 wait complete. 2023-08-18T20:44:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.222+0000 7f9711a51700 1 Processor -- start 2023-08-18T20:44:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.222+0000 7f9711a51700 1 -- start start 2023-08-18T20:44:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f970c153750 0x7f970c156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c1e6de0 0x7f970c1e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c157880 con 0x7f96f4004d90 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1ee0e0 con 0x7f970c153750 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f9711a51700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1e77b0 con 0x7f970c1e6de0 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42292/0 (socket says 172.21.15.121:42292) 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 -- 172.21.15.121:0/2014219527 learned_addr learned my addr 172.21.15.121:0/2014219527 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970a7fc700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f970c153750 0x7f970c156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970b7fe700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c1e6de0 0x7f970c1e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 -- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c1e6de0 msgr2=0x7f970c1e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c1e6de0 0x7f970c1e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 -- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f970c153750 msgr2=0x7f970c156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f970c153750 0x7f970c156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 -- 172.21.15.121:0/2014219527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0bdc20 con 0x7f96f4004d90 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.223+0000 7f970affd700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f97000072f0 tx=0x7f97000076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.224+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000014a0 con 0x7f96f4004d90 2023-08-18T20:44:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.224+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000f8d0 con 0x7f96f4004d90 2023-08-18T20:44:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.224+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000fc80 con 0x7f96f4004d90 2023-08-18T20:44:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.224+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c1ede00 con 0x7f96f4004d90 2023-08-18T20:44:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.224+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c1edad0 con 0x7f96f4004d90 2023-08-18T20:44:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.225+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c0be100 con 0x7f96f4004d90 2023-08-18T20:44:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.225+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f970001d460 con 0x7f96f4004d90 2023-08-18T20:44:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.225+0000 7f96f3fff700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 0x7f96f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.226+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f9700088930 con 0x7f96f4004d90 2023-08-18T20:44:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.226+0000 7f970a7fc700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 0x7f96f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.226+0000 7f970a7fc700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 0x7f96f806c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f970c0c0840 tx=0x7f96fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:47.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.230+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f970c0be100 con 0x7f96f4004d90 2023-08-18T20:44:47.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:47.467+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f970c0be100 con 0x7f96f4004d90 2023-08-18T20:44:48.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.064+0000 7f96f3fff700 1 -- 172.21.15.121:0/2014219527 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v16) v1 ==== 175+0+0 (secure 0 0 0) 0x7f970c0be100 con 0x7f96f4004d90 2023-08-18T20:44:48.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 msgr2=0x7f96f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 0x7f96f806c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f970c0c0840 tx=0x7f96fc008040 comp rx=0 tx=0).stop 2023-08-18T20:44:48.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 msgr2=0x7f970c156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f97000072f0 tx=0x7f97000076b0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 shutdown_connections 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f970c1e6de0 0x7f970c1e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f96f806a0e0 0x7f96f806c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96f4004d90 0x7f970c156a70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 --2- 172.21.15.121:0/2014219527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f970c153750 0x7f970c156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 >> 172.21.15.121:0/2014219527 conn(0x7f970c071bb0 msgr2=0x7f970c157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 shutdown_connections 2023-08-18T20:44:48.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.072+0000 7f9711a51700 1 -- 172.21.15.121:0/2014219527 wait complete. 2023-08-18T20:44:48.080 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 7 and data pool 8 2023-08-18T20:44:48.103 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.226+0000 7fc02501d700 1 Processor -- start 2023-08-18T20:44:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.226+0000 7fc02501d700 1 -- start start 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc02501d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc0200a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc02501d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc020152210 0x7fc020152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc02501d700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200a6270 con 0x7fc02014f9c0 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc02501d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200bbec0 con 0x7fc020152210 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc02501d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200a64a0 con 0x7fc0200c6500 2023-08-18T20:44:48.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc01f59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc020152210 0x7fc020152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc01f59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc020152210 0x7fc020152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42320/0 (socket says 172.21.15.121:42320) 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc01f59e700 1 -- 172.21.15.121:0/3330810201 learned_addr learned my addr 172.21.15.121:0/3330810201 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.227+0000 7fc01e59c700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc0200a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01f59e700 1 -- 172.21.15.121:0/3330810201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 msgr2=0x7fc0200a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01f59e700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc0200a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01f59e700 1 -- 172.21.15.121:0/3330810201 >> v1:172.21.15.122:6789/0 conn(0x7fc02014f9c0 legacy=0x7fc02006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01f59e700 1 -- 172.21.15.121:0/3330810201 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200bcb00 con 0x7fc020152210 2023-08-18T20:44:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01f59e700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc020152210 0x7fc020152670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aa4ee7499e5f04 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01dd9b700 1 -- 172.21.15.121:0/3330810201 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800e070 con 0x7fc020152210 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01dd9b700 1 -- 172.21.15.121:0/3330810201 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018003a20 con 0x7fc020152210 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc01dd9b700 1 -- 172.21.15.121:0/3330810201 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018003dd0 con 0x7fc020152210 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 -- 172.21.15.121:0/3330810201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc020152210 msgr2=0x7fc020152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc020152210 0x7fc020152670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 -- 172.21.15.121:0/3330810201 shutdown_connections 2023-08-18T20:44:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc020152210 0x7fc020152670 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 --2- 172.21.15.121:0/3330810201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc0200a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 -- 172.21.15.121:0/3330810201 >> 172.21.15.121:0/3330810201 conn(0x7fc0200c35a0 msgr2=0x7fc0200c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 -- 172.21.15.121:0/3330810201 shutdown_connections 2023-08-18T20:44:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.228+0000 7fc02501d700 1 -- 172.21.15.121:0/3330810201 wait complete. 2023-08-18T20:44:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.230+0000 7fc02501d700 1 Processor -- start 2023-08-18T20:44:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.230+0000 7fc02501d700 1 -- start start 2023-08-18T20:44:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc02014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc020152210 0x7fc020070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200728c0 con 0x7fc02014f9c0 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200725e0 con 0x7fc020152210 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02014dc40 con 0x7fc0200c6500 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42324/0 (socket says 172.21.15.121:42324) 2023-08-18T20:44:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 -- 172.21.15.121:0/3731972750 learned_addr learned my addr 172.21.15.121:0/3731972750 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01f59e700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc020152210 0x7fc020070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01ed9d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc02014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 -- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 msgr2=0x7fc02014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc02014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 -- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc020152210 msgr2=0x7fc020070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc020152210 0x7fc020070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 -- 172.21.15.121:0/3731972750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018009b30 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc01e59c700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc01000e810 tx=0x7fc01000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000c070 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc010013610 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02014df20 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100139a0 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.231+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02014d8a0 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.232+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02014e290 con 0x7fc02014f9c0 2023-08-18T20:44:48.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.233+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc010013b00 con 0x7fc02014f9c0 2023-08-18T20:44:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.233+0000 7fc0077fe700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 0x7fc00c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.233+0000 7fc01ed9d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 0x7fc00c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.233+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc010088600 con 0x7fc02014f9c0 2023-08-18T20:44:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.234+0000 7fc01ed9d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 0x7fc00c06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc014007fd0 tx=0x7fc014007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.238+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc0100539a0 con 0x7fc02014f9c0 2023-08-18T20:44:48.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.430+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc020074730 con 0x7fc02014f9c0 2023-08-18T20:44:48.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.431+0000 7fc0077fe700 1 -- 172.21.15.121:0/3731972750 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+22070 (secure 0 0 0) 0x7fc010013db0 con 0x7fc02014f9c0 2023-08-18T20:44:48.432 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:48.433 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:47.468863+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 msgr2=0x7fc00c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 0x7fc00c06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc014007fd0 tx=0x7fc014007ec0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 msgr2=0x7fc020151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc01000e810 tx=0x7fc01000eb20 comp rx=0 tx=0).stop 2023-08-18T20:44:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 shutdown_connections 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc020152210 0x7fc020070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0200c6500 0x7fc02014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc00c06a0e0 0x7fc00c06c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 --2- 172.21.15.121:0/3731972750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc02014f9c0 0x7fc020151530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 >> 172.21.15.121:0/3731972750 conn(0x7fc0200c35a0 msgr2=0x7fc0200c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 shutdown_connections 2023-08-18T20:44:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.433+0000 7fc02501d700 1 -- 172.21.15.121:0/3731972750 wait complete. 2023-08-18T20:44:48.446 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:48.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.565+0000 7efe98f59700 1 Processor -- start 2023-08-18T20:44:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.565+0000 7efe98f59700 1 -- start start 2023-08-18T20:44:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe98f59700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 0x7efe940bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe98f59700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94151be0 con 0x7efe940c5130 2023-08-18T20:44:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe98f59700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940c20d0 con 0x7efe940c6560 2023-08-18T20:44:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe98f59700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9414ed20 con 0x7efe940c6120 2023-08-18T20:44:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe92d9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efe940c5130 0x7efe9415bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48916/0 (socket says 172.21.15.121:48916) 2023-08-18T20:44:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe92d9d700 1 -- 172.21.15.121:0/2483405620 learned_addr learned my addr 172.21.15.121:0/2483405620 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.566+0000 7efe9259c700 1 --2- 172.21.15.121:0/2483405620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 0x7efe940bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863256191 0 0) 0x7efe94151be0 con 0x7efe940c5130 2023-08-18T20:44:48.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe7c0035b0 con 0x7efe940c5130 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9259c700 1 -- 172.21.15.121:0/2483405620 >> v1:172.21.15.122:6789/0 conn(0x7efe940c6560 legacy=0x7efe940c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449212360 0 0) 0x7efe940c20d0 con 0x7efe940c6560 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9259c700 1 -- 172.21.15.121:0/2483405620 >> v1:172.21.15.121:6789/0 conn(0x7efe940c5130 legacy=0x7efe9415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9259c700 1 -- 172.21.15.121:0/2483405620 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940c23b0 con 0x7efe940c6120 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9259c700 1 --2- 172.21.15.121:0/2483405620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 0x7efe940bbd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52cca714a8d6057 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011830 con 0x7efe940c6120 2023-08-18T20:44:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88011990 con 0x7efe940c6120 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.567+0000 7efe9159a700 1 -- 172.21.15.121:0/2483405620 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011d00 con 0x7efe940c6120 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 -- 172.21.15.121:0/2483405620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 msgr2=0x7efe940bbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 --2- 172.21.15.121:0/2483405620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 0x7efe940bbd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe88009b80 comp rx=0 tx=0).stop 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 -- 172.21.15.121:0/2483405620 shutdown_connections 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 --2- 172.21.15.121:0/2483405620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6120 0x7efe940bbd80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 -- 172.21.15.121:0/2483405620 >> 172.21.15.121:0/2483405620 conn(0x7efe940c35a0 msgr2=0x7efe940c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 -- 172.21.15.121:0/2483405620 shutdown_connections 2023-08-18T20:44:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.568+0000 7efe98f59700 1 -- 172.21.15.121:0/2483405620 wait complete. 2023-08-18T20:44:48.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.569+0000 7efe98f59700 1 Processor -- start 2023-08-18T20:44:48.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.569+0000 7efe98f59700 1 -- start start 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940c5130 0x7efe940c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6560 0x7efe941e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940bfd70 con 0x7efe940c6120 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940bf740 con 0x7efe940c5130 2023-08-18T20:44:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe98f59700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe941ea5b0 con 0x7efe940c6560 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42338/0 (socket says 172.21.15.121:42338) 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 -- 172.21.15.121:0/2951158555 learned_addr learned my addr 172.21.15.121:0/2951158555 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe9259c700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940c5130 0x7efe940c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe92d9d700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6560 0x7efe941e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 -- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6560 msgr2=0x7efe941e9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6560 0x7efe941e9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 -- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940c5130 msgr2=0x7efe940c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940c5130 0x7efe940c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 -- 172.21.15.121:0/2951158555 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880094a0 con 0x7efe940c6120 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe91d9b700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efe8400e960 tx=0x7efe8400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.570+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84005480 con 0x7efe940c6120 2023-08-18T20:44:48.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.571+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84003680 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.571+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940bfa00 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.571+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84003a30 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.571+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe941e7ee0 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.571+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe940bff20 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.572+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe84003b90 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.573+0000 7efe82ffd700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 0x7efe7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.573+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6918+0+0 (secure 0 0 0) 0x7efe8408abf0 con 0x7efe940c6120 2023-08-18T20:44:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.573+0000 7efe9259c700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 0x7efe7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.573+0000 7efe9259c700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 0x7efe7406c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe880097c0 tx=0x7efe88008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.576+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efe840560f0 con 0x7efe940c6120 2023-08-18T20:44:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.769+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe9404e620 con 0x7efe940c6120 2023-08-18T20:44:48.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.771+0000 7efe82ffd700 1 -- 172.21.15.121:0/2951158555 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+22070 (secure 0 0 0) 0x7efe84059710 con 0x7efe940c6120 2023-08-18T20:44:48.772 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:48.772 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:47.468863+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 msgr2=0x7efe7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 0x7efe7406c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe880097c0 tx=0x7efe88008030 comp rx=0 tx=0).stop 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 msgr2=0x7efe941e77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efe8400e960 tx=0x7efe8400ec70 comp rx=0 tx=0).stop 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 shutdown_connections 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe940c6560 0x7efe941e9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940c5130 0x7efe940c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efe7406a0e0 0x7efe7406c5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 --2- 172.21.15.121:0/2951158555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe940c6120 0x7efe941e77c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 >> 172.21.15.121:0/2951158555 conn(0x7efe940c35a0 msgr2=0x7efe940c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 shutdown_connections 2023-08-18T20:44:48.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.773+0000 7efe98f59700 1 -- 172.21.15.121:0/2951158555 wait complete. 2023-08-18T20:44:48.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-08-18T20:44:48.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.908+0000 7f27a75bd700 1 Processor -- start 2023-08-18T20:44:48.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 -- start start 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f27a014ed30 0x7f27a00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00c2260 con 0x7f27a00c19d0 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00a6630 con 0x7f27a014ed30 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.909+0000 7f27a75bd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0151d90 con 0x7f27a014e950 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5b5a700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f27a00c19d0 0x7f27a00c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48930/0 (socket says 172.21.15.121:48930) 2023-08-18T20:44:48.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5b5a700 1 -- 172.21.15.121:0/1308531577 learned_addr learned my addr 172.21.15.121:0/1308531577 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 --2- 172.21.15.121:0/1308531577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a4b58700 1 --2- 172.21.15.121:0/1308531577 >> v2:172.21.15.122:3300/0 conn(0x7f27a014ed30 0x7f27a00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f2797fff700 1 -- 172.21.15.121:0/1308531577 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638867367 0 0) 0x7f27a00c2260 con 0x7f27a00c19d0 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f2797fff700 1 -- 172.21.15.121:0/1308531577 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c0035b0 con 0x7f27a00c19d0 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 -- 172.21.15.121:0/1308531577 >> v2:172.21.15.122:3300/0 conn(0x7f27a014ed30 msgr2=0x7f27a00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 --2- 172.21.15.121:0/1308531577 >> v2:172.21.15.122:3300/0 conn(0x7f27a014ed30 0x7f27a00c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 -- 172.21.15.121:0/1308531577 >> v1:172.21.15.121:6789/0 conn(0x7f27a00c19d0 legacy=0x7f27a00c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 -- 172.21.15.121:0/1308531577 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0152070 con 0x7f27a014e950 2023-08-18T20:44:48.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f27a5359700 1 --2- 172.21.15.121:0/1308531577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00c2ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22362c661c61ade0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f2797fff700 1 -- 172.21.15.121:0/1308531577 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790011830 con 0x7f27a014e950 2023-08-18T20:44:48.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f2797fff700 1 -- 172.21.15.121:0/1308531577 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790011990 con 0x7f27a014e950 2023-08-18T20:44:48.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.910+0000 7f2797fff700 1 -- 172.21.15.121:0/1308531577 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790011d20 con 0x7f27a014e950 2023-08-18T20:44:48.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 -- 172.21.15.121:0/1308531577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 msgr2=0x7f27a00c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 --2- 172.21.15.121:0/1308531577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00c2ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:48.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 -- 172.21.15.121:0/1308531577 shutdown_connections 2023-08-18T20:44:48.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 --2- 172.21.15.121:0/1308531577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00c2ed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 --2- 172.21.15.121:0/1308531577 >> v2:172.21.15.122:3300/0 conn(0x7f27a014ed30 0x7f27a00c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 -- 172.21.15.121:0/1308531577 >> 172.21.15.121:0/1308531577 conn(0x7f27a00c6b10 msgr2=0x7f27a00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 -- 172.21.15.121:0/1308531577 shutdown_connections 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.911+0000 7f27a75bd700 1 -- 172.21.15.121:0/1308531577 wait complete. 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.912+0000 7f27a75bd700 1 Processor -- start 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 -- start start 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a00c19d0 0x7f27a00c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a014d4e0 con 0x7f27a014ed30 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a01497d0 con 0x7f27a00c19d0 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.913+0000 7f27a75bd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00ac820 con 0x7f27a014e950 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42354/0 (socket says 172.21.15.121:42354) 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 -- 172.21.15.121:0/36951367 learned_addr learned my addr 172.21.15.121:0/36951367 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:48.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a4b58700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5359700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a00c19d0 0x7f27a00c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 -- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 msgr2=0x7f27a00bfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00bfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 -- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a00c19d0 msgr2=0x7f27a00c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a00c19d0 0x7f27a00c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 -- 172.21.15.121:0/36951367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900094a0 con 0x7f27a014ed30 2023-08-18T20:44:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a5b5a700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f279800cb40 tx=0x7f279800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279800ab50 con 0x7f27a014ed30 2023-08-18T20:44:48.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279800acb0 con 0x7f27a014ed30 2023-08-18T20:44:48.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a0148f30 con 0x7f27a014ed30 2023-08-18T20:44:48.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798012620 con 0x7f27a014ed30 2023-08-18T20:44:48.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.914+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a01494f0 con 0x7f27a014ed30 2023-08-18T20:44:48.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.915+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0074730 con 0x7f27a014ed30 2023-08-18T20:44:48.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.916+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f279801b3b0 con 0x7f27a014ed30 2023-08-18T20:44:48.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.916+0000 7f2795ffb700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 0x7f278406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:48.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.916+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f2798088630 con 0x7f27a014ed30 2023-08-18T20:44:48.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.916+0000 7f27a5359700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 0x7f278406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:48.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.916+0000 7f27a5359700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 0x7f278406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f2790008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:48.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:48.920+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2798053a50 con 0x7f27a014ed30 2023-08-18T20:44:49.053 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:44:49.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:44:49.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:49.163+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f27a0073700 con 0x7f27a014ed30 2023-08-18T20:44:50.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.084+0000 7f2795ffb700 1 -- 172.21.15.121:0/36951367 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 119+0+0 (secure 0 0 0) 0x7f2798057070 con 0x7f27a014ed30 2023-08-18T20:44:50.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 msgr2=0x7f278406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 0x7f278406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f2790008030 comp rx=0 tx=0).stop 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 msgr2=0x7f27a00c00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f279800cb40 tx=0x7f279800cf00 comp rx=0 tx=0).stop 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 shutdown_connections 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f278406a0e0 0x7f278406c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27a014ed30 0x7f27a00c00d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a00c19d0 0x7f27a00c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 --2- 172.21.15.121:0/36951367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27a014e950 0x7f27a00bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 >> 172.21.15.121:0/36951367 conn(0x7f27a00c6b10 msgr2=0x7f27a014e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:50.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 shutdown_connections 2023-08-18T20:44:50.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.087+0000 7f27a75bd700 1 -- 172.21.15.121:0/36951367 wait complete. 2023-08-18T20:44:50.102 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-18T20:44:50.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-08-18T20:44:50.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.270+0000 7f9c1eac2700 1 Processor -- start 2023-08-18T20:44:50.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.270+0000 7f9c1eac2700 1 -- start start 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1eac2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 0x7f9c1814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1eac2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1eac2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c181529a0 con 0x7f9c1806fd30 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1eac2700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c18152c80 con 0x7f9c180c7440 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1eac2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18152f60 con 0x7f9c18152450 2023-08-18T20:44:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1d05f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c17fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 0x7f9c1814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1d05f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:38768/0 (socket says 172.21.15.121:38768) 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c17fff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 0x7f9c1814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52196/0 (socket says 172.21.15.121:52196) 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.271+0000 7f9c1d05f700 1 -- 172.21.15.121:0/2296429529 learned_addr learned my addr 172.21.15.121:0/2296429529 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1d05f700 1 -- 172.21.15.121:0/2296429529 >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 msgr2=0x7f9c1814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1d05f700 1 --2- 172.21.15.121:0/2296429529 >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 0x7f9c1814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1d05f700 1 -- 172.21.15.121:0/2296429529 >> v1:172.21.15.122:6789/0 conn(0x7f9c1806fd30 legacy=0x7f9c180c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1d05f700 1 -- 172.21.15.121:0/2296429529 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18153240 con 0x7f9c18152450 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1d05f700 1 --2- 172.21.15.121:0/2296429529 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009e50 tx=0x7f9c1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4bce2252655b866 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c177fe700 1 -- 172.21.15.121:0/2296429529 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000e070 con 0x7f9c18152450 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c177fe700 1 -- 172.21.15.121:0/2296429529 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000b910 con 0x7f9c18152450 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c177fe700 1 -- 172.21.15.121:0/2296429529 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000bcc0 con 0x7f9c18152450 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 -- 172.21.15.121:0/2296429529 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 msgr2=0x7f9c1814f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/2296429529 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009e50 tx=0x7f9c1000b330 comp rx=0 tx=0).stop 2023-08-18T20:44:50.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 -- 172.21.15.121:0/2296429529 shutdown_connections 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/2296429529 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c18152450 0x7f9c1814f8f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/2296429529 >> v2:172.21.15.122:3300/0 conn(0x7f9c180c7440 0x7f9c1814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.272+0000 7f9c1eac2700 1 -- 172.21.15.121:0/2296429529 >> 172.21.15.121:0/2296429529 conn(0x7f9c180c7bf0 msgr2=0x7f9c180c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.273+0000 7f9c1eac2700 1 -- 172.21.15.121:0/2296429529 shutdown_connections 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.273+0000 7f9c1eac2700 1 -- 172.21.15.121:0/2296429529 wait complete. 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 Processor -- start 2023-08-18T20:44:50.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 -- start start 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c1806fd30 0x7f9c180bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c180c7440 0x7f9c180a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c0ce0 con 0x7f9c18152450 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180a67d0 con 0x7f9c180c7440 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.274+0000 7f9c1eac2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1806cde0 con 0x7f9c1806fd30 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42368/0 (socket says 172.21.15.121:42368) 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 -- 172.21.15.121:0/4013638669 learned_addr learned my addr 172.21.15.121:0/4013638669 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1c85e700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c1806fd30 0x7f9c180bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c17fff700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c180c7440 0x7f9c180a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 -- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c1806fd30 msgr2=0x7f9c180bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c1806fd30 0x7f9c180bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 -- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c180c7440 msgr2=0x7f9c180a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c180c7440 0x7f9c180a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 -- 172.21.15.121:0/4013638669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009b30 con 0x7f9c18152450 2023-08-18T20:44:50.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1d05f700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9c181530a0 tx=0x7f9c10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:50.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10003ea0 con 0x7f9c18152450 2023-08-18T20:44:50.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c100099b0 con 0x7f9c18152450 2023-08-18T20:44:50.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1806d0a0 con 0x7f9c18152450 2023-08-18T20:44:50.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1001c680 con 0x7f9c18152450 2023-08-18T20:44:50.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.275+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1806b450 con 0x7f9c18152450 2023-08-18T20:44:50.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.276+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c18074730 con 0x7f9c18152450 2023-08-18T20:44:50.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.277+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c1001c7e0 con 0x7f9c18152450 2023-08-18T20:44:50.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.277+0000 7f9c157fa700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 0x7f9bfc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:50.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.277+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9c1008a4f0 con 0x7f9c18152450 2023-08-18T20:44:50.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.277+0000 7f9c1c85e700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 0x7f9bfc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:50.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.277+0000 7f9c1c85e700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 0x7f9bfc06c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0016c0 tx=0x7f9c0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:50.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.281+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9c10055910 con 0x7f9c18152450 2023-08-18T20:44:50.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:50.513+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c1806f190 con 0x7f9c18152450 2023-08-18T20:44:51.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.089+0000 7f9c157fa700 1 -- 172.21.15.121:0/4013638669 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9c10058f30 con 0x7f9c18152450 2023-08-18T20:44:51.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.091+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 msgr2=0x7f9bfc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.091+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 0x7f9bfc06c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0016c0 tx=0x7f9c0c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:51.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.091+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 msgr2=0x7f9c180a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.091+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9c181530a0 tx=0x7f9c10004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 shutdown_connections 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9bfc06a0e0 0x7f9bfc06c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c18152450 0x7f9c180a6290 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c1806fd30 0x7f9c180bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 --2- 172.21.15.121:0/4013638669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c180c7440 0x7f9c180a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 >> 172.21.15.121:0/4013638669 conn(0x7f9c180c7bf0 msgr2=0x7f9c18155680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 shutdown_connections 2023-08-18T20:44:51.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.092+0000 7f9c1eac2700 1 -- 172.21.15.121:0/4013638669 wait complete. 2023-08-18T20:44:51.104 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-08-18T20:44:51.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:44:51.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.225+0000 7f1a6a1b3700 1 Processor -- start 2023-08-18T20:44:51.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.225+0000 7f1a6a1b3700 1 -- start start 2023-08-18T20:44:51.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a6a1b3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a6406b520 0x7f1a64072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a6a1b3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a64155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a6a1b3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a64066380 con 0x7f1a64152d30 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a6a1b3700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a641531b0 con 0x7f1a6406b520 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a6a1b3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64066080 con 0x7f1a64155820 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a62ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a64152d30 0x7f1a6414f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48954/0 (socket says 172.21.15.121:48954) 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a62ffd700 1 -- 172.21.15.121:0/4120558725 learned_addr learned my addr 172.21.15.121:0/4120558725 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4120558725 >> v2:172.21.15.122:3300/0 conn(0x7f1a6406b520 0x7f1a64072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a63fff700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a64155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999908204 0 0) 0x7f1a64066380 con 0x7f1a64152d30 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a500035b0 con 0x7f1a64152d30 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3737168646 0 0) 0x7f1a500035b0 con 0x7f1a64152d30 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 msgr2=0x7f1a64155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a64155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 >> v2:172.21.15.122:3300/0 conn(0x7f1a6406b520 msgr2=0x7f1a64072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 --2- 172.21.15.121:0/4120558725 >> v2:172.21.15.122:3300/0 conn(0x7f1a6406b520 0x7f1a64072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6406d0f0 con 0x7f1a64152d30 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.226+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1a4c0017f0 con 0x7f1a64152d30 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 >> v1:172.21.15.121:6789/0 conn(0x7f1a64152d30 legacy=0x7f1a6414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a50003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a50004d90 0x7f1a50005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641531b0 con 0x7f1a50003a70 2023-08-18T20:44:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64066080 con 0x7f1a50004d90 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5000ba60 con 0x7f1a64155820 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a50003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a62ffd700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a63fff700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a50004d90 0x7f1a50005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 -- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 msgr2=0x7f1a50004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a64155820 0x7f1a50004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 -- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a50004d90 msgr2=0x7f1a50005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a50004d90 0x7f1a50005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 -- 172.21.15.121:0/4120558725 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500035b0 con 0x7f1a50003a70 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a63fff700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a50004d90 0x7f1a50005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a50003e90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009b60 tx=0x7f1a50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c6334363881b03 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00e6c0 con 0x7f1a50003a70 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00e820 con 0x7f1a50003a70 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.227+0000 7f1a627fc700 1 -- 172.21.15.121:0/4120558725 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00eb90 con 0x7f1a50003a70 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4120558725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 msgr2=0x7f1a50003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4120558725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a50003e90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009b60 tx=0x7f1a50005880 comp rx=0 tx=0).stop 2023-08-18T20:44:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a63fff700 1 -- 172.21.15.121:0/4120558725 reap_dead start 2023-08-18T20:44:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4120558725 shutdown_connections 2023-08-18T20:44:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4120558725 >> 172.21.15.121:0/4120558725 conn(0x7f1a640c2ca0 msgr2=0x7f1a640c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4120558725 shutdown_connections 2023-08-18T20:44:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.228+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4120558725 wait complete. 2023-08-18T20:44:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.229+0000 7f1a6a1b3700 1 Processor -- start 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.229+0000 7f1a6a1b3700 1 -- start start 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a6414cdd0 0x7f1a641e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a640c5050 0x7f1a640c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6414c250 con 0x7f1a50003a70 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64149a70 con 0x7f1a6414cdd0 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641527a0 con 0x7f1a640c5050 2023-08-18T20:44:51.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42384/0 (socket says 172.21.15.121:42384) 2023-08-18T20:44:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 -- 172.21.15.121:0/4160739189 learned_addr learned my addr 172.21.15.121:0/4160739189 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a62ffd700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a6414cdd0 0x7f1a641e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a63fff700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a640c5050 0x7f1a640c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 -- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a640c5050 msgr2=0x7f1a640c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a640c5050 0x7f1a640c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 -- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a6414cdd0 msgr2=0x7f1a641e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a6414cdd0 0x7f1a641e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 -- 172.21.15.121:0/4160739189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64149ce0 con 0x7f1a50003a70 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a637fe700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0090b0 tx=0x7f1a5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c021070 con 0x7f1a50003a70 2023-08-18T20:44:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c004430 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64149fc0 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.230+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00e6c0 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.231+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64152a80 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.231+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a64074730 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.232+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a5c025070 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.232+0000 7f1a5bfff700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 0x7f1a4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.232+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1a5c089890 con 0x7f1a50003a70 2023-08-18T20:44:51.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.232+0000 7f1a62ffd700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 0x7f1a4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.232+0000 7f1a62ffd700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 0x7f1a4406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000ef0 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.236+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1a5c054dd0 con 0x7f1a50003a70 2023-08-18T20:44:51.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.467+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a6414cc20 con 0x7f1a50003a70 2023-08-18T20:44:51.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.468+0000 7f1a5bfff700 1 -- 172.21.15.121:0/4160739189 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6063 (secure 0 0 0) 0x7f1a5c0583f0 con 0x7f1a50003a70 2023-08-18T20:44:51.468 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:51.469 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:44:51.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 msgr2=0x7f1a4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 0x7f1a4406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000ef0 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 msgr2=0x7f1a641551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0090b0 tx=0x7f1a5c0047c0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 shutdown_connections 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a640c5050 0x7f1a640c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1a4406a0e0 0x7f1a4406c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a50003a70 0x7f1a641551e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 --2- 172.21.15.121:0/4160739189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a6414cdd0 0x7f1a641e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 >> 172.21.15.121:0/4160739189 conn(0x7f1a640c2ca0 msgr2=0x7f1a64155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 shutdown_connections 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.470+0000 7f1a6a1b3700 1 -- 172.21.15.121:0/4160739189 wait complete. 2023-08-18T20:44:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2023-08-18T20:44:51.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:51.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.601+0000 7fded46ca700 1 Processor -- start 2023-08-18T20:44:51.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.601+0000 7fded46ca700 1 -- start start 2023-08-18T20:44:51.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded46ca700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdecc14fb90 0x7fdecc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded46ca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc152250 0x7fdecc06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded46ca700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc155970 con 0x7fdecc06a7e0 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded46ca700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc14ff70 con 0x7fdecc14fb90 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded46ca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc06e830 con 0x7fdecc152250 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded2466700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdecc14fb90 0x7fdecc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded2466700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdecc14fb90 0x7fdecc0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42392/0 (socket says 172.21.15.121:42392) 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded2466700 1 -- 172.21.15.121:0/2195096042 learned_addr learned my addr 172.21.15.121:0/2195096042 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.602+0000 7fded1c65700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc152250 0x7fdecc06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded2466700 1 -- 172.21.15.121:0/2195096042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc152250 msgr2=0x7fdecc06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded2466700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc152250 0x7fdecc06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded2466700 1 -- 172.21.15.121:0/2195096042 >> v1:172.21.15.122:6789/0 conn(0x7fdecc06a7e0 legacy=0x7fdecc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded2466700 1 -- 172.21.15.121:0/2195096042 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc06df90 con 0x7fdecc14fb90 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded2466700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc14fb90 0x7fdecc0c5d10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0098f0 tx=0x7fdebc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fae19145f2a783a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded1464700 1 -- 172.21.15.121:0/2195096042 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc004230 con 0x7fdecc14fb90 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded1464700 1 -- 172.21.15.121:0/2195096042 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc004390 con 0x7fdecc14fb90 2023-08-18T20:44:51.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded1464700 1 -- 172.21.15.121:0/2195096042 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0036a0 con 0x7fdecc14fb90 2023-08-18T20:44:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 -- 172.21.15.121:0/2195096042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc14fb90 msgr2=0x7fdecc0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc14fb90 0x7fdecc0c5d10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0098f0 tx=0x7fdebc009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 -- 172.21.15.121:0/2195096042 shutdown_connections 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc14fb90 0x7fdecc0c5d10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 --2- 172.21.15.121:0/2195096042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc152250 0x7fdecc06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 -- 172.21.15.121:0/2195096042 >> 172.21.15.121:0/2195096042 conn(0x7fdecc0c6b10 msgr2=0x7fdecc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.603+0000 7fded46ca700 1 -- 172.21.15.121:0/2195096042 shutdown_connections 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.604+0000 7fded46ca700 1 -- 172.21.15.121:0/2195096042 wait complete. 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.605+0000 7fded46ca700 1 Processor -- start 2023-08-18T20:44:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.605+0000 7fded46ca700 1 -- start start 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc06a7e0 0x7fdecc14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 0x7fdecc1ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1549e0 con 0x7fdecc152250 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0c0670 con 0x7fdecc14fb90 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded46ca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc154700 con 0x7fdecc06a7e0 2023-08-18T20:44:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42402/0 (socket says 172.21.15.121:42402) 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 -- 172.21.15.121:0/3265281543 learned_addr learned my addr 172.21.15.121:0/3265281543 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded1c65700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 0x7fdecc1ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2466700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc06a7e0 0x7fdecc14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 -- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc06a7e0 msgr2=0x7fdecc14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc06a7e0 0x7fdecc14d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 -- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 msgr2=0x7fdecc1ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 0x7fdecc1ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 -- 172.21.15.121:0/3265281543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009550 con 0x7fdecc152250 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded1c65700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 0x7fdecc1ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.606+0000 7fded2c67700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdec400b970 tx=0x7fdec400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400c930 con 0x7fdecc152250 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400cad0 con 0x7fdecc152250 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0c0020 con 0x7fdecc152250 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400ce80 con 0x7fdecc152250 2023-08-18T20:44:51.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc14d5e0 con 0x7fdecc152250 2023-08-18T20:44:51.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.607+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc066cd0 con 0x7fdecc152250 2023-08-18T20:44:51.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.608+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdec4014440 con 0x7fdecc152250 2023-08-18T20:44:51.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.608+0000 7fdec2ffd700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 0x7fdeb006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.608+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fdec4088390 con 0x7fdecc152250 2023-08-18T20:44:51.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.608+0000 7fded2466700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 0x7fdeb006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.609+0000 7fded2466700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 0x7fdeb006c5d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009130 tx=0x7fdebc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.613+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdec4053860 con 0x7fdecc152250 2023-08-18T20:44:51.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.804+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdecc0bfe80 con 0x7fdecc152250 2023-08-18T20:44:51.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.805+0000 7fdec2ffd700 1 -- 172.21.15.121:0/3265281543 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7fdecc0bfe80 con 0x7fdecc152250 2023-08-18T20:44:51.806 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:51.807 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:51.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 msgr2=0x7fdeb006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 0x7fdeb006c5d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009130 tx=0x7fdebc008030 comp rx=0 tx=0).stop 2023-08-18T20:44:51.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 msgr2=0x7fdecc1ed070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdec400b970 tx=0x7fdec400bc80 comp rx=0 tx=0).stop 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 shutdown_connections 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdeb006a110 0x7fdeb006c5d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdecc152250 0x7fdecc1ed070 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdecc06a7e0 0x7fdecc14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 --2- 172.21.15.121:0/3265281543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdecc14fb90 0x7fdecc1ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 >> 172.21.15.121:0/3265281543 conn(0x7fdecc0c6b10 msgr2=0x7fdecc155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 shutdown_connections 2023-08-18T20:44:51.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.807+0000 7fded46ca700 1 -- 172.21.15.121:0/3265281543 wait complete. 2023-08-18T20:44:51.820 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-18T20:44:51.820 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:51.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.940+0000 7f8b59d72700 1 Processor -- start 2023-08-18T20:44:51.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.940+0000 7f8b59d72700 1 -- start start 2023-08-18T20:44:51.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b59d72700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 0x7f8b540c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b59d72700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b540c37c0 0x7f8b54151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b59d72700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b54150d80 con 0x7f8b54070150 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b59d72700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540c10c0 con 0x7f8b540c37c0 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b59d72700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540c2510 con 0x7f8b5414a8c0 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b540c37c0 0x7f8b54151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b540c37c0 0x7f8b54151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42408/0 (socket says 172.21.15.121:42408) 2023-08-18T20:44:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b53fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8b54070150 0x7f8b5406b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48988/0 (socket says 172.21.15.121:48988) 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 -- 172.21.15.121:0/2065887537 learned_addr learned my addr 172.21.15.121:0/2065887537 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b537fe700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 0x7f8b540c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 -- 172.21.15.121:0/2065887537 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 msgr2=0x7f8b540c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 0x7f8b540c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 -- 172.21.15.121:0/2065887537 >> v1:172.21.15.121:6789/0 conn(0x7f8b54070150 legacy=0x7f8b5406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b527fc700 1 -- 172.21.15.121:0/2065887537 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716804108 0 0) 0x7f8b54150d80 con 0x7f8b54070150 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 -- 172.21.15.121:0/2065887537 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540c2a90 con 0x7f8b540c37c0 2023-08-18T20:44:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b537fe700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 0x7f8b540c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b52ffd700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b540c37c0 0x7f8b54151210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8b48006fd0 tx=0x7f8b4800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a3b268c5a11b74 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b527fc700 1 -- 172.21.15.121:0/2065887537 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48005c20 con 0x7f8b540c37c0 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.941+0000 7f8b527fc700 1 -- 172.21.15.121:0/2065887537 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48005d80 con 0x7f8b540c37c0 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b527fc700 1 -- 172.21.15.121:0/2065887537 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800dc40 con 0x7f8b540c37c0 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 -- 172.21.15.121:0/2065887537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b540c37c0 msgr2=0x7f8b54151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b540c37c0 0x7f8b54151210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8b48006fd0 tx=0x7f8b4800be70 comp rx=0 tx=0).stop 2023-08-18T20:44:51.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 -- 172.21.15.121:0/2065887537 shutdown_connections 2023-08-18T20:44:51.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5414a8c0 0x7f8b540c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 --2- 172.21.15.121:0/2065887537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b540c37c0 0x7f8b54151210 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 -- 172.21.15.121:0/2065887537 >> 172.21.15.121:0/2065887537 conn(0x7f8b540c2ca0 msgr2=0x7f8b540c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:51.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 -- 172.21.15.121:0/2065887537 shutdown_connections 2023-08-18T20:44:51.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.942+0000 7f8b59d72700 1 -- 172.21.15.121:0/2065887537 wait complete. 2023-08-18T20:44:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.943+0000 7f8b59d72700 1 Processor -- start 2023-08-18T20:44:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 -- start start 2023-08-18T20:44:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b540c37c0 0x7f8b541e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5414a8c0 0x7f8b541da560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54154330 con 0x7f8b54070150 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541e9300 con 0x7f8b5414a8c0 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b59d72700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541545d0 con 0x7f8b540c37c0 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b537fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b537fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42410/0 (socket says 172.21.15.121:42410) 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.944+0000 7f8b537fe700 1 -- 172.21.15.121:0/1507383378 learned_addr learned my addr 172.21.15.121:0/1507383378 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b52ffd700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b540c37c0 0x7f8b541e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 -- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b540c37c0 msgr2=0x7f8b541e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b540c37c0 0x7f8b541e89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 -- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5414a8c0 msgr2=0x7f8b541da560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5414a8c0 0x7f8b541da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 -- 172.21.15.121:0/1507383378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4800b7a0 con 0x7f8b54070150 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b537fe700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00cf60 tx=0x7f8b4c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c015440 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0155a0 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b541e95e0 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c015930 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.945+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b541e8f20 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.946+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b54074730 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.946+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b4c015a90 con 0x7f8b54070150 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.947+0000 7f8b3bfff700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.947+0000 7f8b52ffd700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.947+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8b4c088cf0 con 0x7f8b54070150 2023-08-18T20:44:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.947+0000 7f8b52ffd700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b5414ee10 tx=0x7f8b4800bf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:51.951+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8b4c08d070 con 0x7f8b54070150 2023-08-18T20:44:52.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.138+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b540c27b0 con 0x7f8b4006a0e0 2023-08-18T20:44:52.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.151+0000 7f8b3bfff700 1 -- 172.21.15.121:0/1507383378 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+535131 (secure 0 0 0) 0x7f8b4801e040 con 0x7f8b4006a0e0 2023-08-18T20:44:52.156 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 msgr2=0x7f8b4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b5414ee10 tx=0x7f8b4800bf90 comp rx=0 tx=0).stop 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 msgr2=0x7f8b54151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00cf60 tx=0x7f8b4c00cf90 comp rx=0 tx=0).stop 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 shutdown_connections 2023-08-18T20:44:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5414a8c0 0x7f8b541da560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b54070150 0x7f8b54151fb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 --2- 172.21.15.121:0/1507383378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b540c37c0 0x7f8b541e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.155+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 >> 172.21.15.121:0/1507383378 conn(0x7f8b540c2ca0 msgr2=0x7f8b5414f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.156+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 shutdown_connections 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.156+0000 7f8b59d72700 1 -- 172.21.15.121:0/1507383378 wait complete. 2023-08-18T20:44:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:52.168 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-08-18T20:44:50.930796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4202496,"data_stored":2383202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.876041"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.023009+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:35.023009+0000","last_peered":"2023-08-18T20:44:35.023009+0000","last_clean":"2023-08-18T20:44:35.023009+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:35.023009+0000","last_undegraded":"2023-08-18T20:44:35.023009+0000","last_fullsized":"2023-08-18T20:44:35.023009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:10:42.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:45.828686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685753+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:35.685753+0000","last_peered":"2023-08-18T20:44:35.685753+0000","last_clean":"2023-08-18T20:44:35.685753+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:35.685753+0000","last_undegraded":"2023-08-18T20:44:35.685753+0000","last_fullsized":"2023-08-18T20:44:35.685753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022591+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:35.022591+0000","last_peered":"2023-08-18T20:44:35.022591+0000","last_clean":"2023-08-18T20:44:35.022591+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:35.022591+0000","last_undegraded":"2023-08-18T20:44:35.022591+0000","last_fullsized":"2023-08-18T20:44:35.022591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:22:33.873991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022271+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:35.022271+0000","last_peered":"2023-08-18T20:44:35.022271+0000","last_clean":"2023-08-18T20:44:35.022271+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:35.022271+0000","last_undegraded":"2023-08-18T20:44:35.022271+0000","last_fullsized":"2023-08-18T20:44:35.022271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686137+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:35.686137+0000","last_peered":"2023-08-18T20:44:35.686137+0000","last_clean":"2023-08-18T20:44:35.686137+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:35.686137+0000","last_undegraded":"2023-08-18T20:44:35.686137+0000","last_fullsized":"2023-08-18T20:44:35.686137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022546+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:35.022546+0000","last_peered":"2023-08-18T20:44:35.022546+0000","last_clean":"2023-08-18T20:44:35.022546+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:35.022546+0000","last_undegraded":"2023-08-18T20:44:35.022546+0000","last_fullsized":"2023-08-18T20:44:35.022546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:11:54.581845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685907+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:35.685907+0000","last_peered":"2023-08-18T20:44:35.685907+0000","last_clean":"2023-08-18T20:44:35.685907+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:35.685907+0000","last_undegraded":"2023-08-18T20:44:35.685907+0000","last_fullsized":"2023-08-18T20:44:35.685907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185071+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:35.185071+0000","last_peered":"2023-08-18T20:44:35.185071+0000","last_clean":"2023-08-18T20:44:35.185071+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:35.185071+0000","last_undegraded":"2023-08-18T20:44:35.185071+0000","last_fullsized":"2023-08-18T20:44:35.185071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673943+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:35.673943+0000","last_peered":"2023-08-18T20:44:35.673943+0000","last_clean":"2023-08-18T20:44:35.673943+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:35.673943+0000","last_undegraded":"2023-08-18T20:44:35.673943+0000","last_fullsized":"2023-08-18T20:44:35.673943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:06.349596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674089+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:35.674089+0000","last_peered":"2023-08-18T20:44:35.674089+0000","last_clean":"2023-08-18T20:44:35.674089+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:35.674089+0000","last_undegraded":"2023-08-18T20:44:35.674089+0000","last_fullsized":"2023-08-18T20:44:35.674089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022154+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:35.022154+0000","last_peered":"2023-08-18T20:44:35.022154+0000","last_clean":"2023-08-18T20:44:35.022154+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:35.022154+0000","last_undegraded":"2023-08-18T20:44:35.022154+0000","last_fullsized":"2023-08-18T20:44:35.022154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:16:09.185476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673769+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:35.673769+0000","last_peered":"2023-08-18T20:44:35.673769+0000","last_clean":"2023-08-18T20:44:35.673769+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:35.673769+0000","last_undegraded":"2023-08-18T20:44:35.673769+0000","last_fullsized":"2023-08-18T20:44:35.673769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:31:37.239696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:36.026211+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:36.026211+0000","last_peered":"2023-08-18T20:44:36.026211+0000","last_clean":"2023-08-18T20:44:36.026211+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:36.026211+0000","last_undegraded":"2023-08-18T20:44:36.026211+0000","last_fullsized":"2023-08-18T20:44:36.026211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:50.840801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674222+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:35.674222+0000","last_peered":"2023-08-18T20:44:35.674222+0000","last_clean":"2023-08-18T20:44:35.674222+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:35.674222+0000","last_undegraded":"2023-08-18T20:44:35.674222+0000","last_fullsized":"2023-08-18T20:44:35.674222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:15:17.512476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674171+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:35.674171+0000","last_peered":"2023-08-18T20:44:35.674171+0000","last_clean":"2023-08-18T20:44:35.674171+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:35.674171+0000","last_undegraded":"2023-08-18T20:44:35.674171+0000","last_fullsized":"2023-08-18T20:44:35.674171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685950+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:35.685950+0000","last_peered":"2023-08-18T20:44:35.685950+0000","last_clean":"2023-08-18T20:44:35.685950+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:35.685950+0000","last_undegraded":"2023-08-18T20:44:35.685950+0000","last_fullsized":"2023-08-18T20:44:35.685950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:35.317206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022060+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:35.022060+0000","last_peered":"2023-08-18T20:44:35.022060+0000","last_clean":"2023-08-18T20:44:35.022060+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:35.022060+0000","last_undegraded":"2023-08-18T20:44:35.022060+0000","last_fullsized":"2023-08-18T20:44:35.022060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:25.883578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686101+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:35.686101+0000","last_peered":"2023-08-18T20:44:35.686101+0000","last_clean":"2023-08-18T20:44:35.686101+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:35.686101+0000","last_undegraded":"2023-08-18T20:44:35.686101+0000","last_fullsized":"2023-08-18T20:44:35.686101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185250+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:35.185250+0000","last_peered":"2023-08-18T20:44:35.185250+0000","last_clean":"2023-08-18T20:44:35.185250+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:35.185250+0000","last_undegraded":"2023-08-18T20:44:35.185250+0000","last_fullsized":"2023-08-18T20:44:35.185250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185235+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:35.185235+0000","last_peered":"2023-08-18T20:44:35.185235+0000","last_clean":"2023-08-18T20:44:35.185235+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:35.185235+0000","last_undegraded":"2023-08-18T20:44:35.185235+0000","last_fullsized":"2023-08-18T20:44:35.185235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674165+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:35.674165+0000","last_peered":"2023-08-18T20:44:35.674165+0000","last_clean":"2023-08-18T20:44:35.674165+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:35.674165+0000","last_undegraded":"2023-08-18T20:44:35.674165+0000","last_fullsized":"2023-08-18T20:44:35.674165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686388+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:35.686388+0000","last_peered":"2023-08-18T20:44:35.686388+0000","last_clean":"2023-08-18T20:44:35.686388+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:35.686388+0000","last_undegraded":"2023-08-18T20:44:35.686388+0000","last_fullsized":"2023-08-18T20:44:35.686388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:58:22.457124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686008+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:35.686008+0000","last_peered":"2023-08-18T20:44:35.686008+0000","last_clean":"2023-08-18T20:44:35.686008+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:35.686008+0000","last_undegraded":"2023-08-18T20:44:35.686008+0000","last_fullsized":"2023-08-18T20:44:35.686008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:42.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686364+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:35.686364+0000","last_peered":"2023-08-18T20:44:35.686364+0000","last_clean":"2023-08-18T20:44:35.686364+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:35.686364+0000","last_undegraded":"2023-08-18T20:44:35.686364+0000","last_fullsized":"2023-08-18T20:44:35.686364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:12.619573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021190+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:35.021190+0000","last_peered":"2023-08-18T20:44:35.021190+0000","last_clean":"2023-08-18T20:44:35.021190+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:35.021190+0000","last_undegraded":"2023-08-18T20:44:35.021190+0000","last_fullsized":"2023-08-18T20:44:35.021190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:08:53.195511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185023+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:35.185023+0000","last_peered":"2023-08-18T20:44:35.185023+0000","last_clean":"2023-08-18T20:44:35.185023+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.185023+0000","last_undegraded":"2023-08-18T20:44:35.185023+0000","last_fullsized":"2023-08-18T20:44:35.185023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674039+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:35.674039+0000","last_peered":"2023-08-18T20:44:35.674039+0000","last_clean":"2023-08-18T20:44:35.674039+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:35.674039+0000","last_undegraded":"2023-08-18T20:44:35.674039+0000","last_fullsized":"2023-08-18T20:44:35.674039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021423+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:35.021423+0000","last_peered":"2023-08-18T20:44:35.021423+0000","last_clean":"2023-08-18T20:44:35.021423+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:35.021423+0000","last_undegraded":"2023-08-18T20:44:35.021423+0000","last_fullsized":"2023-08-18T20:44:35.021423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:14:20.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021094+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:35.021094+0000","last_peered":"2023-08-18T20:44:35.021094+0000","last_clean":"2023-08-18T20:44:35.021094+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:35.021094+0000","last_undegraded":"2023-08-18T20:44:35.021094+0000","last_fullsized":"2023-08-18T20:44:35.021094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:19:26.408213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685666+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:35.685666+0000","last_peered":"2023-08-18T20:44:35.685666+0000","last_clean":"2023-08-18T20:44:35.685666+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:35.685666+0000","last_undegraded":"2023-08-18T20:44:35.685666+0000","last_fullsized":"2023-08-18T20:44:35.685666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:13.854640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021160+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:35.021160+0000","last_peered":"2023-08-18T20:44:35.021160+0000","last_clean":"2023-08-18T20:44:35.021160+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:35.021160+0000","last_undegraded":"2023-08-18T20:44:35.021160+0000","last_fullsized":"2023-08-18T20:44:35.021160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:54:26.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673775+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:35.673775+0000","last_peered":"2023-08-18T20:44:35.673775+0000","last_clean":"2023-08-18T20:44:35.673775+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:35.673775+0000","last_undegraded":"2023-08-18T20:44:35.673775+0000","last_fullsized":"2023-08-18T20:44:35.673775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686207+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:35.686207+0000","last_peered":"2023-08-18T20:44:35.686207+0000","last_clean":"2023-08-18T20:44:35.686207+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:35.686207+0000","last_undegraded":"2023-08-18T20:44:35.686207+0000","last_fullsized":"2023-08-18T20:44:35.686207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:35.821786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021527+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:35.021527+0000","last_peered":"2023-08-18T20:44:35.021527+0000","last_clean":"2023-08-18T20:44:35.021527+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:35.021527+0000","last_undegraded":"2023-08-18T20:44:35.021527+0000","last_fullsized":"2023-08-18T20:44:35.021527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:19:55.961983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021296+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:35.021296+0000","last_peered":"2023-08-18T20:44:35.021296+0000","last_clean":"2023-08-18T20:44:35.021296+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:35.021296+0000","last_undegraded":"2023-08-18T20:44:35.021296+0000","last_fullsized":"2023-08-18T20:44:35.021296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:47.584015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686429+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:35.686429+0000","last_peered":"2023-08-18T20:44:35.686429+0000","last_clean":"2023-08-18T20:44:35.686429+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:35.686429+0000","last_undegraded":"2023-08-18T20:44:35.686429+0000","last_fullsized":"2023-08-18T20:44:35.686429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:40.068512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686553+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:35.686553+0000","last_peered":"2023-08-18T20:44:35.686553+0000","last_clean":"2023-08-18T20:44:35.686553+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:35.686553+0000","last_undegraded":"2023-08-18T20:44:35.686553+0000","last_fullsized":"2023-08-18T20:44:35.686553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:15:21.504162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021887+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:35.021887+0000","last_peered":"2023-08-18T20:44:35.021887+0000","last_clean":"2023-08-18T20:44:35.021887+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:35.021887+0000","last_undegraded":"2023-08-18T20:44:35.021887+0000","last_fullsized":"2023-08-18T20:44:35.021887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:14.155493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021905+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:35.021905+0000","last_peered":"2023-08-18T20:44:35.021905+0000","last_clean":"2023-08-18T20:44:35.021905+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:35.021905+0000","last_undegraded":"2023-08-18T20:44:35.021905+0000","last_fullsized":"2023-08-18T20:44:35.021905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:28.147788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185084+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:35.185084+0000","last_peered":"2023-08-18T20:44:35.185084+0000","last_clean":"2023-08-18T20:44:35.185084+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:35.185084+0000","last_undegraded":"2023-08-18T20:44:35.185084+0000","last_fullsized":"2023-08-18T20:44:35.185084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:15.995149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673938+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:35.673938+0000","last_peered":"2023-08-18T20:44:35.673938+0000","last_clean":"2023-08-18T20:44:35.673938+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:35.673938+0000","last_undegraded":"2023-08-18T20:44:35.673938+0000","last_fullsized":"2023-08-18T20:44:35.673938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:14.990143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184974+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:35.184974+0000","last_peered":"2023-08-18T20:44:35.184974+0000","last_clean":"2023-08-18T20:44:35.184974+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:35.184974+0000","last_undegraded":"2023-08-18T20:44:35.184974+0000","last_fullsized":"2023-08-18T20:44:35.184974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022202+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:35.022202+0000","last_peered":"2023-08-18T20:44:35.022202+0000","last_clean":"2023-08-18T20:44:35.022202+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:35.022202+0000","last_undegraded":"2023-08-18T20:44:35.022202+0000","last_fullsized":"2023-08-18T20:44:35.022202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:00.662486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673788+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:35.673788+0000","last_peered":"2023-08-18T20:44:35.673788+0000","last_clean":"2023-08-18T20:44:35.673788+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:35.673788+0000","last_undegraded":"2023-08-18T20:44:35.673788+0000","last_fullsized":"2023-08-18T20:44:35.673788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:12.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184870+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:35.184870+0000","last_peered":"2023-08-18T20:44:35.184870+0000","last_clean":"2023-08-18T20:44:35.184870+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:35.184870+0000","last_undegraded":"2023-08-18T20:44:35.184870+0000","last_fullsized":"2023-08-18T20:44:35.184870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185166+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:35.185166+0000","last_peered":"2023-08-18T20:44:35.185166+0000","last_clean":"2023-08-18T20:44:35.185166+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:35.185166+0000","last_undegraded":"2023-08-18T20:44:35.185166+0000","last_fullsized":"2023-08-18T20:44:35.185166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686047+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:35.686047+0000","last_peered":"2023-08-18T20:44:35.686047+0000","last_clean":"2023-08-18T20:44:35.686047+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:35.686047+0000","last_undegraded":"2023-08-18T20:44:35.686047+0000","last_fullsized":"2023-08-18T20:44:35.686047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"33'9","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:41.133995+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:41.133995+0000","last_peered":"2023-08-18T20:44:41.133995+0000","last_clean":"2023-08-18T20:44:41.133995+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:41.133995+0000","last_undegraded":"2023-08-18T20:44:41.133995+0000","last_fullsized":"2023-08-18T20:44:41.133995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:34.376644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686532+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:35.686532+0000","last_peered":"2023-08-18T20:44:35.686532+0000","last_clean":"2023-08-18T20:44:35.686532+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:35.686532+0000","last_undegraded":"2023-08-18T20:44:35.686532+0000","last_fullsized":"2023-08-18T20:44:35.686532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:41:34.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022064+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:35.022064+0000","last_peered":"2023-08-18T20:44:35.022064+0000","last_clean":"2023-08-18T20:44:35.022064+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:35.022064+0000","last_undegraded":"2023-08-18T20:44:35.022064+0000","last_fullsized":"2023-08-18T20:44:35.022064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:21:05.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686136+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:35.686136+0000","last_peered":"2023-08-18T20:44:35.686136+0000","last_clean":"2023-08-18T20:44:35.686136+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:35.686136+0000","last_undegraded":"2023-08-18T20:44:35.686136+0000","last_fullsized":"2023-08-18T20:44:35.686136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021526+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:35.021526+0000","last_peered":"2023-08-18T20:44:35.021526+0000","last_clean":"2023-08-18T20:44:35.021526+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:35.021526+0000","last_undegraded":"2023-08-18T20:44:35.021526+0000","last_fullsized":"2023-08-18T20:44:35.021526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:30:54.763621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674145+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:35.674145+0000","last_peered":"2023-08-18T20:44:35.674145+0000","last_clean":"2023-08-18T20:44:35.674145+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:35.674145+0000","last_undegraded":"2023-08-18T20:44:35.674145+0000","last_fullsized":"2023-08-18T20:44:35.674145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:38.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185223+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:35.185223+0000","last_peered":"2023-08-18T20:44:35.185223+0000","last_clean":"2023-08-18T20:44:35.185223+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:35.185223+0000","last_undegraded":"2023-08-18T20:44:35.185223+0000","last_fullsized":"2023-08-18T20:44:35.185223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:37.595262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021269+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:35.021269+0000","last_peered":"2023-08-18T20:44:35.021269+0000","last_clean":"2023-08-18T20:44:35.021269+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:35.021269+0000","last_undegraded":"2023-08-18T20:44:35.021269+0000","last_fullsized":"2023-08-18T20:44:35.021269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:10:19.922914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686003+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:35.686003+0000","last_peered":"2023-08-18T20:44:35.686003+0000","last_clean":"2023-08-18T20:44:35.686003+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:35.686003+0000","last_undegraded":"2023-08-18T20:44:35.686003+0000","last_fullsized":"2023-08-18T20:44:35.686003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:29.096868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185127+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:35.185127+0000","last_peered":"2023-08-18T20:44:35.185127+0000","last_clean":"2023-08-18T20:44:35.185127+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:35.185127+0000","last_undegraded":"2023-08-18T20:44:35.185127+0000","last_fullsized":"2023-08-18T20:44:35.185127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.810386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686171+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:35.686171+0000","last_peered":"2023-08-18T20:44:35.686171+0000","last_clean":"2023-08-18T20:44:35.686171+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:35.686171+0000","last_undegraded":"2023-08-18T20:44:35.686171+0000","last_fullsized":"2023-08-18T20:44:35.686171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:38.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686345+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:35.686345+0000","last_peered":"2023-08-18T20:44:35.686345+0000","last_clean":"2023-08-18T20:44:35.686345+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:35.686345+0000","last_undegraded":"2023-08-18T20:44:35.686345+0000","last_fullsized":"2023-08-18T20:44:35.686345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:08:58.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674020+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:35.674020+0000","last_peered":"2023-08-18T20:44:35.674020+0000","last_clean":"2023-08-18T20:44:35.674020+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:35.674020+0000","last_undegraded":"2023-08-18T20:44:35.674020+0000","last_fullsized":"2023-08-18T20:44:35.674020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:22.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022453+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:35.022453+0000","last_peered":"2023-08-18T20:44:35.022453+0000","last_clean":"2023-08-18T20:44:35.022453+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:35.022453+0000","last_undegraded":"2023-08-18T20:44:35.022453+0000","last_fullsized":"2023-08-18T20:44:35.022453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:00:07.822682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021626+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:35.021626+0000","last_peered":"2023-08-18T20:44:35.021626+0000","last_clean":"2023-08-18T20:44:35.021626+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:35.021626+0000","last_undegraded":"2023-08-18T20:44:35.021626+0000","last_fullsized":"2023-08-18T20:44:35.021626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:02.246115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685538+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:35.685538+0000","last_peered":"2023-08-18T20:44:35.685538+0000","last_clean":"2023-08-18T20:44:35.685538+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:35.685538+0000","last_undegraded":"2023-08-18T20:44:35.685538+0000","last_fullsized":"2023-08-18T20:44:35.685538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:12:44.118040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686474+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:35.686474+0000","last_peered":"2023-08-18T20:44:35.686474+0000","last_clean":"2023-08-18T20:44:35.686474+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:35.686474+0000","last_undegraded":"2023-08-18T20:44:35.686474+0000","last_fullsized":"2023-08-18T20:44:35.686474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.149467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185136+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:35.185136+0000","last_peered":"2023-08-18T20:44:35.185136+0000","last_clean":"2023-08-18T20:44:35.185136+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:35.185136+0000","last_undegraded":"2023-08-18T20:44:35.185136+0000","last_fullsized":"2023-08-18T20:44:35.185136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:23.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686469+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:35.686469+0000","last_peered":"2023-08-18T20:44:35.686469+0000","last_clean":"2023-08-18T20:44:35.686469+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:35.686469+0000","last_undegraded":"2023-08-18T20:44:35.686469+0000","last_fullsized":"2023-08-18T20:44:35.686469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:11:37.290795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686446+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:35.686446+0000","last_peered":"2023-08-18T20:44:35.686446+0000","last_clean":"2023-08-18T20:44:35.686446+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:35.686446+0000","last_undegraded":"2023-08-18T20:44:35.686446+0000","last_fullsized":"2023-08-18T20:44:35.686446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:57:06.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686216+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:35.686216+0000","last_peered":"2023-08-18T20:44:35.686216+0000","last_clean":"2023-08-18T20:44:35.686216+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:35.686216+0000","last_undegraded":"2023-08-18T20:44:35.686216+0000","last_fullsized":"2023-08-18T20:44:35.686216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:47.071148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686382+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:35.686382+0000","last_peered":"2023-08-18T20:44:35.686382+0000","last_clean":"2023-08-18T20:44:35.686382+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:35.686382+0000","last_undegraded":"2023-08-18T20:44:35.686382+0000","last_fullsized":"2023-08-18T20:44:35.686382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:40.808594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022926+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:35.022926+0000","last_peered":"2023-08-18T20:44:35.022926+0000","last_clean":"2023-08-18T20:44:35.022926+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:35.022926+0000","last_undegraded":"2023-08-18T20:44:35.022926+0000","last_fullsized":"2023-08-18T20:44:35.022926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:39.803589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674105+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:35.674105+0000","last_peered":"2023-08-18T20:44:35.674105+0000","last_clean":"2023-08-18T20:44:35.674105+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:35.674105+0000","last_undegraded":"2023-08-18T20:44:35.674105+0000","last_fullsized":"2023-08-18T20:44:35.674105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:35.381650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685586+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:35.685586+0000","last_peered":"2023-08-18T20:44:35.685586+0000","last_clean":"2023-08-18T20:44:35.685586+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:35.685586+0000","last_undegraded":"2023-08-18T20:44:35.685586+0000","last_fullsized":"2023-08-18T20:44:35.685586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673985+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:35.673985+0000","last_peered":"2023-08-18T20:44:35.673985+0000","last_clean":"2023-08-18T20:44:35.673985+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:35.673985+0000","last_undegraded":"2023-08-18T20:44:35.673985+0000","last_fullsized":"2023-08-18T20:44:35.673985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022178+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:35.022178+0000","last_peered":"2023-08-18T20:44:35.022178+0000","last_clean":"2023-08-18T20:44:35.022178+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:35.022178+0000","last_undegraded":"2023-08-18T20:44:35.022178+0000","last_fullsized":"2023-08-18T20:44:35.022178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022145+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:35.022145+0000","last_peered":"2023-08-18T20:44:35.022145+0000","last_clean":"2023-08-18T20:44:35.022145+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:35.022145+0000","last_undegraded":"2023-08-18T20:44:35.022145+0000","last_fullsized":"2023-08-18T20:44:35.022145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021715+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:35.021715+0000","last_peered":"2023-08-18T20:44:35.021715+0000","last_clean":"2023-08-18T20:44:35.021715+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:35.021715+0000","last_undegraded":"2023-08-18T20:44:35.021715+0000","last_fullsized":"2023-08-18T20:44:35.021715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:37.673955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022572+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:35.022572+0000","last_peered":"2023-08-18T20:44:35.022572+0000","last_clean":"2023-08-18T20:44:35.022572+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:35.022572+0000","last_undegraded":"2023-08-18T20:44:35.022572+0000","last_fullsized":"2023-08-18T20:44:35.022572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686401+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:35.686401+0000","last_peered":"2023-08-18T20:44:35.686401+0000","last_clean":"2023-08-18T20:44:35.686401+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:35.686401+0000","last_undegraded":"2023-08-18T20:44:35.686401+0000","last_fullsized":"2023-08-18T20:44:35.686401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022784+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:35.022784+0000","last_peered":"2023-08-18T20:44:35.022784+0000","last_clean":"2023-08-18T20:44:35.022784+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:35.022784+0000","last_undegraded":"2023-08-18T20:44:35.022784+0000","last_fullsized":"2023-08-18T20:44:35.022784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:36.826792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021052+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:35.021052+0000","last_peered":"2023-08-18T20:44:35.021052+0000","last_clean":"2023-08-18T20:44:35.021052+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:35.021052+0000","last_undegraded":"2023-08-18T20:44:35.021052+0000","last_fullsized":"2023-08-18T20:44:35.021052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:10:15.545511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673869+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:35.673869+0000","last_peered":"2023-08-18T20:44:35.673869+0000","last_clean":"2023-08-18T20:44:35.673869+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:35.673869+0000","last_undegraded":"2023-08-18T20:44:35.673869+0000","last_fullsized":"2023-08-18T20:44:35.673869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686144+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:35.686144+0000","last_peered":"2023-08-18T20:44:35.686144+0000","last_clean":"2023-08-18T20:44:35.686144+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:35.686144+0000","last_undegraded":"2023-08-18T20:44:35.686144+0000","last_fullsized":"2023-08-18T20:44:35.686144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:12:36.239200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022047+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:35.022047+0000","last_peered":"2023-08-18T20:44:35.022047+0000","last_clean":"2023-08-18T20:44:35.022047+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:35.022047+0000","last_undegraded":"2023-08-18T20:44:35.022047+0000","last_fullsized":"2023-08-18T20:44:35.022047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:55.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022431+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:35.022431+0000","last_peered":"2023-08-18T20:44:35.022431+0000","last_clean":"2023-08-18T20:44:35.022431+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:35.022431+0000","last_undegraded":"2023-08-18T20:44:35.022431+0000","last_fullsized":"2023-08-18T20:44:35.022431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021198+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:35.021198+0000","last_peered":"2023-08-18T20:44:35.021198+0000","last_clean":"2023-08-18T20:44:35.021198+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:35.021198+0000","last_undegraded":"2023-08-18T20:44:35.021198+0000","last_fullsized":"2023-08-18T20:44:35.021198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:14.550052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674256+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:35.674256+0000","last_peered":"2023-08-18T20:44:35.674256+0000","last_clean":"2023-08-18T20:44:35.674256+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:35.674256+0000","last_undegraded":"2023-08-18T20:44:35.674256+0000","last_fullsized":"2023-08-18T20:44:35.674256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:07.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673718+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:35.673718+0000","last_peered":"2023-08-18T20:44:35.673718+0000","last_clean":"2023-08-18T20:44:35.673718+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:35.673718+0000","last_undegraded":"2023-08-18T20:44:35.673718+0000","last_fullsized":"2023-08-18T20:44:35.673718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022446+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:35.022446+0000","last_peered":"2023-08-18T20:44:35.022446+0000","last_clean":"2023-08-18T20:44:35.022446+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:35.022446+0000","last_undegraded":"2023-08-18T20:44:35.022446+0000","last_fullsized":"2023-08-18T20:44:35.022446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:49:17.166598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686127+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:35.686127+0000","last_peered":"2023-08-18T20:44:35.686127+0000","last_clean":"2023-08-18T20:44:35.686127+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:35.686127+0000","last_undegraded":"2023-08-18T20:44:35.686127+0000","last_fullsized":"2023-08-18T20:44:35.686127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:16.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021695+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:35.021695+0000","last_peered":"2023-08-18T20:44:35.021695+0000","last_clean":"2023-08-18T20:44:35.021695+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:35.021695+0000","last_undegraded":"2023-08-18T20:44:35.021695+0000","last_fullsized":"2023-08-18T20:44:35.021695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:04:24.273971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685639+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:35.685639+0000","last_peered":"2023-08-18T20:44:35.685639+0000","last_clean":"2023-08-18T20:44:35.685639+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:35.685639+0000","last_undegraded":"2023-08-18T20:44:35.685639+0000","last_fullsized":"2023-08-18T20:44:35.685639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:13.931577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021948+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:35.021948+0000","last_peered":"2023-08-18T20:44:35.021948+0000","last_clean":"2023-08-18T20:44:35.021948+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:35.021948+0000","last_undegraded":"2023-08-18T20:44:35.021948+0000","last_fullsized":"2023-08-18T20:44:35.021948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:54.989567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021908+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:35.021908+0000","last_peered":"2023-08-18T20:44:35.021908+0000","last_clean":"2023-08-18T20:44:35.021908+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.021908+0000","last_undegraded":"2023-08-18T20:44:35.021908+0000","last_fullsized":"2023-08-18T20:44:35.021908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:02:17.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685874+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:35.685874+0000","last_peered":"2023-08-18T20:44:35.685874+0000","last_clean":"2023-08-18T20:44:35.685874+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:35.685874+0000","last_undegraded":"2023-08-18T20:44:35.685874+0000","last_fullsized":"2023-08-18T20:44:35.685874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184860+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:35.184860+0000","last_peered":"2023-08-18T20:44:35.184860+0000","last_clean":"2023-08-18T20:44:35.184860+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:35.184860+0000","last_undegraded":"2023-08-18T20:44:35.184860+0000","last_fullsized":"2023-08-18T20:44:35.184860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:45.836631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685871+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:35.685871+0000","last_peered":"2023-08-18T20:44:35.685871+0000","last_clean":"2023-08-18T20:44:35.685871+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:35.685871+0000","last_undegraded":"2023-08-18T20:44:35.685871+0000","last_fullsized":"2023-08-18T20:44:35.685871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021125+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:35.021125+0000","last_peered":"2023-08-18T20:44:35.021125+0000","last_clean":"2023-08-18T20:44:35.021125+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:35.021125+0000","last_undegraded":"2023-08-18T20:44:35.021125+0000","last_fullsized":"2023-08-18T20:44:35.021125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:32.258779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021152+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:35.021152+0000","last_peered":"2023-08-18T20:44:35.021152+0000","last_clean":"2023-08-18T20:44:35.021152+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:35.021152+0000","last_undegraded":"2023-08-18T20:44:35.021152+0000","last_fullsized":"2023-08-18T20:44:35.021152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:12:08.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685832+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:35.685832+0000","last_peered":"2023-08-18T20:44:35.685832+0000","last_clean":"2023-08-18T20:44:35.685832+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:35.685832+0000","last_undegraded":"2023-08-18T20:44:35.685832+0000","last_fullsized":"2023-08-18T20:44:35.685832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185015+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:35.185015+0000","last_peered":"2023-08-18T20:44:35.185015+0000","last_clean":"2023-08-18T20:44:35.185015+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:35.185015+0000","last_undegraded":"2023-08-18T20:44:35.185015+0000","last_fullsized":"2023-08-18T20:44:35.185015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:32:32.700486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185240+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:35.185240+0000","last_peered":"2023-08-18T20:44:35.185240+0000","last_clean":"2023-08-18T20:44:35.185240+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:35.185240+0000","last_undegraded":"2023-08-18T20:44:35.185240+0000","last_fullsized":"2023-08-18T20:44:35.185240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.755},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":149911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.501},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.435}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.372}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":739787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.309},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.23499999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.25800000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":149363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.371},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":149399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":152482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.54600000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.442}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.376},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:52.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:52.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.327+0000 7fd268d58700 1 Processor -- start 2023-08-18T20:44:52.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.327+0000 7fd268d58700 1 -- start start 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd268d58700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd26406a2a0 0x7fd26406a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd268d58700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd2641592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd268d58700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd264158e50 con 0x7fd2640bd470 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd268d58700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640c1bb0 con 0x7fd26406a2a0 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd268d58700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd264158820 con 0x7fd2640c2630 2023-08-18T20:44:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd262d9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd2640bd470 0x7fd2640c14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49002/0 (socket says 172.21.15.121:49002) 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.328+0000 7fd262d9d700 1 -- 172.21.15.121:0/1867841897 learned_addr learned my addr 172.21.15.121:0/1867841897 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862605528 0 0) 0x7fd264158e50 con 0x7fd2640bd470 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd24c0035b0 con 0x7fd2640bd470 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd261d9b700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd2641592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26259c700 1 --2- 172.21.15.121:0/1867841897 >> v2:172.21.15.122:3300/0 conn(0x7fd26406a2a0 0x7fd26406a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427892081 0 0) 0x7fd24c0035b0 con 0x7fd2640bd470 2023-08-18T20:44:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 msgr2=0x7fd2641592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd2641592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 >> v2:172.21.15.122:3300/0 conn(0x7fd26406a2a0 msgr2=0x7fd26406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 --2- 172.21.15.121:0/1867841897 >> v2:172.21.15.122:3300/0 conn(0x7fd26406a2a0 0x7fd26406a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640c2b30 con 0x7fd2640bd470 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fd25c0019f0 con 0x7fd2640bd470 2023-08-18T20:44:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 >> v1:172.21.15.121:6789/0 conn(0x7fd2640bd470 legacy=0x7fd2640c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd24c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd24c003ff0 0x7fd24c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd24c004d90 0x7fd24c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640c1bb0 con 0x7fd24c004d90 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264158820 con 0x7fd24c003ff0 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c00bac0 con 0x7fd2640c2630 2023-08-18T20:44:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd262d9d700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd24c004d90 0x7fd24c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd261d9b700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd24c003ff0 0x7fd24c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd26259c700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd24c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd262d9d700 1 -- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 msgr2=0x7fd24c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd262d9d700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2640c2630 0x7fd24c003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd262d9d700 1 -- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd24c003ff0 msgr2=0x7fd24c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.329+0000 7fd262d9d700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd24c003ff0 0x7fd24c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd262d9d700 1 -- 172.21.15.121:0/1867841897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0035b0 con 0x7fd24c004d90 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd262d9d700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd24c004d90 0x7fd24c005210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00a8d0 tx=0x7fd24c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a467b2d79680ae9f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00a340 con 0x7fd24c004d90 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c012600 con 0x7fd24c004d90 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd26159a700 1 -- 172.21.15.121:0/1867841897 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0129b0 con 0x7fd24c004d90 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 -- 172.21.15.121:0/1867841897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd24c004d90 msgr2=0x7fd24c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 --2- 172.21.15.121:0/1867841897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd24c004d90 0x7fd24c005210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00a8d0 tx=0x7fd24c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd262d9d700 1 -- 172.21.15.121:0/1867841897 reap_dead start 2023-08-18T20:44:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 -- 172.21.15.121:0/1867841897 shutdown_connections 2023-08-18T20:44:52.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 -- 172.21.15.121:0/1867841897 >> 172.21.15.121:0/1867841897 conn(0x7fd2640c35a0 msgr2=0x7fd2640c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:52.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 -- 172.21.15.121:0/1867841897 shutdown_connections 2023-08-18T20:44:52.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.330+0000 7fd268d58700 1 -- 172.21.15.121:0/1867841897 wait complete. 2023-08-18T20:44:52.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 Processor -- start 2023-08-18T20:44:52.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 -- start start 2023-08-18T20:44:52.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 0x7fd2641f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26414e8f0 0x7fd26414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640a8fb0 con 0x7fd264072200 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641f20d0 con 0x7fd26414e8f0 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd268d58700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641ef870 con 0x7fd24c004d90 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.332+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42430/0 (socket says 172.21.15.121:42430) 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 -- 172.21.15.121:0/1795326071 learned_addr learned my addr 172.21.15.121:0/1795326071 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd262d9d700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26414e8f0 0x7fd26414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd26259c700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 0x7fd2641f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 -- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 msgr2=0x7fd2641f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 0x7fd2641f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 -- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26414e8f0 msgr2=0x7fd26414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26414e8f0 0x7fd26414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 -- 172.21.15.121:0/1795326071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26406e520 con 0x7fd264072200 2023-08-18T20:44:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd26259c700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 0x7fd2641f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd261d9b700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd2580119a0 tx=0x7fd258011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800f940 con 0x7fd264072200 2023-08-18T20:44:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800faa0 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800fe30 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd264072690 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.333+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2641ef500 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.334+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2641ef080 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.334+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd258014440 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.335+0000 7fd252ffd700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 0x7fd24406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.335+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fd258088f00 con 0x7fd264072200 2023-08-18T20:44:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.335+0000 7fd26259c700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 0x7fd24406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.335+0000 7fd26259c700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 0x7fd24406c5d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd254009ce0 tx=0x7fd254008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.339+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd2641ef080 con 0x7fd264072200 2023-08-18T20:44:52.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.524+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd264158ae0 con 0x7fd24406a110 2023-08-18T20:44:52.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.537+0000 7fd252ffd700 1 -- 172.21.15.121:0/1795326071 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+535131 (secure 0 0 0) 0x7fd254009930 con 0x7fd24406a110 2023-08-18T20:44:52.543 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:52.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 msgr2=0x7fd24406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 0x7fd24406c5d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd254009ce0 tx=0x7fd254008040 comp rx=0 tx=0).stop 2023-08-18T20:44:52.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 msgr2=0x7fd2641513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd2580119a0 tx=0x7fd258011cb0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 shutdown_connections 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26414e8f0 0x7fd26414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd24c004d90 0x7fd2641f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd24406a110 0x7fd24406c5d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 --2- 172.21.15.121:0/1795326071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd264072200 0x7fd2641513f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 >> 172.21.15.121:0/1795326071 conn(0x7fd2640c35a0 msgr2=0x7fd2640bc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 shutdown_connections 2023-08-18T20:44:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.542+0000 7fd268d58700 1 -- 172.21.15.121:0/1795326071 wait complete. 2023-08-18T20:44:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:52.554 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-08-18T20:44:50.930796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4202496,"data_stored":2383202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.876041"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.023009+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:35.023009+0000","last_peered":"2023-08-18T20:44:35.023009+0000","last_clean":"2023-08-18T20:44:35.023009+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:35.023009+0000","last_undegraded":"2023-08-18T20:44:35.023009+0000","last_fullsized":"2023-08-18T20:44:35.023009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:10:42.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:45.828686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685753+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:35.685753+0000","last_peered":"2023-08-18T20:44:35.685753+0000","last_clean":"2023-08-18T20:44:35.685753+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:35.685753+0000","last_undegraded":"2023-08-18T20:44:35.685753+0000","last_fullsized":"2023-08-18T20:44:35.685753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022591+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:35.022591+0000","last_peered":"2023-08-18T20:44:35.022591+0000","last_clean":"2023-08-18T20:44:35.022591+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:35.022591+0000","last_undegraded":"2023-08-18T20:44:35.022591+0000","last_fullsized":"2023-08-18T20:44:35.022591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:22:33.873991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022271+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:35.022271+0000","last_peered":"2023-08-18T20:44:35.022271+0000","last_clean":"2023-08-18T20:44:35.022271+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:35.022271+0000","last_undegraded":"2023-08-18T20:44:35.022271+0000","last_fullsized":"2023-08-18T20:44:35.022271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686137+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:35.686137+0000","last_peered":"2023-08-18T20:44:35.686137+0000","last_clean":"2023-08-18T20:44:35.686137+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:35.686137+0000","last_undegraded":"2023-08-18T20:44:35.686137+0000","last_fullsized":"2023-08-18T20:44:35.686137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022546+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:35.022546+0000","last_peered":"2023-08-18T20:44:35.022546+0000","last_clean":"2023-08-18T20:44:35.022546+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:35.022546+0000","last_undegraded":"2023-08-18T20:44:35.022546+0000","last_fullsized":"2023-08-18T20:44:35.022546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:11:54.581845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685907+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:35.685907+0000","last_peered":"2023-08-18T20:44:35.685907+0000","last_clean":"2023-08-18T20:44:35.685907+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:35.685907+0000","last_undegraded":"2023-08-18T20:44:35.685907+0000","last_fullsized":"2023-08-18T20:44:35.685907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185071+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:35.185071+0000","last_peered":"2023-08-18T20:44:35.185071+0000","last_clean":"2023-08-18T20:44:35.185071+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:35.185071+0000","last_undegraded":"2023-08-18T20:44:35.185071+0000","last_fullsized":"2023-08-18T20:44:35.185071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673943+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:35.673943+0000","last_peered":"2023-08-18T20:44:35.673943+0000","last_clean":"2023-08-18T20:44:35.673943+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:35.673943+0000","last_undegraded":"2023-08-18T20:44:35.673943+0000","last_fullsized":"2023-08-18T20:44:35.673943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:06.349596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674089+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:35.674089+0000","last_peered":"2023-08-18T20:44:35.674089+0000","last_clean":"2023-08-18T20:44:35.674089+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:35.674089+0000","last_undegraded":"2023-08-18T20:44:35.674089+0000","last_fullsized":"2023-08-18T20:44:35.674089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022154+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:35.022154+0000","last_peered":"2023-08-18T20:44:35.022154+0000","last_clean":"2023-08-18T20:44:35.022154+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:35.022154+0000","last_undegraded":"2023-08-18T20:44:35.022154+0000","last_fullsized":"2023-08-18T20:44:35.022154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:16:09.185476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673769+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:35.673769+0000","last_peered":"2023-08-18T20:44:35.673769+0000","last_clean":"2023-08-18T20:44:35.673769+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:35.673769+0000","last_undegraded":"2023-08-18T20:44:35.673769+0000","last_fullsized":"2023-08-18T20:44:35.673769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:31:37.239696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:36.026211+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:36.026211+0000","last_peered":"2023-08-18T20:44:36.026211+0000","last_clean":"2023-08-18T20:44:36.026211+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:36.026211+0000","last_undegraded":"2023-08-18T20:44:36.026211+0000","last_fullsized":"2023-08-18T20:44:36.026211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:50.840801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674222+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:35.674222+0000","last_peered":"2023-08-18T20:44:35.674222+0000","last_clean":"2023-08-18T20:44:35.674222+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:35.674222+0000","last_undegraded":"2023-08-18T20:44:35.674222+0000","last_fullsized":"2023-08-18T20:44:35.674222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:15:17.512476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674171+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:35.674171+0000","last_peered":"2023-08-18T20:44:35.674171+0000","last_clean":"2023-08-18T20:44:35.674171+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:35.674171+0000","last_undegraded":"2023-08-18T20:44:35.674171+0000","last_fullsized":"2023-08-18T20:44:35.674171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685950+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:35.685950+0000","last_peered":"2023-08-18T20:44:35.685950+0000","last_clean":"2023-08-18T20:44:35.685950+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:35.685950+0000","last_undegraded":"2023-08-18T20:44:35.685950+0000","last_fullsized":"2023-08-18T20:44:35.685950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:35.317206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022060+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:35.022060+0000","last_peered":"2023-08-18T20:44:35.022060+0000","last_clean":"2023-08-18T20:44:35.022060+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:35.022060+0000","last_undegraded":"2023-08-18T20:44:35.022060+0000","last_fullsized":"2023-08-18T20:44:35.022060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:25.883578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686101+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:35.686101+0000","last_peered":"2023-08-18T20:44:35.686101+0000","last_clean":"2023-08-18T20:44:35.686101+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:35.686101+0000","last_undegraded":"2023-08-18T20:44:35.686101+0000","last_fullsized":"2023-08-18T20:44:35.686101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185250+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:35.185250+0000","last_peered":"2023-08-18T20:44:35.185250+0000","last_clean":"2023-08-18T20:44:35.185250+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:35.185250+0000","last_undegraded":"2023-08-18T20:44:35.185250+0000","last_fullsized":"2023-08-18T20:44:35.185250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185235+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:35.185235+0000","last_peered":"2023-08-18T20:44:35.185235+0000","last_clean":"2023-08-18T20:44:35.185235+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:35.185235+0000","last_undegraded":"2023-08-18T20:44:35.185235+0000","last_fullsized":"2023-08-18T20:44:35.185235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674165+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:35.674165+0000","last_peered":"2023-08-18T20:44:35.674165+0000","last_clean":"2023-08-18T20:44:35.674165+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:35.674165+0000","last_undegraded":"2023-08-18T20:44:35.674165+0000","last_fullsized":"2023-08-18T20:44:35.674165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686388+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:35.686388+0000","last_peered":"2023-08-18T20:44:35.686388+0000","last_clean":"2023-08-18T20:44:35.686388+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:35.686388+0000","last_undegraded":"2023-08-18T20:44:35.686388+0000","last_fullsized":"2023-08-18T20:44:35.686388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:58:22.457124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686008+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:35.686008+0000","last_peered":"2023-08-18T20:44:35.686008+0000","last_clean":"2023-08-18T20:44:35.686008+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:35.686008+0000","last_undegraded":"2023-08-18T20:44:35.686008+0000","last_fullsized":"2023-08-18T20:44:35.686008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:42.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686364+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:35.686364+0000","last_peered":"2023-08-18T20:44:35.686364+0000","last_clean":"2023-08-18T20:44:35.686364+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:35.686364+0000","last_undegraded":"2023-08-18T20:44:35.686364+0000","last_fullsized":"2023-08-18T20:44:35.686364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:12.619573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021190+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:35.021190+0000","last_peered":"2023-08-18T20:44:35.021190+0000","last_clean":"2023-08-18T20:44:35.021190+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:35.021190+0000","last_undegraded":"2023-08-18T20:44:35.021190+0000","last_fullsized":"2023-08-18T20:44:35.021190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:08:53.195511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185023+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:35.185023+0000","last_peered":"2023-08-18T20:44:35.185023+0000","last_clean":"2023-08-18T20:44:35.185023+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.185023+0000","last_undegraded":"2023-08-18T20:44:35.185023+0000","last_fullsized":"2023-08-18T20:44:35.185023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674039+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:35.674039+0000","last_peered":"2023-08-18T20:44:35.674039+0000","last_clean":"2023-08-18T20:44:35.674039+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:35.674039+0000","last_undegraded":"2023-08-18T20:44:35.674039+0000","last_fullsized":"2023-08-18T20:44:35.674039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021423+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:35.021423+0000","last_peered":"2023-08-18T20:44:35.021423+0000","last_clean":"2023-08-18T20:44:35.021423+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:35.021423+0000","last_undegraded":"2023-08-18T20:44:35.021423+0000","last_fullsized":"2023-08-18T20:44:35.021423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:14:20.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021094+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:35.021094+0000","last_peered":"2023-08-18T20:44:35.021094+0000","last_clean":"2023-08-18T20:44:35.021094+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:35.021094+0000","last_undegraded":"2023-08-18T20:44:35.021094+0000","last_fullsized":"2023-08-18T20:44:35.021094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:19:26.408213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685666+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:35.685666+0000","last_peered":"2023-08-18T20:44:35.685666+0000","last_clean":"2023-08-18T20:44:35.685666+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:35.685666+0000","last_undegraded":"2023-08-18T20:44:35.685666+0000","last_fullsized":"2023-08-18T20:44:35.685666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:13.854640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021160+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:35.021160+0000","last_peered":"2023-08-18T20:44:35.021160+0000","last_clean":"2023-08-18T20:44:35.021160+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:35.021160+0000","last_undegraded":"2023-08-18T20:44:35.021160+0000","last_fullsized":"2023-08-18T20:44:35.021160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:54:26.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673775+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:35.673775+0000","last_peered":"2023-08-18T20:44:35.673775+0000","last_clean":"2023-08-18T20:44:35.673775+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:35.673775+0000","last_undegraded":"2023-08-18T20:44:35.673775+0000","last_fullsized":"2023-08-18T20:44:35.673775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686207+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:35.686207+0000","last_peered":"2023-08-18T20:44:35.686207+0000","last_clean":"2023-08-18T20:44:35.686207+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:35.686207+0000","last_undegraded":"2023-08-18T20:44:35.686207+0000","last_fullsized":"2023-08-18T20:44:35.686207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:35.821786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021527+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:35.021527+0000","last_peered":"2023-08-18T20:44:35.021527+0000","last_clean":"2023-08-18T20:44:35.021527+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:35.021527+0000","last_undegraded":"2023-08-18T20:44:35.021527+0000","last_fullsized":"2023-08-18T20:44:35.021527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:19:55.961983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021296+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:35.021296+0000","last_peered":"2023-08-18T20:44:35.021296+0000","last_clean":"2023-08-18T20:44:35.021296+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:35.021296+0000","last_undegraded":"2023-08-18T20:44:35.021296+0000","last_fullsized":"2023-08-18T20:44:35.021296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:47.584015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686429+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:35.686429+0000","last_peered":"2023-08-18T20:44:35.686429+0000","last_clean":"2023-08-18T20:44:35.686429+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:35.686429+0000","last_undegraded":"2023-08-18T20:44:35.686429+0000","last_fullsized":"2023-08-18T20:44:35.686429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:40.068512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686553+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:35.686553+0000","last_peered":"2023-08-18T20:44:35.686553+0000","last_clean":"2023-08-18T20:44:35.686553+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:35.686553+0000","last_undegraded":"2023-08-18T20:44:35.686553+0000","last_fullsized":"2023-08-18T20:44:35.686553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:15:21.504162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021887+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:35.021887+0000","last_peered":"2023-08-18T20:44:35.021887+0000","last_clean":"2023-08-18T20:44:35.021887+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:35.021887+0000","last_undegraded":"2023-08-18T20:44:35.021887+0000","last_fullsized":"2023-08-18T20:44:35.021887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:14.155493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021905+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:35.021905+0000","last_peered":"2023-08-18T20:44:35.021905+0000","last_clean":"2023-08-18T20:44:35.021905+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:35.021905+0000","last_undegraded":"2023-08-18T20:44:35.021905+0000","last_fullsized":"2023-08-18T20:44:35.021905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:28.147788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185084+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:35.185084+0000","last_peered":"2023-08-18T20:44:35.185084+0000","last_clean":"2023-08-18T20:44:35.185084+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:35.185084+0000","last_undegraded":"2023-08-18T20:44:35.185084+0000","last_fullsized":"2023-08-18T20:44:35.185084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:15.995149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673938+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:35.673938+0000","last_peered":"2023-08-18T20:44:35.673938+0000","last_clean":"2023-08-18T20:44:35.673938+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:35.673938+0000","last_undegraded":"2023-08-18T20:44:35.673938+0000","last_fullsized":"2023-08-18T20:44:35.673938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:14.990143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184974+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:35.184974+0000","last_peered":"2023-08-18T20:44:35.184974+0000","last_clean":"2023-08-18T20:44:35.184974+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:35.184974+0000","last_undegraded":"2023-08-18T20:44:35.184974+0000","last_fullsized":"2023-08-18T20:44:35.184974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022202+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:35.022202+0000","last_peered":"2023-08-18T20:44:35.022202+0000","last_clean":"2023-08-18T20:44:35.022202+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:35.022202+0000","last_undegraded":"2023-08-18T20:44:35.022202+0000","last_fullsized":"2023-08-18T20:44:35.022202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:00.662486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673788+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:35.673788+0000","last_peered":"2023-08-18T20:44:35.673788+0000","last_clean":"2023-08-18T20:44:35.673788+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:35.673788+0000","last_undegraded":"2023-08-18T20:44:35.673788+0000","last_fullsized":"2023-08-18T20:44:35.673788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:12.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184870+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:35.184870+0000","last_peered":"2023-08-18T20:44:35.184870+0000","last_clean":"2023-08-18T20:44:35.184870+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:35.184870+0000","last_undegraded":"2023-08-18T20:44:35.184870+0000","last_fullsized":"2023-08-18T20:44:35.184870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185166+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:35.185166+0000","last_peered":"2023-08-18T20:44:35.185166+0000","last_clean":"2023-08-18T20:44:35.185166+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:35.185166+0000","last_undegraded":"2023-08-18T20:44:35.185166+0000","last_fullsized":"2023-08-18T20:44:35.185166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686047+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:35.686047+0000","last_peered":"2023-08-18T20:44:35.686047+0000","last_clean":"2023-08-18T20:44:35.686047+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:35.686047+0000","last_undegraded":"2023-08-18T20:44:35.686047+0000","last_fullsized":"2023-08-18T20:44:35.686047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"33'9","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:41.133995+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:41.133995+0000","last_peered":"2023-08-18T20:44:41.133995+0000","last_clean":"2023-08-18T20:44:41.133995+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:41.133995+0000","last_undegraded":"2023-08-18T20:44:41.133995+0000","last_fullsized":"2023-08-18T20:44:41.133995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:34.376644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686532+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:35.686532+0000","last_peered":"2023-08-18T20:44:35.686532+0000","last_clean":"2023-08-18T20:44:35.686532+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:35.686532+0000","last_undegraded":"2023-08-18T20:44:35.686532+0000","last_fullsized":"2023-08-18T20:44:35.686532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:41:34.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022064+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:35.022064+0000","last_peered":"2023-08-18T20:44:35.022064+0000","last_clean":"2023-08-18T20:44:35.022064+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:35.022064+0000","last_undegraded":"2023-08-18T20:44:35.022064+0000","last_fullsized":"2023-08-18T20:44:35.022064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:21:05.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686136+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:35.686136+0000","last_peered":"2023-08-18T20:44:35.686136+0000","last_clean":"2023-08-18T20:44:35.686136+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:35.686136+0000","last_undegraded":"2023-08-18T20:44:35.686136+0000","last_fullsized":"2023-08-18T20:44:35.686136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021526+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:35.021526+0000","last_peered":"2023-08-18T20:44:35.021526+0000","last_clean":"2023-08-18T20:44:35.021526+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:35.021526+0000","last_undegraded":"2023-08-18T20:44:35.021526+0000","last_fullsized":"2023-08-18T20:44:35.021526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:30:54.763621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674145+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:35.674145+0000","last_peered":"2023-08-18T20:44:35.674145+0000","last_clean":"2023-08-18T20:44:35.674145+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:35.674145+0000","last_undegraded":"2023-08-18T20:44:35.674145+0000","last_fullsized":"2023-08-18T20:44:35.674145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:38.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185223+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:35.185223+0000","last_peered":"2023-08-18T20:44:35.185223+0000","last_clean":"2023-08-18T20:44:35.185223+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:35.185223+0000","last_undegraded":"2023-08-18T20:44:35.185223+0000","last_fullsized":"2023-08-18T20:44:35.185223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:37.595262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021269+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:35.021269+0000","last_peered":"2023-08-18T20:44:35.021269+0000","last_clean":"2023-08-18T20:44:35.021269+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:35.021269+0000","last_undegraded":"2023-08-18T20:44:35.021269+0000","last_fullsized":"2023-08-18T20:44:35.021269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:10:19.922914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686003+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:35.686003+0000","last_peered":"2023-08-18T20:44:35.686003+0000","last_clean":"2023-08-18T20:44:35.686003+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:35.686003+0000","last_undegraded":"2023-08-18T20:44:35.686003+0000","last_fullsized":"2023-08-18T20:44:35.686003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:29.096868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185127+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:35.185127+0000","last_peered":"2023-08-18T20:44:35.185127+0000","last_clean":"2023-08-18T20:44:35.185127+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:35.185127+0000","last_undegraded":"2023-08-18T20:44:35.185127+0000","last_fullsized":"2023-08-18T20:44:35.185127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.810386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686171+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:35.686171+0000","last_peered":"2023-08-18T20:44:35.686171+0000","last_clean":"2023-08-18T20:44:35.686171+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:35.686171+0000","last_undegraded":"2023-08-18T20:44:35.686171+0000","last_fullsized":"2023-08-18T20:44:35.686171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:38.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686345+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:35.686345+0000","last_peered":"2023-08-18T20:44:35.686345+0000","last_clean":"2023-08-18T20:44:35.686345+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:35.686345+0000","last_undegraded":"2023-08-18T20:44:35.686345+0000","last_fullsized":"2023-08-18T20:44:35.686345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:08:58.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674020+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:35.674020+0000","last_peered":"2023-08-18T20:44:35.674020+0000","last_clean":"2023-08-18T20:44:35.674020+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:35.674020+0000","last_undegraded":"2023-08-18T20:44:35.674020+0000","last_fullsized":"2023-08-18T20:44:35.674020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:22.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022453+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:35.022453+0000","last_peered":"2023-08-18T20:44:35.022453+0000","last_clean":"2023-08-18T20:44:35.022453+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:35.022453+0000","last_undegraded":"2023-08-18T20:44:35.022453+0000","last_fullsized":"2023-08-18T20:44:35.022453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:00:07.822682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021626+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:35.021626+0000","last_peered":"2023-08-18T20:44:35.021626+0000","last_clean":"2023-08-18T20:44:35.021626+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:35.021626+0000","last_undegraded":"2023-08-18T20:44:35.021626+0000","last_fullsized":"2023-08-18T20:44:35.021626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:02.246115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685538+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:35.685538+0000","last_peered":"2023-08-18T20:44:35.685538+0000","last_clean":"2023-08-18T20:44:35.685538+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:35.685538+0000","last_undegraded":"2023-08-18T20:44:35.685538+0000","last_fullsized":"2023-08-18T20:44:35.685538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:12:44.118040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686474+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:35.686474+0000","last_peered":"2023-08-18T20:44:35.686474+0000","last_clean":"2023-08-18T20:44:35.686474+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:35.686474+0000","last_undegraded":"2023-08-18T20:44:35.686474+0000","last_fullsized":"2023-08-18T20:44:35.686474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.149467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185136+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:35.185136+0000","last_peered":"2023-08-18T20:44:35.185136+0000","last_clean":"2023-08-18T20:44:35.185136+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:35.185136+0000","last_undegraded":"2023-08-18T20:44:35.185136+0000","last_fullsized":"2023-08-18T20:44:35.185136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:23.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686469+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:35.686469+0000","last_peered":"2023-08-18T20:44:35.686469+0000","last_clean":"2023-08-18T20:44:35.686469+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:35.686469+0000","last_undegraded":"2023-08-18T20:44:35.686469+0000","last_fullsized":"2023-08-18T20:44:35.686469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:11:37.290795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686446+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:35.686446+0000","last_peered":"2023-08-18T20:44:35.686446+0000","last_clean":"2023-08-18T20:44:35.686446+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:35.686446+0000","last_undegraded":"2023-08-18T20:44:35.686446+0000","last_fullsized":"2023-08-18T20:44:35.686446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:57:06.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686216+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:35.686216+0000","last_peered":"2023-08-18T20:44:35.686216+0000","last_clean":"2023-08-18T20:44:35.686216+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:35.686216+0000","last_undegraded":"2023-08-18T20:44:35.686216+0000","last_fullsized":"2023-08-18T20:44:35.686216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:47.071148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686382+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:35.686382+0000","last_peered":"2023-08-18T20:44:35.686382+0000","last_clean":"2023-08-18T20:44:35.686382+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:35.686382+0000","last_undegraded":"2023-08-18T20:44:35.686382+0000","last_fullsized":"2023-08-18T20:44:35.686382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:40.808594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022926+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:35.022926+0000","last_peered":"2023-08-18T20:44:35.022926+0000","last_clean":"2023-08-18T20:44:35.022926+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:35.022926+0000","last_undegraded":"2023-08-18T20:44:35.022926+0000","last_fullsized":"2023-08-18T20:44:35.022926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:39.803589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674105+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:35.674105+0000","last_peered":"2023-08-18T20:44:35.674105+0000","last_clean":"2023-08-18T20:44:35.674105+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:35.674105+0000","last_undegraded":"2023-08-18T20:44:35.674105+0000","last_fullsized":"2023-08-18T20:44:35.674105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:35.381650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685586+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:35.685586+0000","last_peered":"2023-08-18T20:44:35.685586+0000","last_clean":"2023-08-18T20:44:35.685586+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:35.685586+0000","last_undegraded":"2023-08-18T20:44:35.685586+0000","last_fullsized":"2023-08-18T20:44:35.685586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673985+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:35.673985+0000","last_peered":"2023-08-18T20:44:35.673985+0000","last_clean":"2023-08-18T20:44:35.673985+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:35.673985+0000","last_undegraded":"2023-08-18T20:44:35.673985+0000","last_fullsized":"2023-08-18T20:44:35.673985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022178+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:35.022178+0000","last_peered":"2023-08-18T20:44:35.022178+0000","last_clean":"2023-08-18T20:44:35.022178+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:35.022178+0000","last_undegraded":"2023-08-18T20:44:35.022178+0000","last_fullsized":"2023-08-18T20:44:35.022178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022145+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:35.022145+0000","last_peered":"2023-08-18T20:44:35.022145+0000","last_clean":"2023-08-18T20:44:35.022145+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:35.022145+0000","last_undegraded":"2023-08-18T20:44:35.022145+0000","last_fullsized":"2023-08-18T20:44:35.022145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021715+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:35.021715+0000","last_peered":"2023-08-18T20:44:35.021715+0000","last_clean":"2023-08-18T20:44:35.021715+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:35.021715+0000","last_undegraded":"2023-08-18T20:44:35.021715+0000","last_fullsized":"2023-08-18T20:44:35.021715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:37.673955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022572+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:35.022572+0000","last_peered":"2023-08-18T20:44:35.022572+0000","last_clean":"2023-08-18T20:44:35.022572+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:35.022572+0000","last_undegraded":"2023-08-18T20:44:35.022572+0000","last_fullsized":"2023-08-18T20:44:35.022572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686401+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:35.686401+0000","last_peered":"2023-08-18T20:44:35.686401+0000","last_clean":"2023-08-18T20:44:35.686401+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:35.686401+0000","last_undegraded":"2023-08-18T20:44:35.686401+0000","last_fullsized":"2023-08-18T20:44:35.686401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022784+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:35.022784+0000","last_peered":"2023-08-18T20:44:35.022784+0000","last_clean":"2023-08-18T20:44:35.022784+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:35.022784+0000","last_undegraded":"2023-08-18T20:44:35.022784+0000","last_fullsized":"2023-08-18T20:44:35.022784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:36.826792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021052+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:35.021052+0000","last_peered":"2023-08-18T20:44:35.021052+0000","last_clean":"2023-08-18T20:44:35.021052+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:35.021052+0000","last_undegraded":"2023-08-18T20:44:35.021052+0000","last_fullsized":"2023-08-18T20:44:35.021052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:10:15.545511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673869+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:35.673869+0000","last_peered":"2023-08-18T20:44:35.673869+0000","last_clean":"2023-08-18T20:44:35.673869+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:35.673869+0000","last_undegraded":"2023-08-18T20:44:35.673869+0000","last_fullsized":"2023-08-18T20:44:35.673869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686144+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:35.686144+0000","last_peered":"2023-08-18T20:44:35.686144+0000","last_clean":"2023-08-18T20:44:35.686144+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:35.686144+0000","last_undegraded":"2023-08-18T20:44:35.686144+0000","last_fullsized":"2023-08-18T20:44:35.686144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:12:36.239200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022047+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:35.022047+0000","last_peered":"2023-08-18T20:44:35.022047+0000","last_clean":"2023-08-18T20:44:35.022047+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:35.022047+0000","last_undegraded":"2023-08-18T20:44:35.022047+0000","last_fullsized":"2023-08-18T20:44:35.022047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:55.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022431+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:35.022431+0000","last_peered":"2023-08-18T20:44:35.022431+0000","last_clean":"2023-08-18T20:44:35.022431+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:35.022431+0000","last_undegraded":"2023-08-18T20:44:35.022431+0000","last_fullsized":"2023-08-18T20:44:35.022431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021198+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:35.021198+0000","last_peered":"2023-08-18T20:44:35.021198+0000","last_clean":"2023-08-18T20:44:35.021198+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:35.021198+0000","last_undegraded":"2023-08-18T20:44:35.021198+0000","last_fullsized":"2023-08-18T20:44:35.021198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:14.550052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674256+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:35.674256+0000","last_peered":"2023-08-18T20:44:35.674256+0000","last_clean":"2023-08-18T20:44:35.674256+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:35.674256+0000","last_undegraded":"2023-08-18T20:44:35.674256+0000","last_fullsized":"2023-08-18T20:44:35.674256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:07.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673718+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:35.673718+0000","last_peered":"2023-08-18T20:44:35.673718+0000","last_clean":"2023-08-18T20:44:35.673718+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:35.673718+0000","last_undegraded":"2023-08-18T20:44:35.673718+0000","last_fullsized":"2023-08-18T20:44:35.673718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022446+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:35.022446+0000","last_peered":"2023-08-18T20:44:35.022446+0000","last_clean":"2023-08-18T20:44:35.022446+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:35.022446+0000","last_undegraded":"2023-08-18T20:44:35.022446+0000","last_fullsized":"2023-08-18T20:44:35.022446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:49:17.166598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686127+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:35.686127+0000","last_peered":"2023-08-18T20:44:35.686127+0000","last_clean":"2023-08-18T20:44:35.686127+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:35.686127+0000","last_undegraded":"2023-08-18T20:44:35.686127+0000","last_fullsized":"2023-08-18T20:44:35.686127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:16.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021695+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:35.021695+0000","last_peered":"2023-08-18T20:44:35.021695+0000","last_clean":"2023-08-18T20:44:35.021695+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:35.021695+0000","last_undegraded":"2023-08-18T20:44:35.021695+0000","last_fullsized":"2023-08-18T20:44:35.021695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:04:24.273971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685639+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:35.685639+0000","last_peered":"2023-08-18T20:44:35.685639+0000","last_clean":"2023-08-18T20:44:35.685639+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:35.685639+0000","last_undegraded":"2023-08-18T20:44:35.685639+0000","last_fullsized":"2023-08-18T20:44:35.685639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:13.931577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021948+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:35.021948+0000","last_peered":"2023-08-18T20:44:35.021948+0000","last_clean":"2023-08-18T20:44:35.021948+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:35.021948+0000","last_undegraded":"2023-08-18T20:44:35.021948+0000","last_fullsized":"2023-08-18T20:44:35.021948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:54.989567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021908+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:35.021908+0000","last_peered":"2023-08-18T20:44:35.021908+0000","last_clean":"2023-08-18T20:44:35.021908+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.021908+0000","last_undegraded":"2023-08-18T20:44:35.021908+0000","last_fullsized":"2023-08-18T20:44:35.021908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:02:17.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685874+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:35.685874+0000","last_peered":"2023-08-18T20:44:35.685874+0000","last_clean":"2023-08-18T20:44:35.685874+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:35.685874+0000","last_undegraded":"2023-08-18T20:44:35.685874+0000","last_fullsized":"2023-08-18T20:44:35.685874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184860+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:35.184860+0000","last_peered":"2023-08-18T20:44:35.184860+0000","last_clean":"2023-08-18T20:44:35.184860+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:35.184860+0000","last_undegraded":"2023-08-18T20:44:35.184860+0000","last_fullsized":"2023-08-18T20:44:35.184860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:45.836631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685871+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:35.685871+0000","last_peered":"2023-08-18T20:44:35.685871+0000","last_clean":"2023-08-18T20:44:35.685871+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:35.685871+0000","last_undegraded":"2023-08-18T20:44:35.685871+0000","last_fullsized":"2023-08-18T20:44:35.685871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021125+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:35.021125+0000","last_peered":"2023-08-18T20:44:35.021125+0000","last_clean":"2023-08-18T20:44:35.021125+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:35.021125+0000","last_undegraded":"2023-08-18T20:44:35.021125+0000","last_fullsized":"2023-08-18T20:44:35.021125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:32.258779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021152+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:35.021152+0000","last_peered":"2023-08-18T20:44:35.021152+0000","last_clean":"2023-08-18T20:44:35.021152+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:35.021152+0000","last_undegraded":"2023-08-18T20:44:35.021152+0000","last_fullsized":"2023-08-18T20:44:35.021152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:12:08.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685832+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:35.685832+0000","last_peered":"2023-08-18T20:44:35.685832+0000","last_clean":"2023-08-18T20:44:35.685832+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:35.685832+0000","last_undegraded":"2023-08-18T20:44:35.685832+0000","last_fullsized":"2023-08-18T20:44:35.685832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185015+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:35.185015+0000","last_peered":"2023-08-18T20:44:35.185015+0000","last_clean":"2023-08-18T20:44:35.185015+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:35.185015+0000","last_undegraded":"2023-08-18T20:44:35.185015+0000","last_fullsized":"2023-08-18T20:44:35.185015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:32:32.700486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185240+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:35.185240+0000","last_peered":"2023-08-18T20:44:35.185240+0000","last_clean":"2023-08-18T20:44:35.185240+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:35.185240+0000","last_undegraded":"2023-08-18T20:44:35.185240+0000","last_fullsized":"2023-08-18T20:44:35.185240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.755},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":149911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.501},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.435}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.372}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":739787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.309},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.23499999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.25800000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":149363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.371},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":149399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":152482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.54600000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.442}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.376},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:52.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:52.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.713+0000 7ff872c00700 1 Processor -- start 2023-08-18T20:44:52.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.713+0000 7ff872c00700 1 -- start start 2023-08-18T20:44:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff872c00700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff86c0c5ae0 0x7ff86c071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff872c00700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c0c4f40 con 0x7ff86c0a6290 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff872c00700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c0c6120 con 0x7ff86c0c0c50 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff872c00700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c1551f0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff87119d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff86c0c5ae0 0x7ff86c071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff87119d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff86c0c5ae0 0x7ff86c071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42438/0 (socket says 172.21.15.121:42438) 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff87119d700 1 -- 172.21.15.121:0/3957825162 learned_addr learned my addr 172.21.15.121:0/3957825162 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.714+0000 7ff86bfff700 1 --1- 172.21.15.121:0/3957825162 >> v1:172.21.15.121:6789/0 conn(0x7ff86c0a6290 0x7ff86c0c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49022/0 (socket says 172.21.15.121:49022) 2023-08-18T20:44:52.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff87119d700 1 -- 172.21.15.121:0/3957825162 >> v1:172.21.15.122:6789/0 conn(0x7ff86c0c0c50 legacy=0x7ff86c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff87119d700 1 -- 172.21.15.121:0/3957825162 >> v1:172.21.15.121:6789/0 conn(0x7ff86c0a6290 legacy=0x7ff86c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff87119d700 1 -- 172.21.15.121:0/3957825162 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c0c63a0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff86b7fe700 1 -- 172.21.15.121:0/3957825162 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767938695 0 0) 0x7ff86c0c4f40 con 0x7ff86c0a6290 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff87119d700 1 --2- 172.21.15.121:0/3957825162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c071b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff864009e50 tx=0x7ff86400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81d2b34058cd2aa server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff86b7fe700 1 -- 172.21.15.121:0/3957825162 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400e070 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff86b7fe700 1 -- 172.21.15.121:0/3957825162 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86400b9c0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff86b7fe700 1 -- 172.21.15.121:0/3957825162 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400bd70 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff872c00700 1 -- 172.21.15.121:0/3957825162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 msgr2=0x7ff86c071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.715+0000 7ff872c00700 1 --2- 172.21.15.121:0/3957825162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c071b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff864009e50 tx=0x7ff86400b330 comp rx=0 tx=0).stop 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.716+0000 7ff872c00700 1 -- 172.21.15.121:0/3957825162 shutdown_connections 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.716+0000 7ff872c00700 1 --2- 172.21.15.121:0/3957825162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c071b80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.716+0000 7ff872c00700 1 -- 172.21.15.121:0/3957825162 >> 172.21.15.121:0/3957825162 conn(0x7ff86c0c6b10 msgr2=0x7ff86c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.716+0000 7ff872c00700 1 -- 172.21.15.121:0/3957825162 shutdown_connections 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.716+0000 7ff872c00700 1 -- 172.21.15.121:0/3957825162 wait complete. 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.717+0000 7ff872c00700 1 Processor -- start 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.717+0000 7ff872c00700 1 -- start start 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff86c0a6290 0x7ff86c158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0c0c50 0x7ff86c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0aa4c0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c1ea510 con 0x7ff86c0c0c50 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c155580 con 0x7ff86c0a6290 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42446/0 (socket says 172.21.15.121:42446) 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 -- 172.21.15.121:0/3559144290 learned_addr learned my addr 172.21.15.121:0/3559144290 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff86bfff700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0c0c50 0x7ff86c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87099c700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff86c0a6290 0x7ff86c158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 -- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff86c0a6290 msgr2=0x7ff86c158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff86c0a6290 0x7ff86c158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 -- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0c0c50 msgr2=0x7ff86c14be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0c0c50 0x7ff86c14be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 -- 172.21.15.121:0/3559144290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009b30 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff87119d700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b730 tx=0x7ff864004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86401b630 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86401b7b0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c155860 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86401bb60 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.718+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c155b40 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c0aa630 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff86401bcc0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff8697fa700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 0x7ff85006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ff864089dc0 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff87099c700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 0x7ff85006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.720+0000 7ff87099c700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 0x7ff85006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff860007fd0 tx=0x7ff860009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.724+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff86c0aa630 con 0x7ff86c0c5ae0 2023-08-18T20:44:52.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.912+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff86c154ec0 con 0x7ff85006a0e0 2023-08-18T20:44:52.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.925+0000 7ff8697fa700 1 -- 172.21.15.121:0/3559144290 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+535131 (secure 0 0 0) 0x7ff860001560 con 0x7ff85006a0e0 2023-08-18T20:44:52.930 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:52.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.929+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 msgr2=0x7ff85006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.929+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 0x7ff85006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff860007fd0 tx=0x7ff860009040 comp rx=0 tx=0).stop 2023-08-18T20:44:52.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.929+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 msgr2=0x7ff86c1ecb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:52.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.929+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b730 tx=0x7ff864004ad0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 shutdown_connections 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff85006a0e0 0x7ff85006c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff86c0c5ae0 0x7ff86c1ecb40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff86c0a6290 0x7ff86c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 --2- 172.21.15.121:0/3559144290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0c0c50 0x7ff86c14be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 >> 172.21.15.121:0/3559144290 conn(0x7ff86c0c6b10 msgr2=0x7ff86c0a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 shutdown_connections 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:52.930+0000 7ff872c00700 1 -- 172.21.15.121:0/3559144290 wait complete. 2023-08-18T20:44:52.935 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:52.942 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-08-18T20:44:50.930796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4202496,"data_stored":2383202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.876041"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.023009+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:35.023009+0000","last_peered":"2023-08-18T20:44:35.023009+0000","last_clean":"2023-08-18T20:44:35.023009+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:35.023009+0000","last_undegraded":"2023-08-18T20:44:35.023009+0000","last_fullsized":"2023-08-18T20:44:35.023009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:10:42.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:45.828686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685753+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:35.685753+0000","last_peered":"2023-08-18T20:44:35.685753+0000","last_clean":"2023-08-18T20:44:35.685753+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:35.685753+0000","last_undegraded":"2023-08-18T20:44:35.685753+0000","last_fullsized":"2023-08-18T20:44:35.685753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022591+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:35.022591+0000","last_peered":"2023-08-18T20:44:35.022591+0000","last_clean":"2023-08-18T20:44:35.022591+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:35.022591+0000","last_undegraded":"2023-08-18T20:44:35.022591+0000","last_fullsized":"2023-08-18T20:44:35.022591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:22:33.873991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022271+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:35.022271+0000","last_peered":"2023-08-18T20:44:35.022271+0000","last_clean":"2023-08-18T20:44:35.022271+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:35.022271+0000","last_undegraded":"2023-08-18T20:44:35.022271+0000","last_fullsized":"2023-08-18T20:44:35.022271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686137+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:35.686137+0000","last_peered":"2023-08-18T20:44:35.686137+0000","last_clean":"2023-08-18T20:44:35.686137+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:35.686137+0000","last_undegraded":"2023-08-18T20:44:35.686137+0000","last_fullsized":"2023-08-18T20:44:35.686137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022546+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:35.022546+0000","last_peered":"2023-08-18T20:44:35.022546+0000","last_clean":"2023-08-18T20:44:35.022546+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:35.022546+0000","last_undegraded":"2023-08-18T20:44:35.022546+0000","last_fullsized":"2023-08-18T20:44:35.022546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:11:54.581845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685907+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:35.685907+0000","last_peered":"2023-08-18T20:44:35.685907+0000","last_clean":"2023-08-18T20:44:35.685907+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:35.685907+0000","last_undegraded":"2023-08-18T20:44:35.685907+0000","last_fullsized":"2023-08-18T20:44:35.685907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:29.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185071+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:35.185071+0000","last_peered":"2023-08-18T20:44:35.185071+0000","last_clean":"2023-08-18T20:44:35.185071+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:35.185071+0000","last_undegraded":"2023-08-18T20:44:35.185071+0000","last_fullsized":"2023-08-18T20:44:35.185071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673943+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:35.673943+0000","last_peered":"2023-08-18T20:44:35.673943+0000","last_clean":"2023-08-18T20:44:35.673943+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:35.673943+0000","last_undegraded":"2023-08-18T20:44:35.673943+0000","last_fullsized":"2023-08-18T20:44:35.673943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:06.349596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674089+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:35.674089+0000","last_peered":"2023-08-18T20:44:35.674089+0000","last_clean":"2023-08-18T20:44:35.674089+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:35.674089+0000","last_undegraded":"2023-08-18T20:44:35.674089+0000","last_fullsized":"2023-08-18T20:44:35.674089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022154+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:35.022154+0000","last_peered":"2023-08-18T20:44:35.022154+0000","last_clean":"2023-08-18T20:44:35.022154+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:35.022154+0000","last_undegraded":"2023-08-18T20:44:35.022154+0000","last_fullsized":"2023-08-18T20:44:35.022154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:16:09.185476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673769+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:35.673769+0000","last_peered":"2023-08-18T20:44:35.673769+0000","last_clean":"2023-08-18T20:44:35.673769+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:35.673769+0000","last_undegraded":"2023-08-18T20:44:35.673769+0000","last_fullsized":"2023-08-18T20:44:35.673769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:31:37.239696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:36.026211+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:36.026211+0000","last_peered":"2023-08-18T20:44:36.026211+0000","last_clean":"2023-08-18T20:44:36.026211+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:36.026211+0000","last_undegraded":"2023-08-18T20:44:36.026211+0000","last_fullsized":"2023-08-18T20:44:36.026211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:50.840801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674222+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:35.674222+0000","last_peered":"2023-08-18T20:44:35.674222+0000","last_clean":"2023-08-18T20:44:35.674222+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:35.674222+0000","last_undegraded":"2023-08-18T20:44:35.674222+0000","last_fullsized":"2023-08-18T20:44:35.674222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:15:17.512476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674171+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:35.674171+0000","last_peered":"2023-08-18T20:44:35.674171+0000","last_clean":"2023-08-18T20:44:35.674171+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:35.674171+0000","last_undegraded":"2023-08-18T20:44:35.674171+0000","last_fullsized":"2023-08-18T20:44:35.674171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685950+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:35.685950+0000","last_peered":"2023-08-18T20:44:35.685950+0000","last_clean":"2023-08-18T20:44:35.685950+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:35.685950+0000","last_undegraded":"2023-08-18T20:44:35.685950+0000","last_fullsized":"2023-08-18T20:44:35.685950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:35.317206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022060+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:35.022060+0000","last_peered":"2023-08-18T20:44:35.022060+0000","last_clean":"2023-08-18T20:44:35.022060+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:35.022060+0000","last_undegraded":"2023-08-18T20:44:35.022060+0000","last_fullsized":"2023-08-18T20:44:35.022060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:25.883578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686101+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:35.686101+0000","last_peered":"2023-08-18T20:44:35.686101+0000","last_clean":"2023-08-18T20:44:35.686101+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:35.686101+0000","last_undegraded":"2023-08-18T20:44:35.686101+0000","last_fullsized":"2023-08-18T20:44:35.686101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185250+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:35.185250+0000","last_peered":"2023-08-18T20:44:35.185250+0000","last_clean":"2023-08-18T20:44:35.185250+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:35.185250+0000","last_undegraded":"2023-08-18T20:44:35.185250+0000","last_fullsized":"2023-08-18T20:44:35.185250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:29.925572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185235+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:35.185235+0000","last_peered":"2023-08-18T20:44:35.185235+0000","last_clean":"2023-08-18T20:44:35.185235+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:35.185235+0000","last_undegraded":"2023-08-18T20:44:35.185235+0000","last_fullsized":"2023-08-18T20:44:35.185235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674165+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:35.674165+0000","last_peered":"2023-08-18T20:44:35.674165+0000","last_clean":"2023-08-18T20:44:35.674165+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:35.674165+0000","last_undegraded":"2023-08-18T20:44:35.674165+0000","last_fullsized":"2023-08-18T20:44:35.674165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686388+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:35.686388+0000","last_peered":"2023-08-18T20:44:35.686388+0000","last_clean":"2023-08-18T20:44:35.686388+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:35.686388+0000","last_undegraded":"2023-08-18T20:44:35.686388+0000","last_fullsized":"2023-08-18T20:44:35.686388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:58:22.457124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686008+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:35.686008+0000","last_peered":"2023-08-18T20:44:35.686008+0000","last_clean":"2023-08-18T20:44:35.686008+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:35.686008+0000","last_undegraded":"2023-08-18T20:44:35.686008+0000","last_fullsized":"2023-08-18T20:44:35.686008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:42.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686364+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:35.686364+0000","last_peered":"2023-08-18T20:44:35.686364+0000","last_clean":"2023-08-18T20:44:35.686364+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:35.686364+0000","last_undegraded":"2023-08-18T20:44:35.686364+0000","last_fullsized":"2023-08-18T20:44:35.686364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:12.619573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021190+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:35.021190+0000","last_peered":"2023-08-18T20:44:35.021190+0000","last_clean":"2023-08-18T20:44:35.021190+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:35.021190+0000","last_undegraded":"2023-08-18T20:44:35.021190+0000","last_fullsized":"2023-08-18T20:44:35.021190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:08:53.195511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185023+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:35.185023+0000","last_peered":"2023-08-18T20:44:35.185023+0000","last_clean":"2023-08-18T20:44:35.185023+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.185023+0000","last_undegraded":"2023-08-18T20:44:35.185023+0000","last_fullsized":"2023-08-18T20:44:35.185023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674039+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:35.674039+0000","last_peered":"2023-08-18T20:44:35.674039+0000","last_clean":"2023-08-18T20:44:35.674039+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:35.674039+0000","last_undegraded":"2023-08-18T20:44:35.674039+0000","last_fullsized":"2023-08-18T20:44:35.674039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:22:29.616631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021423+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:35.021423+0000","last_peered":"2023-08-18T20:44:35.021423+0000","last_clean":"2023-08-18T20:44:35.021423+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:35.021423+0000","last_undegraded":"2023-08-18T20:44:35.021423+0000","last_fullsized":"2023-08-18T20:44:35.021423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:14:20.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021094+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:35.021094+0000","last_peered":"2023-08-18T20:44:35.021094+0000","last_clean":"2023-08-18T20:44:35.021094+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:35.021094+0000","last_undegraded":"2023-08-18T20:44:35.021094+0000","last_fullsized":"2023-08-18T20:44:35.021094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:19:26.408213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685666+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:35.685666+0000","last_peered":"2023-08-18T20:44:35.685666+0000","last_clean":"2023-08-18T20:44:35.685666+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:35.685666+0000","last_undegraded":"2023-08-18T20:44:35.685666+0000","last_fullsized":"2023-08-18T20:44:35.685666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:13.854640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021160+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:35.021160+0000","last_peered":"2023-08-18T20:44:35.021160+0000","last_clean":"2023-08-18T20:44:35.021160+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:35.021160+0000","last_undegraded":"2023-08-18T20:44:35.021160+0000","last_fullsized":"2023-08-18T20:44:35.021160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:54:26.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673775+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:35.673775+0000","last_peered":"2023-08-18T20:44:35.673775+0000","last_clean":"2023-08-18T20:44:35.673775+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:35.673775+0000","last_undegraded":"2023-08-18T20:44:35.673775+0000","last_fullsized":"2023-08-18T20:44:35.673775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686207+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:35.686207+0000","last_peered":"2023-08-18T20:44:35.686207+0000","last_clean":"2023-08-18T20:44:35.686207+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:35.686207+0000","last_undegraded":"2023-08-18T20:44:35.686207+0000","last_fullsized":"2023-08-18T20:44:35.686207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:35.821786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021527+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:35.021527+0000","last_peered":"2023-08-18T20:44:35.021527+0000","last_clean":"2023-08-18T20:44:35.021527+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:35.021527+0000","last_undegraded":"2023-08-18T20:44:35.021527+0000","last_fullsized":"2023-08-18T20:44:35.021527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:19:55.961983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021296+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:35.021296+0000","last_peered":"2023-08-18T20:44:35.021296+0000","last_clean":"2023-08-18T20:44:35.021296+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:35.021296+0000","last_undegraded":"2023-08-18T20:44:35.021296+0000","last_fullsized":"2023-08-18T20:44:35.021296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:47.584015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686429+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:35.686429+0000","last_peered":"2023-08-18T20:44:35.686429+0000","last_clean":"2023-08-18T20:44:35.686429+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:35.686429+0000","last_undegraded":"2023-08-18T20:44:35.686429+0000","last_fullsized":"2023-08-18T20:44:35.686429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:40.068512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686553+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:35.686553+0000","last_peered":"2023-08-18T20:44:35.686553+0000","last_clean":"2023-08-18T20:44:35.686553+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:35.686553+0000","last_undegraded":"2023-08-18T20:44:35.686553+0000","last_fullsized":"2023-08-18T20:44:35.686553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:15:21.504162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021887+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:35.021887+0000","last_peered":"2023-08-18T20:44:35.021887+0000","last_clean":"2023-08-18T20:44:35.021887+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:35.021887+0000","last_undegraded":"2023-08-18T20:44:35.021887+0000","last_fullsized":"2023-08-18T20:44:35.021887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:14.155493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021905+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:35.021905+0000","last_peered":"2023-08-18T20:44:35.021905+0000","last_clean":"2023-08-18T20:44:35.021905+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:35.021905+0000","last_undegraded":"2023-08-18T20:44:35.021905+0000","last_fullsized":"2023-08-18T20:44:35.021905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:28.147788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185084+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:35.185084+0000","last_peered":"2023-08-18T20:44:35.185084+0000","last_clean":"2023-08-18T20:44:35.185084+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:35.185084+0000","last_undegraded":"2023-08-18T20:44:35.185084+0000","last_fullsized":"2023-08-18T20:44:35.185084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:15.995149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673938+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:35.673938+0000","last_peered":"2023-08-18T20:44:35.673938+0000","last_clean":"2023-08-18T20:44:35.673938+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:35.673938+0000","last_undegraded":"2023-08-18T20:44:35.673938+0000","last_fullsized":"2023-08-18T20:44:35.673938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:14:14.990143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184974+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:35.184974+0000","last_peered":"2023-08-18T20:44:35.184974+0000","last_clean":"2023-08-18T20:44:35.184974+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:35.184974+0000","last_undegraded":"2023-08-18T20:44:35.184974+0000","last_fullsized":"2023-08-18T20:44:35.184974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022202+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:35.022202+0000","last_peered":"2023-08-18T20:44:35.022202+0000","last_clean":"2023-08-18T20:44:35.022202+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:35.022202+0000","last_undegraded":"2023-08-18T20:44:35.022202+0000","last_fullsized":"2023-08-18T20:44:35.022202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:00.662486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673788+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:35.673788+0000","last_peered":"2023-08-18T20:44:35.673788+0000","last_clean":"2023-08-18T20:44:35.673788+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:35.673788+0000","last_undegraded":"2023-08-18T20:44:35.673788+0000","last_fullsized":"2023-08-18T20:44:35.673788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:24:17.443640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685989+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:35.685989+0000","last_peered":"2023-08-18T20:44:35.685989+0000","last_clean":"2023-08-18T20:44:35.685989+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:35.685989+0000","last_undegraded":"2023-08-18T20:44:35.685989+0000","last_fullsized":"2023-08-18T20:44:35.685989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:12.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184870+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:35.184870+0000","last_peered":"2023-08-18T20:44:35.184870+0000","last_clean":"2023-08-18T20:44:35.184870+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:35.184870+0000","last_undegraded":"2023-08-18T20:44:35.184870+0000","last_fullsized":"2023-08-18T20:44:35.184870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:59:38.201036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185166+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:35.185166+0000","last_peered":"2023-08-18T20:44:35.185166+0000","last_clean":"2023-08-18T20:44:35.185166+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:35.185166+0000","last_undegraded":"2023-08-18T20:44:35.185166+0000","last_fullsized":"2023-08-18T20:44:35.185166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:08.351601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686047+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:35.686047+0000","last_peered":"2023-08-18T20:44:35.686047+0000","last_clean":"2023-08-18T20:44:35.686047+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:35.686047+0000","last_undegraded":"2023-08-18T20:44:35.686047+0000","last_fullsized":"2023-08-18T20:44:35.686047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"33'9","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:41.133995+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:41.133995+0000","last_peered":"2023-08-18T20:44:41.133995+0000","last_clean":"2023-08-18T20:44:41.133995+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:41.133995+0000","last_undegraded":"2023-08-18T20:44:41.133995+0000","last_fullsized":"2023-08-18T20:44:41.133995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:34.376644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686532+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:35.686532+0000","last_peered":"2023-08-18T20:44:35.686532+0000","last_clean":"2023-08-18T20:44:35.686532+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:35.686532+0000","last_undegraded":"2023-08-18T20:44:35.686532+0000","last_fullsized":"2023-08-18T20:44:35.686532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:41:34.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022064+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:35.022064+0000","last_peered":"2023-08-18T20:44:35.022064+0000","last_clean":"2023-08-18T20:44:35.022064+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:35.022064+0000","last_undegraded":"2023-08-18T20:44:35.022064+0000","last_fullsized":"2023-08-18T20:44:35.022064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:21:05.041012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686136+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:35.686136+0000","last_peered":"2023-08-18T20:44:35.686136+0000","last_clean":"2023-08-18T20:44:35.686136+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:35.686136+0000","last_undegraded":"2023-08-18T20:44:35.686136+0000","last_fullsized":"2023-08-18T20:44:35.686136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021526+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:35.021526+0000","last_peered":"2023-08-18T20:44:35.021526+0000","last_clean":"2023-08-18T20:44:35.021526+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:35.021526+0000","last_undegraded":"2023-08-18T20:44:35.021526+0000","last_fullsized":"2023-08-18T20:44:35.021526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:30:54.763621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674145+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:35.674145+0000","last_peered":"2023-08-18T20:44:35.674145+0000","last_clean":"2023-08-18T20:44:35.674145+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:35.674145+0000","last_undegraded":"2023-08-18T20:44:35.674145+0000","last_fullsized":"2023-08-18T20:44:35.674145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:38.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185223+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:35.185223+0000","last_peered":"2023-08-18T20:44:35.185223+0000","last_clean":"2023-08-18T20:44:35.185223+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:35.185223+0000","last_undegraded":"2023-08-18T20:44:35.185223+0000","last_fullsized":"2023-08-18T20:44:35.185223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:35:37.595262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021269+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:35.021269+0000","last_peered":"2023-08-18T20:44:35.021269+0000","last_clean":"2023-08-18T20:44:35.021269+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:35.021269+0000","last_undegraded":"2023-08-18T20:44:35.021269+0000","last_fullsized":"2023-08-18T20:44:35.021269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:10:19.922914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686003+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:35.686003+0000","last_peered":"2023-08-18T20:44:35.686003+0000","last_clean":"2023-08-18T20:44:35.686003+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:35.686003+0000","last_undegraded":"2023-08-18T20:44:35.686003+0000","last_fullsized":"2023-08-18T20:44:35.686003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:29.096868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185127+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:35.185127+0000","last_peered":"2023-08-18T20:44:35.185127+0000","last_clean":"2023-08-18T20:44:35.185127+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:35.185127+0000","last_undegraded":"2023-08-18T20:44:35.185127+0000","last_fullsized":"2023-08-18T20:44:35.185127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.810386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686171+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:35.686171+0000","last_peered":"2023-08-18T20:44:35.686171+0000","last_clean":"2023-08-18T20:44:35.686171+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:35.686171+0000","last_undegraded":"2023-08-18T20:44:35.686171+0000","last_fullsized":"2023-08-18T20:44:35.686171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:38.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686345+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:35.686345+0000","last_peered":"2023-08-18T20:44:35.686345+0000","last_clean":"2023-08-18T20:44:35.686345+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:35.686345+0000","last_undegraded":"2023-08-18T20:44:35.686345+0000","last_fullsized":"2023-08-18T20:44:35.686345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:08:58.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674020+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:35.674020+0000","last_peered":"2023-08-18T20:44:35.674020+0000","last_clean":"2023-08-18T20:44:35.674020+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:35.674020+0000","last_undegraded":"2023-08-18T20:44:35.674020+0000","last_fullsized":"2023-08-18T20:44:35.674020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:22.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022453+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:35.022453+0000","last_peered":"2023-08-18T20:44:35.022453+0000","last_clean":"2023-08-18T20:44:35.022453+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:35.022453+0000","last_undegraded":"2023-08-18T20:44:35.022453+0000","last_fullsized":"2023-08-18T20:44:35.022453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:00:07.822682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021626+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:35.021626+0000","last_peered":"2023-08-18T20:44:35.021626+0000","last_clean":"2023-08-18T20:44:35.021626+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:35.021626+0000","last_undegraded":"2023-08-18T20:44:35.021626+0000","last_fullsized":"2023-08-18T20:44:35.021626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:02.246115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685538+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:35.685538+0000","last_peered":"2023-08-18T20:44:35.685538+0000","last_clean":"2023-08-18T20:44:35.685538+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:35.685538+0000","last_undegraded":"2023-08-18T20:44:35.685538+0000","last_fullsized":"2023-08-18T20:44:35.685538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:12:44.118040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686474+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:35.686474+0000","last_peered":"2023-08-18T20:44:35.686474+0000","last_clean":"2023-08-18T20:44:35.686474+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:35.686474+0000","last_undegraded":"2023-08-18T20:44:35.686474+0000","last_fullsized":"2023-08-18T20:44:35.686474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.149467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185136+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:35.185136+0000","last_peered":"2023-08-18T20:44:35.185136+0000","last_clean":"2023-08-18T20:44:35.185136+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:35.185136+0000","last_undegraded":"2023-08-18T20:44:35.185136+0000","last_fullsized":"2023-08-18T20:44:35.185136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:53:23.234237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686469+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:35.686469+0000","last_peered":"2023-08-18T20:44:35.686469+0000","last_clean":"2023-08-18T20:44:35.686469+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:35.686469+0000","last_undegraded":"2023-08-18T20:44:35.686469+0000","last_fullsized":"2023-08-18T20:44:35.686469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:11:37.290795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686446+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:35.686446+0000","last_peered":"2023-08-18T20:44:35.686446+0000","last_clean":"2023-08-18T20:44:35.686446+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:35.686446+0000","last_undegraded":"2023-08-18T20:44:35.686446+0000","last_fullsized":"2023-08-18T20:44:35.686446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:57:06.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686216+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:35.686216+0000","last_peered":"2023-08-18T20:44:35.686216+0000","last_clean":"2023-08-18T20:44:35.686216+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:35.686216+0000","last_undegraded":"2023-08-18T20:44:35.686216+0000","last_fullsized":"2023-08-18T20:44:35.686216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:47.071148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686382+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:35.686382+0000","last_peered":"2023-08-18T20:44:35.686382+0000","last_clean":"2023-08-18T20:44:35.686382+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:35.686382+0000","last_undegraded":"2023-08-18T20:44:35.686382+0000","last_fullsized":"2023-08-18T20:44:35.686382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:40.808594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022926+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:35.022926+0000","last_peered":"2023-08-18T20:44:35.022926+0000","last_clean":"2023-08-18T20:44:35.022926+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:35.022926+0000","last_undegraded":"2023-08-18T20:44:35.022926+0000","last_fullsized":"2023-08-18T20:44:35.022926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:39.803589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674105+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:35.674105+0000","last_peered":"2023-08-18T20:44:35.674105+0000","last_clean":"2023-08-18T20:44:35.674105+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:35.674105+0000","last_undegraded":"2023-08-18T20:44:35.674105+0000","last_fullsized":"2023-08-18T20:44:35.674105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:35.381650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:46.048590+0000","last_change":"2023-08-18T20:44:46.048590+0000","last_active":"2023-08-18T20:44:46.048590+0000","last_peered":"2023-08-18T20:44:46.048590+0000","last_clean":"2023-08-18T20:44:46.048590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:46.048590+0000","last_undegraded":"2023-08-18T20:44:46.048590+0000","last_fullsized":"2023-08-18T20:44:46.048590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685586+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:35.685586+0000","last_peered":"2023-08-18T20:44:35.685586+0000","last_clean":"2023-08-18T20:44:35.685586+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:35.685586+0000","last_undegraded":"2023-08-18T20:44:35.685586+0000","last_fullsized":"2023-08-18T20:44:35.685586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:01.667492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673985+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:35.673985+0000","last_peered":"2023-08-18T20:44:35.673985+0000","last_clean":"2023-08-18T20:44:35.673985+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:35.673985+0000","last_undegraded":"2023-08-18T20:44:35.673985+0000","last_fullsized":"2023-08-18T20:44:35.673985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:04.476928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022178+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:35.022178+0000","last_peered":"2023-08-18T20:44:35.022178+0000","last_clean":"2023-08-18T20:44:35.022178+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:35.022178+0000","last_undegraded":"2023-08-18T20:44:35.022178+0000","last_fullsized":"2023-08-18T20:44:35.022178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022145+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:35.022145+0000","last_peered":"2023-08-18T20:44:35.022145+0000","last_clean":"2023-08-18T20:44:35.022145+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:35.022145+0000","last_undegraded":"2023-08-18T20:44:35.022145+0000","last_fullsized":"2023-08-18T20:44:35.022145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021715+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:35.021715+0000","last_peered":"2023-08-18T20:44:35.021715+0000","last_clean":"2023-08-18T20:44:35.021715+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:35.021715+0000","last_undegraded":"2023-08-18T20:44:35.021715+0000","last_fullsized":"2023-08-18T20:44:35.021715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:26:37.673955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022572+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:35.022572+0000","last_peered":"2023-08-18T20:44:35.022572+0000","last_clean":"2023-08-18T20:44:35.022572+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:35.022572+0000","last_undegraded":"2023-08-18T20:44:35.022572+0000","last_fullsized":"2023-08-18T20:44:35.022572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:39.134766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686401+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:35.686401+0000","last_peered":"2023-08-18T20:44:35.686401+0000","last_clean":"2023-08-18T20:44:35.686401+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:35.686401+0000","last_undegraded":"2023-08-18T20:44:35.686401+0000","last_fullsized":"2023-08-18T20:44:35.686401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:29.334781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022784+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:35.022784+0000","last_peered":"2023-08-18T20:44:35.022784+0000","last_clean":"2023-08-18T20:44:35.022784+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:35.022784+0000","last_undegraded":"2023-08-18T20:44:35.022784+0000","last_fullsized":"2023-08-18T20:44:35.022784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:36.826792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021052+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:35.021052+0000","last_peered":"2023-08-18T20:44:35.021052+0000","last_clean":"2023-08-18T20:44:35.021052+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:35.021052+0000","last_undegraded":"2023-08-18T20:44:35.021052+0000","last_fullsized":"2023-08-18T20:44:35.021052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:10:15.545511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673869+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:35.673869+0000","last_peered":"2023-08-18T20:44:35.673869+0000","last_clean":"2023-08-18T20:44:35.673869+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:35.673869+0000","last_undegraded":"2023-08-18T20:44:35.673869+0000","last_fullsized":"2023-08-18T20:44:35.673869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:52:50.425944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686144+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:35.686144+0000","last_peered":"2023-08-18T20:44:35.686144+0000","last_clean":"2023-08-18T20:44:35.686144+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:35.686144+0000","last_undegraded":"2023-08-18T20:44:35.686144+0000","last_fullsized":"2023-08-18T20:44:35.686144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:12:36.239200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022047+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:35.022047+0000","last_peered":"2023-08-18T20:44:35.022047+0000","last_clean":"2023-08-18T20:44:35.022047+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:35.022047+0000","last_undegraded":"2023-08-18T20:44:35.022047+0000","last_fullsized":"2023-08-18T20:44:35.022047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:55.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022431+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:35.022431+0000","last_peered":"2023-08-18T20:44:35.022431+0000","last_clean":"2023-08-18T20:44:35.022431+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:35.022431+0000","last_undegraded":"2023-08-18T20:44:35.022431+0000","last_fullsized":"2023-08-18T20:44:35.022431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:46.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021198+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:35.021198+0000","last_peered":"2023-08-18T20:44:35.021198+0000","last_clean":"2023-08-18T20:44:35.021198+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:35.021198+0000","last_undegraded":"2023-08-18T20:44:35.021198+0000","last_fullsized":"2023-08-18T20:44:35.021198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:14.550052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:38:48.076154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.674256+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:35.674256+0000","last_peered":"2023-08-18T20:44:35.674256+0000","last_clean":"2023-08-18T20:44:35.674256+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:35.674256+0000","last_undegraded":"2023-08-18T20:44:35.674256+0000","last_fullsized":"2023-08-18T20:44:35.674256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:06:07.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.673718+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:35.673718+0000","last_peered":"2023-08-18T20:44:35.673718+0000","last_clean":"2023-08-18T20:44:35.673718+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:35.673718+0000","last_undegraded":"2023-08-18T20:44:35.673718+0000","last_fullsized":"2023-08-18T20:44:35.673718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022446+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:35.022446+0000","last_peered":"2023-08-18T20:44:35.022446+0000","last_clean":"2023-08-18T20:44:35.022446+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:35.022446+0000","last_undegraded":"2023-08-18T20:44:35.022446+0000","last_fullsized":"2023-08-18T20:44:35.022446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:49:17.166598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.686127+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:35.686127+0000","last_peered":"2023-08-18T20:44:35.686127+0000","last_clean":"2023-08-18T20:44:35.686127+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:35.686127+0000","last_undegraded":"2023-08-18T20:44:35.686127+0000","last_fullsized":"2023-08-18T20:44:35.686127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:16.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021695+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:35.021695+0000","last_peered":"2023-08-18T20:44:35.021695+0000","last_clean":"2023-08-18T20:44:35.021695+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:35.021695+0000","last_undegraded":"2023-08-18T20:44:35.021695+0000","last_fullsized":"2023-08-18T20:44:35.021695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:04:24.273971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685639+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:35.685639+0000","last_peered":"2023-08-18T20:44:35.685639+0000","last_clean":"2023-08-18T20:44:35.685639+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:35.685639+0000","last_undegraded":"2023-08-18T20:44:35.685639+0000","last_fullsized":"2023-08-18T20:44:35.685639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:33:13.931577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021948+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:35.021948+0000","last_peered":"2023-08-18T20:44:35.021948+0000","last_clean":"2023-08-18T20:44:35.021948+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:35.021948+0000","last_undegraded":"2023-08-18T20:44:35.021948+0000","last_fullsized":"2023-08-18T20:44:35.021948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:32:54.989567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021908+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:35.021908+0000","last_peered":"2023-08-18T20:44:35.021908+0000","last_clean":"2023-08-18T20:44:35.021908+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:35.021908+0000","last_undegraded":"2023-08-18T20:44:35.021908+0000","last_fullsized":"2023-08-18T20:44:35.021908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:02:17.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685874+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:35.685874+0000","last_peered":"2023-08-18T20:44:35.685874+0000","last_clean":"2023-08-18T20:44:35.685874+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:35.685874+0000","last_undegraded":"2023-08-18T20:44:35.685874+0000","last_fullsized":"2023-08-18T20:44:35.685874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:07:13.056698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.184860+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:35.184860+0000","last_peered":"2023-08-18T20:44:35.184860+0000","last_clean":"2023-08-18T20:44:35.184860+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:35.184860+0000","last_undegraded":"2023-08-18T20:44:35.184860+0000","last_fullsized":"2023-08-18T20:44:35.184860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:55:12.557777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.022636+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:35.022636+0000","last_peered":"2023-08-18T20:44:35.022636+0000","last_clean":"2023-08-18T20:44:35.022636+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:35.022636+0000","last_undegraded":"2023-08-18T20:44:35.022636+0000","last_fullsized":"2023-08-18T20:44:35.022636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:45.836631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685871+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:35.685871+0000","last_peered":"2023-08-18T20:44:35.685871+0000","last_clean":"2023-08-18T20:44:35.685871+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:35.685871+0000","last_undegraded":"2023-08-18T20:44:35.685871+0000","last_fullsized":"2023-08-18T20:44:35.685871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021125+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:35.021125+0000","last_peered":"2023-08-18T20:44:35.021125+0000","last_clean":"2023-08-18T20:44:35.021125+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:35.021125+0000","last_undegraded":"2023-08-18T20:44:35.021125+0000","last_fullsized":"2023-08-18T20:44:35.021125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:32.258779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.021152+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:35.021152+0000","last_peered":"2023-08-18T20:44:35.021152+0000","last_clean":"2023-08-18T20:44:35.021152+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:35.021152+0000","last_undegraded":"2023-08-18T20:44:35.021152+0000","last_fullsized":"2023-08-18T20:44:35.021152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:12:08.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.685832+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:35.685832+0000","last_peered":"2023-08-18T20:44:35.685832+0000","last_clean":"2023-08-18T20:44:35.685832+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:35.685832+0000","last_undegraded":"2023-08-18T20:44:35.685832+0000","last_fullsized":"2023-08-18T20:44:35.685832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:10:27.620837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185015+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:35.185015+0000","last_peered":"2023-08-18T20:44:35.185015+0000","last_clean":"2023-08-18T20:44:35.185015+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:35.185015+0000","last_undegraded":"2023-08-18T20:44:35.185015+0000","last_fullsized":"2023-08-18T20:44:35.185015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:32:32.700486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-18T20:44:47.054355+0000","last_change":"2023-08-18T20:44:47.054355+0000","last_active":"2023-08-18T20:44:47.054355+0000","last_peered":"2023-08-18T20:44:47.054355+0000","last_clean":"2023-08-18T20:44:47.054355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-18T20:44:47.054355+0000","last_undegraded":"2023-08-18T20:44:47.054355+0000","last_fullsized":"2023-08-18T20:44:47.054355+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-18T20:44:35.185240+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:35.185240+0000","last_peered":"2023-08-18T20:44:35.185240+0000","last_clean":"2023-08-18T20:44:35.185240+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:35.185240+0000","last_undegraded":"2023-08-18T20:44:35.185240+0000","last_fullsized":"2023-08-18T20:44:35.185240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:46:16.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.755},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":149911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.501},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.435}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.372}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":739787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.309},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.23499999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.25800000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":149363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.371},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":149399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":152482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.54600000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.442}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.376},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46200000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":149441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.626},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:52.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-08-18T20:44:52.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-08-18T20:44:52.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-08-18T20:44:52.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-08-18T20:44:52.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-08-18T20:44:52.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-08-18T20:44:52.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-08-18T20:44:52.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-08-18T20:44:52.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-08-18T20:44:52.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-08-18T20:44:52.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-08-18T20:44:52.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-08-18T20:44:52.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-08-18T20:44:52.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-08-18T20:44:52.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-08-18T20:44:52.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-08-18T20:44:52.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-08-18T20:44:52.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-08-18T20:44:52.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-08-18T20:44:52.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-08-18T20:44:52.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-08-18T20:44:52.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-08-18T20:44:52.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-08-18T20:44:52.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-08-18T20:44:52.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-08-18T20:44:52.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-08-18T20:44:52.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-08-18T20:44:52.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-08-18T20:44:52.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-08-18T20:44:52.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-08-18T20:44:52.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-08-18T20:44:52.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-08-18T20:44:52.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-08-18T20:44:52.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-08-18T20:44:52.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-08-18T20:44:52.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-08-18T20:44:52.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-08-18T20:44:52.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-08-18T20:44:52.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-08-18T20:44:52.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-08-18T20:44:52.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-08-18T20:44:52.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-08-18T20:44:52.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-08-18T20:44:52.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-08-18T20:44:52.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-08-18T20:44:52.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-08-18T20:44:52.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-08-18T20:44:52.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-08-18T20:44:52.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-08-18T20:44:52.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-08-18T20:44:52.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-08-18T20:44:52.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-08-18T20:44:52.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-08-18T20:44:52.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-08-18T20:44:52.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-08-18T20:44:52.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-08-18T20:44:52.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-08-18T20:44:52.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-08-18T20:44:52.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-08-18T20:44:52.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-08-18T20:44:52.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-08-18T20:44:52.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-08-18T20:44:52.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-08-18T20:44:52.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:46.048590+0000', 'last_change': '2023-08-18T20:44:46.048590+0000', 'last_active': '2023-08-18T20:44:46.048590+0000', 'last_peered': '2023-08-18T20:44:46.048590+0000', 'last_clean': '2023-08-18T20:44:46.048590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:46.048590+0000', 'last_undegraded': '2023-08-18T20:44:46.048590+0000', 'last_fullsized': '2023-08-18T20:44:46.048590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:46.048590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-08-18T20:44:52.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-08-18T20:44:52.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-08-18T20:44:52.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-08-18T20:44:52.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-08-18T20:44:52.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-08-18T20:44:52.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-08-18T20:44:52.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:52.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-08-18T20:44:52.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-08-18T20:44:53.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-08-18T20:44:53.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-08-18T20:44:53.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-08-18T20:44:53.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-08-18T20:44:53.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-08-18T20:44:53.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-08-18T20:44:53.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-08-18T20:44:53.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-08-18T20:44:53.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-08-18T20:44:53.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-08-18T20:44:53.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-08-18T20:44:53.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-08-18T20:44:53.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-08-18T20:44:53.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-08-18T20:44:53.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-08-18T20:44:53.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-08-18T20:44:53.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-08-18T20:44:53.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-08-18T20:44:53.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-08-18T20:44:53.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-08-18T20:44:53.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-08-18T20:44:53.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-08-18T20:44:53.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-08-18T20:44:53.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-08-18T20:44:53.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-18T20:44:47.054355+0000', 'last_change': '2023-08-18T20:44:47.054355+0000', 'last_active': '2023-08-18T20:44:47.054355+0000', 'last_peered': '2023-08-18T20:44:47.054355+0000', 'last_clean': '2023-08-18T20:44:47.054355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-18T20:44:47.054355+0000', 'last_undegraded': '2023-08-18T20:44:47.054355+0000', 'last_fullsized': '2023-08-18T20:44:47.054355+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'last_clean_scrub_stamp': '2023-08-18T20:44:47.054355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-18T20:44:53.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-18T20:44:53.018 INFO:tasks.ceph.mds.a.smithi121.stderr:2023-08-18T20:44:52.987+0000 7fe0e8844700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:44:53.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.136+0000 7f34b7554700 1 Processor -- start 2023-08-18T20:44:53.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b7554700 1 -- start start 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b7554700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f34b0151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b7554700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b006fba0 con 0x7f34b006f420 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b7554700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b01552b0 con 0x7f34b00c7220 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b7554700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a7300 con 0x7f34b00c61a0 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b4aef700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f34b006f420 0x7f34b0151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49034/0 (socket says 172.21.15.121:49034) 2023-08-18T20:44:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.137+0000 7f34b4aef700 1 -- 172.21.15.121:0/2343721941 learned_addr learned my addr 172.21.15.121:0/2343721941 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593961760 0 0) 0x7f34b006fba0 con 0x7f34b006f420 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f349c0035b0 con 0x7f34b006f420 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b5af1700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f34b0151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227488528 0 0) 0x7f349c0035b0 con 0x7f34b006f420 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 msgr2=0x7f34b0151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f34b0151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 >> v1:172.21.15.122:6789/0 conn(0x7f34b00c7220 legacy=0x7f34b00c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00a6d40 con 0x7f34b006f420 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f34ac001670 con 0x7f34b006f420 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 >> v1:172.21.15.121:6789/0 conn(0x7f34b006f420 legacy=0x7f34b0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f349c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c004850 0x7f349c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f349c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a7300 con 0x7f349c003aa0 2023-08-18T20:44:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00bb10 con 0x7f349c004850 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00bcd0 con 0x7f34b00c61a0 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f349c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b5af1700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f349c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b4aef700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c004850 0x7f349c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 -- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 msgr2=0x7f349c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b00c61a0 0x7f349c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 -- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c004850 msgr2=0x7f349c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c004850 0x7f349c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b52f0700 1 -- 172.21.15.121:0/2343721941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0035b0 con 0x7f349c003aa0 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.138+0000 7f34b4aef700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c004850 0x7f349c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b52f0700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f349c003ec0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f34a00017c0 tx=0x7f349c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818219e302ddba0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00052d0 con 0x7f349c003aa0 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0005430 con 0x7f349c003aa0 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34a7fff700 1 -- 172.21.15.121:0/2343721941 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00038c0 con 0x7f349c003aa0 2023-08-18T20:44:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 -- 172.21.15.121:0/2343721941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 msgr2=0x7f349c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 --2- 172.21.15.121:0/2343721941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f349c003ec0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f34a00017c0 tx=0x7f349c005880 comp rx=0 tx=0).stop 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b5af1700 1 -- 172.21.15.121:0/2343721941 reap_dead start 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 -- 172.21.15.121:0/2343721941 shutdown_connections 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 -- 172.21.15.121:0/2343721941 >> 172.21.15.121:0/2343721941 conn(0x7f34b00a96a0 msgr2=0x7f34b00a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 -- 172.21.15.121:0/2343721941 shutdown_connections 2023-08-18T20:44:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.139+0000 7f34b7554700 1 -- 172.21.15.121:0/2343721941 wait complete. 2023-08-18T20:44:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 Processor -- start 2023-08-18T20:44:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 -- start start 2023-08-18T20:44:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b00acfb0 0x7f34b0158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b0158690 0x7f34b00bd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01e9810 con 0x7f349c003aa0 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01e9a90 con 0x7f34b00acfb0 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b7554700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01e9d70 con 0x7f34b0158690 2023-08-18T20:44:53.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b52f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b52f0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42462/0 (socket says 172.21.15.121:42462) 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.141+0000 7f34b52f0700 1 -- 172.21.15.121:0/3836262954 learned_addr learned my addr 172.21.15.121:0/3836262954 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 -- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b0158690 msgr2=0x7f34b00bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b0158690 0x7f34b00bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 -- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b00acfb0 msgr2=0x7f34b0158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b4aef700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b00acfb0 0x7f34b0158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b00acfb0 0x7f34b0158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 -- 172.21.15.121:0/3836262954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b01ea050 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b52f0700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f349c00bae0 tx=0x7f34a0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0007240 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00073a0 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b01e9810 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0001290 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.142+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00ad430 con 0x7f349c003aa0 2023-08-18T20:44:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.143+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b0074730 con 0x7f349c003aa0 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.143+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34a0003680 con 0x7f349c003aa0 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.144+0000 7f34a5ffb700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 0x7f349406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.144+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f34a0089720 con 0x7f349c003aa0 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.144+0000 7f34b4aef700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 0x7f349406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.144+0000 7f34b4aef700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 0x7f349406c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f34ac001bb0 tx=0x7f34ac001b40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.148+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f34a0054b40 con 0x7f349c003aa0 2023-08-18T20:44:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.415+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f34b00c5520 con 0x7f349c003aa0 2023-08-18T20:44:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.416+0000 7f34a5ffb700 1 -- 172.21.15.121:0/3836262954 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1662 (secure 0 0 0) 0x7f34a0058160 con 0x7f349c003aa0 2023-08-18T20:44:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:53.417 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1692391415,"num_in_osds":8,"osd_in_since":1692391407,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":201}],"num_pgs":201,"num_pools":6,"num_objects":45,"data_bytes":596695,"bytes_used":230219776,"bytes_avail":772863893504,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":20,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5025},{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5028}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-08-18T20:44:36.924085+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 msgr2=0x7f349406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 0x7f349406c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f34ac001bb0 tx=0x7f34ac001b40 comp rx=0 tx=0).stop 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 msgr2=0x7f34b0156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f349c00bae0 tx=0x7f34a0001120 comp rx=0 tx=0).stop 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 shutdown_connections 2023-08-18T20:44:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34b0158690 0x7f34b00bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f349406a0e0 0x7f349406c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f349c003aa0 0x7f34b0156960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 --2- 172.21.15.121:0/3836262954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b00acfb0 0x7f34b0158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 >> 172.21.15.121:0/3836262954 conn(0x7f34b00a96a0 msgr2=0x7f34b006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 shutdown_connections 2023-08-18T20:44:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.418+0000 7f34b7554700 1 -- 172.21.15.121:0/3836262954 wait complete. 2023-08-18T20:44:53.431 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-18T20:44:53.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:53.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.550+0000 7f5c17392700 1 Processor -- start 2023-08-18T20:44:53.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 -- start start 2023-08-18T20:44:53.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 0x7f5c100c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5c10070950 0x7f5c100c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100c2260 con 0x7f5c1014e950 2023-08-18T20:44:53.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100a6630 con 0x7f5c10070950 2023-08-18T20:44:53.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.551+0000 7f5c17392700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10151d90 con 0x7f5c1014ed30 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1512e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5c1014e950 0x7f5c100c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49052/0 (socket says 172.21.15.121:49052) 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1512e700 1 -- 172.21.15.121:0/410377451 learned_addr learned my addr 172.21.15.121:0/410377451 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 --2- 172.21.15.121:0/410377451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 0x7f5c100c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1592f700 1 --2- 172.21.15.121:0/410377451 >> v2:172.21.15.122:3300/0 conn(0x7f5c10070950 0x7f5c100c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866780346 0 0) 0x7f5c100c2260 con 0x7f5c1014e950 2023-08-18T20:44:53.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bfc0035b0 con 0x7f5c1014e950 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 -- 172.21.15.121:0/410377451 >> v2:172.21.15.122:3300/0 conn(0x7f5c10070950 msgr2=0x7f5c100c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 --2- 172.21.15.121:0/410377451 >> v2:172.21.15.122:3300/0 conn(0x7f5c10070950 0x7f5c100c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 -- 172.21.15.121:0/410377451 >> v1:172.21.15.121:6789/0 conn(0x7f5c1014e950 legacy=0x7f5c100c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705323686 0 0) 0x7f5bfc0035b0 con 0x7f5c1014e950 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 -- 172.21.15.121:0/410377451 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10152070 con 0x7f5c1014ed30 2023-08-18T20:44:53.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c1492d700 1 --2- 172.21.15.121:0/410377451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 0x7f5c100c2ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009840 tx=0x7f5c0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0e344a8ce10faa server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00001670 con 0x7f5c1014ed30 2023-08-18T20:44:53.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c004030 con 0x7f5c1014ed30 2023-08-18T20:44:53.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.552+0000 7f5c07fff700 1 -- 172.21.15.121:0/410377451 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0043c0 con 0x7f5c1014ed30 2023-08-18T20:44:53.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 -- 172.21.15.121:0/410377451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 msgr2=0x7f5c100c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 --2- 172.21.15.121:0/410377451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 0x7f5c100c2ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009840 tx=0x7f5c0c009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 -- 172.21.15.121:0/410377451 shutdown_connections 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 --2- 172.21.15.121:0/410377451 >> v2:172.21.15.122:3300/0 conn(0x7f5c10070950 0x7f5c100c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 --2- 172.21.15.121:0/410377451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014ed30 0x7f5c100c2ed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 -- 172.21.15.121:0/410377451 >> 172.21.15.121:0/410377451 conn(0x7f5c100c6b10 msgr2=0x7f5c100c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 -- 172.21.15.121:0/410377451 shutdown_connections 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.553+0000 7f5c17392700 1 -- 172.21.15.121:0/410377451 wait complete. 2023-08-18T20:44:53.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.554+0000 7f5c17392700 1 Processor -- start 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.554+0000 7f5c17392700 1 -- start start 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014e950 0x7f5c100abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c1014ed30 0x7f5c1006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1006e9a0 con 0x7f5c10070950 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c0f80 con 0x7f5c1014ed30 2023-08-18T20:44:53.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c17392700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c101eb8e0 con 0x7f5c1014e950 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42476/0 (socket says 172.21.15.121:42476) 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 -- 172.21.15.121:0/1230982336 learned_addr learned my addr 172.21.15.121:0/1230982336 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1492d700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014e950 0x7f5c100abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1592f700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c1014ed30 0x7f5c1006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 -- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014e950 msgr2=0x7f5c100abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014e950 0x7f5c100abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 -- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c1014ed30 msgr2=0x7f5c1006ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c1014ed30 0x7f5c1006ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 -- 172.21.15.121:0/1230982336 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0094a0 con 0x7f5c10070950 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c1512e700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c780 tx=0x7f5c0000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.555+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00004c80 con 0x7f5c10070950 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.556+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c00004de0 con 0x7f5c10070950 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.556+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c101eb360 con 0x7f5c10070950 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.556+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000072f0 con 0x7f5c10070950 2023-08-18T20:44:53.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.556+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1014c6c0 con 0x7f5c10070950 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.557+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c10074730 con 0x7f5c10070950 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.557+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c00007450 con 0x7f5c10070950 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.557+0000 7f5c05ffb700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 0x7f5bf406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.557+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f5c000886a0 con 0x7f5c10070950 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.557+0000 7f5c1492d700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 0x7f5bf406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:53.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.558+0000 7f5c1492d700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 0x7f5bf406c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c1014f150 tx=0x7f5c0c013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:53.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.562+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5c00053a40 con 0x7f5c10070950 2023-08-18T20:44:53.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.748+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c100716e0 con 0x7f5bf406a0e0 2023-08-18T20:44:53.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.761+0000 7f5c05ffb700 1 -- 172.21.15.121:0/1230982336 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549911 (secure 0 0 0) 0x7f5c0c004520 con 0x7f5bf406a0e0 2023-08-18T20:44:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:53.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 msgr2=0x7f5bf406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 0x7f5bf406c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c1014f150 tx=0x7f5c0c013040 comp rx=0 tx=0).stop 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 msgr2=0x7f5c1014bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c780 tx=0x7f5c0000cb40 comp rx=0 tx=0).stop 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 shutdown_connections 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c1014ed30 0x7f5c1006ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5bf406a0e0 0x7f5bf406c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c10070950 0x7f5c1014bb90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 --2- 172.21.15.121:0/1230982336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c1014e950 0x7f5c100abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:53.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 >> 172.21.15.121:0/1230982336 conn(0x7f5c100c6b10 msgr2=0x7f5c101dc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:53.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 shutdown_connections 2023-08-18T20:44:53.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:53.766+0000 7f5c17392700 1 -- 172.21.15.121:0/1230982336 wait complete. 2023-08-18T20:44:53.771 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:53.778 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-08-18T20:44:52.931123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596695,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":357,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224824,"kb_used_data":4552,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749896,"statfs":{"total":773094113280,"available":772863893504,"internally_reserved":0,"allocated":4661248,"data_stored":2628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001062"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078653+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:49.078653+0000","last_peered":"2023-08-18T20:44:49.078653+0000","last_clean":"2023-08-18T20:44:49.078653+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:49.078653+0000","last_undegraded":"2023-08-18T20:44:49.078653+0000","last_fullsized":"2023-08-18T20:44:49.078653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:39:57.249148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315044+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:49.315044+0000","last_peered":"2023-08-18T20:44:49.315044+0000","last_clean":"2023-08-18T20:44:49.315044+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:49.315044+0000","last_undegraded":"2023-08-18T20:44:49.315044+0000","last_fullsized":"2023-08-18T20:44:49.315044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:54.696956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314591+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:49.314591+0000","last_peered":"2023-08-18T20:44:49.314591+0000","last_clean":"2023-08-18T20:44:49.314591+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:49.314591+0000","last_undegraded":"2023-08-18T20:44:49.314591+0000","last_fullsized":"2023-08-18T20:44:49.314591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:10.336570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567840+0000","last_change":"2023-08-18T20:44:47.080583+0000","last_active":"2023-08-18T20:44:49.567840+0000","last_peered":"2023-08-18T20:44:49.567840+0000","last_clean":"2023-08-18T20:44:49.567840+0000","last_became_active":"2023-08-18T20:44:47.080279+0000","last_became_peered":"2023-08-18T20:44:47.080279+0000","last_unstale":"2023-08-18T20:44:49.567840+0000","last_undegraded":"2023-08-18T20:44:49.567840+0000","last_fullsized":"2023-08-18T20:44:49.567840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.226070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315351+0000","last_change":"2023-08-18T20:44:48.097511+0000","last_active":"2023-08-18T20:44:49.315351+0000","last_peered":"2023-08-18T20:44:49.315351+0000","last_clean":"2023-08-18T20:44:49.315351+0000","last_became_active":"2023-08-18T20:44:48.097167+0000","last_became_peered":"2023-08-18T20:44:48.097167+0000","last_unstale":"2023-08-18T20:44:49.315351+0000","last_undegraded":"2023-08-18T20:44:49.315351+0000","last_fullsized":"2023-08-18T20:44:49.315351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:24:57.736900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078292+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:49.078292+0000","last_peered":"2023-08-18T20:44:49.078292+0000","last_clean":"2023-08-18T20:44:49.078292+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:49.078292+0000","last_undegraded":"2023-08-18T20:44:49.078292+0000","last_fullsized":"2023-08-18T20:44:49.078292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:56:44.166051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077685+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:49.077685+0000","last_peered":"2023-08-18T20:44:49.077685+0000","last_clean":"2023-08-18T20:44:49.077685+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:49.077685+0000","last_undegraded":"2023-08-18T20:44:49.077685+0000","last_fullsized":"2023-08-18T20:44:49.077685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:57:12.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567215+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:49.567215+0000","last_peered":"2023-08-18T20:44:49.567215+0000","last_clean":"2023-08-18T20:44:49.567215+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:49.567215+0000","last_undegraded":"2023-08-18T20:44:49.567215+0000","last_fullsized":"2023-08-18T20:44:49.567215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:55:06.042269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568344+0000","last_change":"2023-08-18T20:44:47.079058+0000","last_active":"2023-08-18T20:44:49.568344+0000","last_peered":"2023-08-18T20:44:49.568344+0000","last_clean":"2023-08-18T20:44:49.568344+0000","last_became_active":"2023-08-18T20:44:47.078761+0000","last_became_peered":"2023-08-18T20:44:47.078761+0000","last_unstale":"2023-08-18T20:44:49.568344+0000","last_undegraded":"2023-08-18T20:44:49.568344+0000","last_fullsized":"2023-08-18T20:44:49.568344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:19.820137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078319+0000","last_change":"2023-08-18T20:44:48.080277+0000","last_active":"2023-08-18T20:44:49.078319+0000","last_peered":"2023-08-18T20:44:49.078319+0000","last_clean":"2023-08-18T20:44:49.078319+0000","last_became_active":"2023-08-18T20:44:48.079974+0000","last_became_peered":"2023-08-18T20:44:48.079974+0000","last_unstale":"2023-08-18T20:44:49.078319+0000","last_undegraded":"2023-08-18T20:44:49.078319+0000","last_fullsized":"2023-08-18T20:44:49.078319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:30:21.497449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570093+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:49.570093+0000","last_peered":"2023-08-18T20:44:49.570093+0000","last_clean":"2023-08-18T20:44:49.570093+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:49.570093+0000","last_undegraded":"2023-08-18T20:44:49.570093+0000","last_fullsized":"2023-08-18T20:44:49.570093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:28:40.145306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315321+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:49.315321+0000","last_peered":"2023-08-18T20:44:49.315321+0000","last_clean":"2023-08-18T20:44:49.315321+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:49.315321+0000","last_undegraded":"2023-08-18T20:44:49.315321+0000","last_fullsized":"2023-08-18T20:44:49.315321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:32.719211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078459+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:49.078459+0000","last_peered":"2023-08-18T20:44:49.078459+0000","last_clean":"2023-08-18T20:44:49.078459+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:49.078459+0000","last_undegraded":"2023-08-18T20:44:49.078459+0000","last_fullsized":"2023-08-18T20:44:49.078459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:36:14.190785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078152+0000","last_change":"2023-08-18T20:44:47.085956+0000","last_active":"2023-08-18T20:44:49.078152+0000","last_peered":"2023-08-18T20:44:49.078152+0000","last_clean":"2023-08-18T20:44:49.078152+0000","last_became_active":"2023-08-18T20:44:47.085671+0000","last_became_peered":"2023-08-18T20:44:47.085671+0000","last_unstale":"2023-08-18T20:44:49.078152+0000","last_undegraded":"2023-08-18T20:44:49.078152+0000","last_fullsized":"2023-08-18T20:44:49.078152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:10:03.501595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568501+0000","last_change":"2023-08-18T20:44:48.087889+0000","last_active":"2023-08-18T20:44:49.568501+0000","last_peered":"2023-08-18T20:44:49.568501+0000","last_clean":"2023-08-18T20:44:49.568501+0000","last_became_active":"2023-08-18T20:44:48.087509+0000","last_became_peered":"2023-08-18T20:44:48.087509+0000","last_unstale":"2023-08-18T20:44:49.568501+0000","last_undegraded":"2023-08-18T20:44:49.568501+0000","last_fullsized":"2023-08-18T20:44:49.568501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:32.231834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567865+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:49.567865+0000","last_peered":"2023-08-18T20:44:49.567865+0000","last_clean":"2023-08-18T20:44:49.567865+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:49.567865+0000","last_undegraded":"2023-08-18T20:44:49.567865+0000","last_fullsized":"2023-08-18T20:44:49.567865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:35.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568714+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:49.568714+0000","last_peered":"2023-08-18T20:44:49.568714+0000","last_clean":"2023-08-18T20:44:49.568714+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:49.568714+0000","last_undegraded":"2023-08-18T20:44:49.568714+0000","last_fullsized":"2023-08-18T20:44:49.568714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:27.742245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570612+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:49.570612+0000","last_peered":"2023-08-18T20:44:49.570612+0000","last_clean":"2023-08-18T20:44:49.570612+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:49.570612+0000","last_undegraded":"2023-08-18T20:44:49.570612+0000","last_fullsized":"2023-08-18T20:44:49.570612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:48.233232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315571+0000","last_change":"2023-08-18T20:44:47.085151+0000","last_active":"2023-08-18T20:44:49.315571+0000","last_peered":"2023-08-18T20:44:49.315571+0000","last_clean":"2023-08-18T20:44:49.315571+0000","last_became_active":"2023-08-18T20:44:47.084748+0000","last_became_peered":"2023-08-18T20:44:47.084748+0000","last_unstale":"2023-08-18T20:44:49.315571+0000","last_undegraded":"2023-08-18T20:44:49.315571+0000","last_fullsized":"2023-08-18T20:44:49.315571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:51.075569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078006+0000","last_change":"2023-08-18T20:44:48.078855+0000","last_active":"2023-08-18T20:44:49.078006+0000","last_peered":"2023-08-18T20:44:49.078006+0000","last_clean":"2023-08-18T20:44:49.078006+0000","last_became_active":"2023-08-18T20:44:48.078596+0000","last_became_peered":"2023-08-18T20:44:48.078596+0000","last_unstale":"2023-08-18T20:44:49.078006+0000","last_undegraded":"2023-08-18T20:44:49.078006+0000","last_fullsized":"2023-08-18T20:44:49.078006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:27.183029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568461+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:49.568461+0000","last_peered":"2023-08-18T20:44:49.568461+0000","last_clean":"2023-08-18T20:44:49.568461+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:49.568461+0000","last_undegraded":"2023-08-18T20:44:49.568461+0000","last_fullsized":"2023-08-18T20:44:49.568461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:29:11.979763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"33'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081341+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:49.081341+0000","last_peered":"2023-08-18T20:44:49.081341+0000","last_clean":"2023-08-18T20:44:49.081341+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:49.081341+0000","last_undegraded":"2023-08-18T20:44:49.081341+0000","last_fullsized":"2023-08-18T20:44:49.081341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:30.681795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568296+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:49.568296+0000","last_peered":"2023-08-18T20:44:49.568296+0000","last_clean":"2023-08-18T20:44:49.568296+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:49.568296+0000","last_undegraded":"2023-08-18T20:44:49.568296+0000","last_fullsized":"2023-08-18T20:44:49.568296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:22:26.793949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314974+0000","last_change":"2023-08-18T20:44:47.079935+0000","last_active":"2023-08-18T20:44:49.314974+0000","last_peered":"2023-08-18T20:44:49.314974+0000","last_clean":"2023-08-18T20:44:49.314974+0000","last_became_active":"2023-08-18T20:44:47.079311+0000","last_became_peered":"2023-08-18T20:44:47.079311+0000","last_unstale":"2023-08-18T20:44:49.314974+0000","last_undegraded":"2023-08-18T20:44:49.314974+0000","last_fullsized":"2023-08-18T20:44:49.314974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:49:25.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078786+0000","last_change":"2023-08-18T20:44:48.087549+0000","last_active":"2023-08-18T20:44:49.078786+0000","last_peered":"2023-08-18T20:44:49.078786+0000","last_clean":"2023-08-18T20:44:49.078786+0000","last_became_active":"2023-08-18T20:44:48.087284+0000","last_became_peered":"2023-08-18T20:44:48.087284+0000","last_unstale":"2023-08-18T20:44:49.078786+0000","last_undegraded":"2023-08-18T20:44:49.078786+0000","last_fullsized":"2023-08-18T20:44:49.078786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:47:30.036901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567733+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:49.567733+0000","last_peered":"2023-08-18T20:44:49.567733+0000","last_clean":"2023-08-18T20:44:49.567733+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:49.567733+0000","last_undegraded":"2023-08-18T20:44:49.567733+0000","last_fullsized":"2023-08-18T20:44:49.567733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:56.026416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567547+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:49.567547+0000","last_peered":"2023-08-18T20:44:49.567547+0000","last_clean":"2023-08-18T20:44:49.567547+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:49.567547+0000","last_undegraded":"2023-08-18T20:44:49.567547+0000","last_fullsized":"2023-08-18T20:44:49.567547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:54.989674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570433+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:49.570433+0000","last_peered":"2023-08-18T20:44:49.570433+0000","last_clean":"2023-08-18T20:44:49.570433+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:49.570433+0000","last_undegraded":"2023-08-18T20:44:49.570433+0000","last_fullsized":"2023-08-18T20:44:49.570433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:24.732218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567340+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:49.567340+0000","last_peered":"2023-08-18T20:44:49.567340+0000","last_clean":"2023-08-18T20:44:49.567340+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:49.567340+0000","last_undegraded":"2023-08-18T20:44:49.567340+0000","last_fullsized":"2023-08-18T20:44:49.567340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:50:52.846958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569916+0000","last_change":"2023-08-18T20:44:47.075209+0000","last_active":"2023-08-18T20:44:49.569916+0000","last_peered":"2023-08-18T20:44:49.569916+0000","last_clean":"2023-08-18T20:44:49.569916+0000","last_became_active":"2023-08-18T20:44:47.074924+0000","last_became_peered":"2023-08-18T20:44:47.074924+0000","last_unstale":"2023-08-18T20:44:49.569916+0000","last_undegraded":"2023-08-18T20:44:49.569916+0000","last_fullsized":"2023-08-18T20:44:49.569916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:07.851397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567594+0000","last_change":"2023-08-18T20:44:48.097341+0000","last_active":"2023-08-18T20:44:49.567594+0000","last_peered":"2023-08-18T20:44:49.567594+0000","last_clean":"2023-08-18T20:44:49.567594+0000","last_became_active":"2023-08-18T20:44:48.097016+0000","last_became_peered":"2023-08-18T20:44:48.097016+0000","last_unstale":"2023-08-18T20:44:49.567594+0000","last_undegraded":"2023-08-18T20:44:49.567594+0000","last_fullsized":"2023-08-18T20:44:49.567594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:24.393465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078273+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:49.078273+0000","last_peered":"2023-08-18T20:44:49.078273+0000","last_clean":"2023-08-18T20:44:49.078273+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:49.078273+0000","last_undegraded":"2023-08-18T20:44:49.078273+0000","last_fullsized":"2023-08-18T20:44:49.078273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:21:31.333158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078273+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:49.078273+0000","last_peered":"2023-08-18T20:44:49.078273+0000","last_clean":"2023-08-18T20:44:49.078273+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:49.078273+0000","last_undegraded":"2023-08-18T20:44:49.078273+0000","last_fullsized":"2023-08-18T20:44:49.078273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:46.507690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569477+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:49.569477+0000","last_peered":"2023-08-18T20:44:49.569477+0000","last_clean":"2023-08-18T20:44:49.569477+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:49.569477+0000","last_undegraded":"2023-08-18T20:44:49.569477+0000","last_fullsized":"2023-08-18T20:44:49.569477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:59:47.910919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078725+0000","last_change":"2023-08-18T20:44:47.070129+0000","last_active":"2023-08-18T20:44:49.078725+0000","last_peered":"2023-08-18T20:44:49.078725+0000","last_clean":"2023-08-18T20:44:49.078725+0000","last_became_active":"2023-08-18T20:44:47.069866+0000","last_became_peered":"2023-08-18T20:44:47.069866+0000","last_unstale":"2023-08-18T20:44:49.078725+0000","last_undegraded":"2023-08-18T20:44:49.078725+0000","last_fullsized":"2023-08-18T20:44:49.078725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:02.357199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570259+0000","last_change":"2023-08-18T20:44:48.087114+0000","last_active":"2023-08-18T20:44:49.570259+0000","last_peered":"2023-08-18T20:44:49.570259+0000","last_clean":"2023-08-18T20:44:49.570259+0000","last_became_active":"2023-08-18T20:44:48.086878+0000","last_became_peered":"2023-08-18T20:44:48.086878+0000","last_unstale":"2023-08-18T20:44:49.570259+0000","last_undegraded":"2023-08-18T20:44:49.570259+0000","last_fullsized":"2023-08-18T20:44:49.570259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:49:02.967283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568376+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:49.568376+0000","last_peered":"2023-08-18T20:44:49.568376+0000","last_clean":"2023-08-18T20:44:49.568376+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:49.568376+0000","last_undegraded":"2023-08-18T20:44:49.568376+0000","last_fullsized":"2023-08-18T20:44:49.568376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:03:22.692301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568012+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:49.568012+0000","last_peered":"2023-08-18T20:44:49.568012+0000","last_clean":"2023-08-18T20:44:49.568012+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:49.568012+0000","last_undegraded":"2023-08-18T20:44:49.568012+0000","last_fullsized":"2023-08-18T20:44:49.568012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:39:26.482882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569327+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:49.569327+0000","last_peered":"2023-08-18T20:44:49.569327+0000","last_clean":"2023-08-18T20:44:49.569327+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:49.569327+0000","last_undegraded":"2023-08-18T20:44:49.569327+0000","last_fullsized":"2023-08-18T20:44:49.569327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:41:59.920334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078663+0000","last_change":"2023-08-18T20:44:47.078285+0000","last_active":"2023-08-18T20:44:49.078663+0000","last_peered":"2023-08-18T20:44:49.078663+0000","last_clean":"2023-08-18T20:44:49.078663+0000","last_became_active":"2023-08-18T20:44:47.078018+0000","last_became_peered":"2023-08-18T20:44:47.078018+0000","last_unstale":"2023-08-18T20:44:49.078663+0000","last_undegraded":"2023-08-18T20:44:49.078663+0000","last_fullsized":"2023-08-18T20:44:49.078663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:47:48.203761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314856+0000","last_change":"2023-08-18T20:44:48.090556+0000","last_active":"2023-08-18T20:44:49.314856+0000","last_peered":"2023-08-18T20:44:49.314856+0000","last_clean":"2023-08-18T20:44:49.314856+0000","last_became_active":"2023-08-18T20:44:48.090249+0000","last_became_peered":"2023-08-18T20:44:48.090249+0000","last_unstale":"2023-08-18T20:44:49.314856+0000","last_undegraded":"2023-08-18T20:44:49.314856+0000","last_fullsized":"2023-08-18T20:44:49.314856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079070+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:49.079070+0000","last_peered":"2023-08-18T20:44:49.079070+0000","last_clean":"2023-08-18T20:44:49.079070+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:49.079070+0000","last_undegraded":"2023-08-18T20:44:49.079070+0000","last_fullsized":"2023-08-18T20:44:49.079070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:13:38.138152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078220+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:49.078220+0000","last_peered":"2023-08-18T20:44:49.078220+0000","last_clean":"2023-08-18T20:44:49.078220+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:49.078220+0000","last_undegraded":"2023-08-18T20:44:49.078220+0000","last_fullsized":"2023-08-18T20:44:49.078220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:38.434404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077975+0000","last_change":"2023-08-18T20:44:47.075080+0000","last_active":"2023-08-18T20:44:49.077975+0000","last_peered":"2023-08-18T20:44:49.077975+0000","last_clean":"2023-08-18T20:44:49.077975+0000","last_became_active":"2023-08-18T20:44:47.074818+0000","last_became_peered":"2023-08-18T20:44:47.074818+0000","last_unstale":"2023-08-18T20:44:49.077975+0000","last_undegraded":"2023-08-18T20:44:49.077975+0000","last_fullsized":"2023-08-18T20:44:49.077975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:44.105600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077608+0000","last_change":"2023-08-18T20:44:48.082195+0000","last_active":"2023-08-18T20:44:49.077608+0000","last_peered":"2023-08-18T20:44:49.077608+0000","last_clean":"2023-08-18T20:44:49.077608+0000","last_became_active":"2023-08-18T20:44:48.081945+0000","last_became_peered":"2023-08-18T20:44:48.081945+0000","last_unstale":"2023-08-18T20:44:49.077608+0000","last_undegraded":"2023-08-18T20:44:49.077608+0000","last_fullsized":"2023-08-18T20:44:49.077608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:57:22.812695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568476+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:49.568476+0000","last_peered":"2023-08-18T20:44:49.568476+0000","last_clean":"2023-08-18T20:44:49.568476+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:49.568476+0000","last_undegraded":"2023-08-18T20:44:49.568476+0000","last_fullsized":"2023-08-18T20:44:49.568476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:29.905031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570062+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:49.570062+0000","last_peered":"2023-08-18T20:44:49.570062+0000","last_clean":"2023-08-18T20:44:49.570062+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:49.570062+0000","last_undegraded":"2023-08-18T20:44:49.570062+0000","last_fullsized":"2023-08-18T20:44:49.570062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:53.058978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567281+0000","last_change":"2023-08-18T20:44:47.079755+0000","last_active":"2023-08-18T20:44:49.567281+0000","last_peered":"2023-08-18T20:44:49.567281+0000","last_clean":"2023-08-18T20:44:49.567281+0000","last_became_active":"2023-08-18T20:44:47.079475+0000","last_became_peered":"2023-08-18T20:44:47.079475+0000","last_unstale":"2023-08-18T20:44:49.567281+0000","last_undegraded":"2023-08-18T20:44:49.567281+0000","last_fullsized":"2023-08-18T20:44:49.567281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:57:21.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569281+0000","last_change":"2023-08-18T20:44:48.082719+0000","last_active":"2023-08-18T20:44:49.569281+0000","last_peered":"2023-08-18T20:44:49.569281+0000","last_clean":"2023-08-18T20:44:49.569281+0000","last_became_active":"2023-08-18T20:44:48.082386+0000","last_became_peered":"2023-08-18T20:44:48.082386+0000","last_unstale":"2023-08-18T20:44:49.569281+0000","last_undegraded":"2023-08-18T20:44:49.569281+0000","last_fullsized":"2023-08-18T20:44:49.569281+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080109+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:49.080109+0000","last_peered":"2023-08-18T20:44:49.080109+0000","last_clean":"2023-08-18T20:44:49.080109+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:49.080109+0000","last_undegraded":"2023-08-18T20:44:49.080109+0000","last_fullsized":"2023-08-18T20:44:49.080109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:55:53.475950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314695+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:49.314695+0000","last_peered":"2023-08-18T20:44:49.314695+0000","last_clean":"2023-08-18T20:44:49.314695+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:49.314695+0000","last_undegraded":"2023-08-18T20:44:49.314695+0000","last_fullsized":"2023-08-18T20:44:49.314695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:57:39.626842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079461+0000","last_change":"2023-08-18T20:44:47.075035+0000","last_active":"2023-08-18T20:44:49.079461+0000","last_peered":"2023-08-18T20:44:49.079461+0000","last_clean":"2023-08-18T20:44:49.079461+0000","last_became_active":"2023-08-18T20:44:47.074771+0000","last_became_peered":"2023-08-18T20:44:47.074771+0000","last_unstale":"2023-08-18T20:44:49.079461+0000","last_undegraded":"2023-08-18T20:44:49.079461+0000","last_fullsized":"2023-08-18T20:44:49.079461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:33:23.520359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567799+0000","last_change":"2023-08-18T20:44:48.087687+0000","last_active":"2023-08-18T20:44:49.567799+0000","last_peered":"2023-08-18T20:44:49.567799+0000","last_clean":"2023-08-18T20:44:49.567799+0000","last_became_active":"2023-08-18T20:44:48.087435+0000","last_became_peered":"2023-08-18T20:44:48.087435+0000","last_unstale":"2023-08-18T20:44:49.567799+0000","last_undegraded":"2023-08-18T20:44:49.567799+0000","last_fullsized":"2023-08-18T20:44:49.567799+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080203+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:49.080203+0000","last_peered":"2023-08-18T20:44:49.080203+0000","last_clean":"2023-08-18T20:44:49.080203+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:49.080203+0000","last_undegraded":"2023-08-18T20:44:49.080203+0000","last_fullsized":"2023-08-18T20:44:49.080203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:12:21.656026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568012+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:49.568012+0000","last_peered":"2023-08-18T20:44:49.568012+0000","last_clean":"2023-08-18T20:44:49.568012+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:49.568012+0000","last_undegraded":"2023-08-18T20:44:49.568012+0000","last_fullsized":"2023-08-18T20:44:49.568012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:17:10.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314605+0000","last_change":"2023-08-18T20:44:47.085380+0000","last_active":"2023-08-18T20:44:49.314605+0000","last_peered":"2023-08-18T20:44:49.314605+0000","last_clean":"2023-08-18T20:44:49.314605+0000","last_became_active":"2023-08-18T20:44:47.084974+0000","last_became_peered":"2023-08-18T20:44:47.084974+0000","last_unstale":"2023-08-18T20:44:49.314605+0000","last_undegraded":"2023-08-18T20:44:49.314605+0000","last_fullsized":"2023-08-18T20:44:49.314605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:20.705015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315433+0000","last_change":"2023-08-18T20:44:48.081010+0000","last_active":"2023-08-18T20:44:49.315433+0000","last_peered":"2023-08-18T20:44:49.315433+0000","last_clean":"2023-08-18T20:44:49.315433+0000","last_became_active":"2023-08-18T20:44:48.080662+0000","last_became_peered":"2023-08-18T20:44:48.080662+0000","last_unstale":"2023-08-18T20:44:49.315433+0000","last_undegraded":"2023-08-18T20:44:49.315433+0000","last_fullsized":"2023-08-18T20:44:49.315433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:13:56.473474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567363+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:49.567363+0000","last_peered":"2023-08-18T20:44:49.567363+0000","last_clean":"2023-08-18T20:44:49.567363+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:49.567363+0000","last_undegraded":"2023-08-18T20:44:49.567363+0000","last_fullsized":"2023-08-18T20:44:49.567363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:26.719601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081427+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:49.081427+0000","last_peered":"2023-08-18T20:44:49.081427+0000","last_clean":"2023-08-18T20:44:49.081427+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:49.081427+0000","last_undegraded":"2023-08-18T20:44:49.081427+0000","last_fullsized":"2023-08-18T20:44:49.081427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:55:44.107172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081292+0000","last_change":"2023-08-18T20:44:47.080082+0000","last_active":"2023-08-18T20:44:49.081292+0000","last_peered":"2023-08-18T20:44:49.081292+0000","last_clean":"2023-08-18T20:44:49.081292+0000","last_became_active":"2023-08-18T20:44:47.079820+0000","last_became_peered":"2023-08-18T20:44:47.079820+0000","last_unstale":"2023-08-18T20:44:49.081292+0000","last_undegraded":"2023-08-18T20:44:49.081292+0000","last_fullsized":"2023-08-18T20:44:49.081292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:45:32.395157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567093+0000","last_change":"2023-08-18T20:44:48.089995+0000","last_active":"2023-08-18T20:44:49.567093+0000","last_peered":"2023-08-18T20:44:49.567093+0000","last_clean":"2023-08-18T20:44:49.567093+0000","last_became_active":"2023-08-18T20:44:48.089682+0000","last_became_peered":"2023-08-18T20:44:48.089682+0000","last_unstale":"2023-08-18T20:44:49.567093+0000","last_undegraded":"2023-08-18T20:44:49.567093+0000","last_fullsized":"2023-08-18T20:44:49.567093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:10:28.195656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080707+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:49.080707+0000","last_peered":"2023-08-18T20:44:49.080707+0000","last_clean":"2023-08-18T20:44:49.080707+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:49.080707+0000","last_undegraded":"2023-08-18T20:44:49.080707+0000","last_fullsized":"2023-08-18T20:44:49.080707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:22.996680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568736+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:49.568736+0000","last_peered":"2023-08-18T20:44:49.568736+0000","last_clean":"2023-08-18T20:44:49.568736+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:49.568736+0000","last_undegraded":"2023-08-18T20:44:49.568736+0000","last_fullsized":"2023-08-18T20:44:49.568736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:29:35.606097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315615+0000","last_change":"2023-08-18T20:44:47.085149+0000","last_active":"2023-08-18T20:44:49.315615+0000","last_peered":"2023-08-18T20:44:49.315615+0000","last_clean":"2023-08-18T20:44:49.315615+0000","last_became_active":"2023-08-18T20:44:47.084745+0000","last_became_peered":"2023-08-18T20:44:47.084745+0000","last_unstale":"2023-08-18T20:44:49.315615+0000","last_undegraded":"2023-08-18T20:44:49.315615+0000","last_fullsized":"2023-08-18T20:44:49.315615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:43:01.487731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078850+0000","last_change":"2023-08-18T20:44:48.082724+0000","last_active":"2023-08-18T20:44:49.078850+0000","last_peered":"2023-08-18T20:44:49.078850+0000","last_clean":"2023-08-18T20:44:49.078850+0000","last_became_active":"2023-08-18T20:44:48.082284+0000","last_became_peered":"2023-08-18T20:44:48.082284+0000","last_unstale":"2023-08-18T20:44:49.078850+0000","last_undegraded":"2023-08-18T20:44:49.078850+0000","last_fullsized":"2023-08-18T20:44:49.078850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:00:01.967814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568479+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:49.568479+0000","last_peered":"2023-08-18T20:44:49.568479+0000","last_clean":"2023-08-18T20:44:49.568479+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:49.568479+0000","last_undegraded":"2023-08-18T20:44:49.568479+0000","last_fullsized":"2023-08-18T20:44:49.568479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:52.053973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570115+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:49.570115+0000","last_peered":"2023-08-18T20:44:49.570115+0000","last_clean":"2023-08-18T20:44:49.570115+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:49.570115+0000","last_undegraded":"2023-08-18T20:44:49.570115+0000","last_fullsized":"2023-08-18T20:44:49.570115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:59.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078748+0000","last_change":"2023-08-18T20:44:47.081221+0000","last_active":"2023-08-18T20:44:49.078748+0000","last_peered":"2023-08-18T20:44:49.078748+0000","last_clean":"2023-08-18T20:44:49.078748+0000","last_became_active":"2023-08-18T20:44:47.080932+0000","last_became_peered":"2023-08-18T20:44:47.080932+0000","last_unstale":"2023-08-18T20:44:49.078748+0000","last_undegraded":"2023-08-18T20:44:49.078748+0000","last_fullsized":"2023-08-18T20:44:49.078748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:55:25.362311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567292+0000","last_change":"2023-08-18T20:44:48.074356+0000","last_active":"2023-08-18T20:44:49.567292+0000","last_peered":"2023-08-18T20:44:49.567292+0000","last_clean":"2023-08-18T20:44:49.567292+0000","last_became_active":"2023-08-18T20:44:48.074087+0000","last_became_peered":"2023-08-18T20:44:48.074087+0000","last_unstale":"2023-08-18T20:44:49.567292+0000","last_undegraded":"2023-08-18T20:44:49.567292+0000","last_fullsized":"2023-08-18T20:44:49.567292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:57:27.612365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570553+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:49.570553+0000","last_peered":"2023-08-18T20:44:49.570553+0000","last_clean":"2023-08-18T20:44:49.570553+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:49.570553+0000","last_undegraded":"2023-08-18T20:44:49.570553+0000","last_fullsized":"2023-08-18T20:44:49.570553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:17:47.436741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079176+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:49.079176+0000","last_peered":"2023-08-18T20:44:49.079176+0000","last_clean":"2023-08-18T20:44:49.079176+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:49.079176+0000","last_undegraded":"2023-08-18T20:44:49.079176+0000","last_fullsized":"2023-08-18T20:44:49.079176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:04:27.817885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077780+0000","last_change":"2023-08-18T20:44:47.085143+0000","last_active":"2023-08-18T20:44:49.077780+0000","last_peered":"2023-08-18T20:44:49.077780+0000","last_clean":"2023-08-18T20:44:49.077780+0000","last_became_active":"2023-08-18T20:44:47.084826+0000","last_became_peered":"2023-08-18T20:44:47.084826+0000","last_unstale":"2023-08-18T20:44:49.077780+0000","last_undegraded":"2023-08-18T20:44:49.077780+0000","last_fullsized":"2023-08-18T20:44:49.077780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:05.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568191+0000","last_change":"2023-08-18T20:44:48.090848+0000","last_active":"2023-08-18T20:44:49.568191+0000","last_peered":"2023-08-18T20:44:49.568191+0000","last_clean":"2023-08-18T20:44:49.568191+0000","last_became_active":"2023-08-18T20:44:48.090264+0000","last_became_peered":"2023-08-18T20:44:48.090264+0000","last_unstale":"2023-08-18T20:44:49.568191+0000","last_undegraded":"2023-08-18T20:44:49.568191+0000","last_fullsized":"2023-08-18T20:44:49.568191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:52.081333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315246+0000","last_change":"2023-08-18T20:44:48.095390+0000","last_active":"2023-08-18T20:44:49.315246+0000","last_peered":"2023-08-18T20:44:49.315246+0000","last_clean":"2023-08-18T20:44:49.315246+0000","last_became_active":"2023-08-18T20:44:48.095072+0000","last_became_peered":"2023-08-18T20:44:48.095072+0000","last_unstale":"2023-08-18T20:44:49.315246+0000","last_undegraded":"2023-08-18T20:44:49.315246+0000","last_fullsized":"2023-08-18T20:44:49.315246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:06.639831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567993+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:49.567993+0000","last_peered":"2023-08-18T20:44:49.567993+0000","last_clean":"2023-08-18T20:44:49.567993+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:49.567993+0000","last_undegraded":"2023-08-18T20:44:49.567993+0000","last_fullsized":"2023-08-18T20:44:49.567993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079732+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:49.079732+0000","last_peered":"2023-08-18T20:44:49.079732+0000","last_clean":"2023-08-18T20:44:49.079732+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:49.079732+0000","last_undegraded":"2023-08-18T20:44:49.079732+0000","last_fullsized":"2023-08-18T20:44:49.079732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:40:54.800266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078741+0000","last_change":"2023-08-18T20:44:47.085267+0000","last_active":"2023-08-18T20:44:49.078741+0000","last_peered":"2023-08-18T20:44:49.078741+0000","last_clean":"2023-08-18T20:44:49.078741+0000","last_became_active":"2023-08-18T20:44:47.084983+0000","last_became_peered":"2023-08-18T20:44:47.084983+0000","last_unstale":"2023-08-18T20:44:49.078741+0000","last_undegraded":"2023-08-18T20:44:49.078741+0000","last_fullsized":"2023-08-18T20:44:49.078741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:00.342428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077473+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:49.077473+0000","last_peered":"2023-08-18T20:44:49.077473+0000","last_clean":"2023-08-18T20:44:49.077473+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:49.077473+0000","last_undegraded":"2023-08-18T20:44:49.077473+0000","last_fullsized":"2023-08-18T20:44:49.077473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:40:10.634354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568258+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:49.568258+0000","last_peered":"2023-08-18T20:44:49.568258+0000","last_clean":"2023-08-18T20:44:49.568258+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:49.568258+0000","last_undegraded":"2023-08-18T20:44:49.568258+0000","last_fullsized":"2023-08-18T20:44:49.568258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:21:09.746484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315096+0000","last_change":"2023-08-18T20:44:47.082756+0000","last_active":"2023-08-18T20:44:49.315096+0000","last_peered":"2023-08-18T20:44:49.315096+0000","last_clean":"2023-08-18T20:44:49.315096+0000","last_became_active":"2023-08-18T20:44:47.082215+0000","last_became_peered":"2023-08-18T20:44:47.082215+0000","last_unstale":"2023-08-18T20:44:49.315096+0000","last_undegraded":"2023-08-18T20:44:49.315096+0000","last_fullsized":"2023-08-18T20:44:49.315096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:35.048626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568688+0000","last_change":"2023-08-18T20:44:48.085105+0000","last_active":"2023-08-18T20:44:49.568688+0000","last_peered":"2023-08-18T20:44:49.568688+0000","last_clean":"2023-08-18T20:44:49.568688+0000","last_became_active":"2023-08-18T20:44:48.084470+0000","last_became_peered":"2023-08-18T20:44:48.084470+0000","last_unstale":"2023-08-18T20:44:49.568688+0000","last_undegraded":"2023-08-18T20:44:49.568688+0000","last_fullsized":"2023-08-18T20:44:49.568688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:16.936791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315767+0000","last_change":"2023-08-18T20:44:48.081649+0000","last_active":"2023-08-18T20:44:49.315767+0000","last_peered":"2023-08-18T20:44:49.315767+0000","last_clean":"2023-08-18T20:44:49.315767+0000","last_became_active":"2023-08-18T20:44:48.081451+0000","last_became_peered":"2023-08-18T20:44:48.081451+0000","last_unstale":"2023-08-18T20:44:49.315767+0000","last_undegraded":"2023-08-18T20:44:49.315767+0000","last_fullsized":"2023-08-18T20:44:49.315767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:32.209987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567503+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:49.567503+0000","last_peered":"2023-08-18T20:44:49.567503+0000","last_clean":"2023-08-18T20:44:49.567503+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:49.567503+0000","last_undegraded":"2023-08-18T20:44:49.567503+0000","last_fullsized":"2023-08-18T20:44:49.567503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:06.648878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077837+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:49.077837+0000","last_peered":"2023-08-18T20:44:49.077837+0000","last_clean":"2023-08-18T20:44:49.077837+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:49.077837+0000","last_undegraded":"2023-08-18T20:44:49.077837+0000","last_fullsized":"2023-08-18T20:44:49.077837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:42:22.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078601+0000","last_change":"2023-08-18T20:44:47.075736+0000","last_active":"2023-08-18T20:44:49.078601+0000","last_peered":"2023-08-18T20:44:49.078601+0000","last_clean":"2023-08-18T20:44:49.078601+0000","last_became_active":"2023-08-18T20:44:47.074145+0000","last_became_peered":"2023-08-18T20:44:47.074145+0000","last_unstale":"2023-08-18T20:44:49.078601+0000","last_undegraded":"2023-08-18T20:44:49.078601+0000","last_fullsized":"2023-08-18T20:44:49.078601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:41.798382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079087+0000","last_change":"2023-08-18T20:44:48.086355+0000","last_active":"2023-08-18T20:44:49.079087+0000","last_peered":"2023-08-18T20:44:49.079087+0000","last_clean":"2023-08-18T20:44:49.079087+0000","last_became_active":"2023-08-18T20:44:48.086053+0000","last_became_peered":"2023-08-18T20:44:48.086053+0000","last_unstale":"2023-08-18T20:44:49.079087+0000","last_undegraded":"2023-08-18T20:44:49.079087+0000","last_fullsized":"2023-08-18T20:44:49.079087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:36.514048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077949+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:49.077949+0000","last_peered":"2023-08-18T20:44:49.077949+0000","last_clean":"2023-08-18T20:44:49.077949+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:49.077949+0000","last_undegraded":"2023-08-18T20:44:49.077949+0000","last_fullsized":"2023-08-18T20:44:49.077949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314504+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:49.314504+0000","last_peered":"2023-08-18T20:44:49.314504+0000","last_clean":"2023-08-18T20:44:49.314504+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:49.314504+0000","last_undegraded":"2023-08-18T20:44:49.314504+0000","last_fullsized":"2023-08-18T20:44:49.314504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:13.126133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568845+0000","last_change":"2023-08-18T20:44:47.083159+0000","last_active":"2023-08-18T20:44:49.568845+0000","last_peered":"2023-08-18T20:44:49.568845+0000","last_clean":"2023-08-18T20:44:49.568845+0000","last_became_active":"2023-08-18T20:44:47.082845+0000","last_became_peered":"2023-08-18T20:44:47.082845+0000","last_unstale":"2023-08-18T20:44:49.568845+0000","last_undegraded":"2023-08-18T20:44:49.568845+0000","last_fullsized":"2023-08-18T20:44:49.568845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:47:48.203761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"33'9","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079368+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:49.079368+0000","last_peered":"2023-08-18T20:44:49.079368+0000","last_clean":"2023-08-18T20:44:49.079368+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:49.079368+0000","last_undegraded":"2023-08-18T20:44:49.079368+0000","last_fullsized":"2023-08-18T20:44:49.079368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:28.953739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568792+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:49.568792+0000","last_peered":"2023-08-18T20:44:49.568792+0000","last_clean":"2023-08-18T20:44:49.568792+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:49.568792+0000","last_undegraded":"2023-08-18T20:44:49.568792+0000","last_fullsized":"2023-08-18T20:44:49.568792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:59.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568905+0000","last_change":"2023-08-18T20:44:47.085732+0000","last_active":"2023-08-18T20:44:49.568905+0000","last_peered":"2023-08-18T20:44:49.568905+0000","last_clean":"2023-08-18T20:44:49.568905+0000","last_became_active":"2023-08-18T20:44:47.085433+0000","last_became_peered":"2023-08-18T20:44:47.085433+0000","last_unstale":"2023-08-18T20:44:49.568905+0000","last_undegraded":"2023-08-18T20:44:49.568905+0000","last_fullsized":"2023-08-18T20:44:49.568905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:39:28.226476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570026+0000","last_change":"2023-08-18T20:44:48.082524+0000","last_active":"2023-08-18T20:44:49.570026+0000","last_peered":"2023-08-18T20:44:49.570026+0000","last_clean":"2023-08-18T20:44:49.570026+0000","last_became_active":"2023-08-18T20:44:48.082189+0000","last_became_peered":"2023-08-18T20:44:48.082189+0000","last_unstale":"2023-08-18T20:44:49.570026+0000","last_undegraded":"2023-08-18T20:44:49.570026+0000","last_fullsized":"2023-08-18T20:44:49.570026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:43:02.493496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570385+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:49.570385+0000","last_peered":"2023-08-18T20:44:49.570385+0000","last_clean":"2023-08-18T20:44:49.570385+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:49.570385+0000","last_undegraded":"2023-08-18T20:44:49.570385+0000","last_fullsized":"2023-08-18T20:44:49.570385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:38:18.627807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315482+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:49.315482+0000","last_peered":"2023-08-18T20:44:49.315482+0000","last_clean":"2023-08-18T20:44:49.315482+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:49.315482+0000","last_undegraded":"2023-08-18T20:44:49.315482+0000","last_fullsized":"2023-08-18T20:44:49.315482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:02.879896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569513+0000","last_change":"2023-08-18T20:44:47.079918+0000","last_active":"2023-08-18T20:44:49.569513+0000","last_peered":"2023-08-18T20:44:49.569513+0000","last_clean":"2023-08-18T20:44:49.569513+0000","last_became_active":"2023-08-18T20:44:47.079619+0000","last_became_peered":"2023-08-18T20:44:47.079619+0000","last_unstale":"2023-08-18T20:44:49.569513+0000","last_undegraded":"2023-08-18T20:44:49.569513+0000","last_fullsized":"2023-08-18T20:44:49.569513+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:32.445444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567565+0000","last_change":"2023-08-18T20:44:48.091462+0000","last_active":"2023-08-18T20:44:49.567565+0000","last_peered":"2023-08-18T20:44:49.567565+0000","last_clean":"2023-08-18T20:44:49.567565+0000","last_became_active":"2023-08-18T20:44:48.091137+0000","last_became_peered":"2023-08-18T20:44:48.091137+0000","last_unstale":"2023-08-18T20:44:49.567565+0000","last_undegraded":"2023-08-18T20:44:49.567565+0000","last_fullsized":"2023-08-18T20:44:49.567565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:13:56.473474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568801+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:49.568801+0000","last_peered":"2023-08-18T20:44:49.568801+0000","last_clean":"2023-08-18T20:44:49.568801+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:49.568801+0000","last_undegraded":"2023-08-18T20:44:49.568801+0000","last_fullsized":"2023-08-18T20:44:49.568801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:52.704427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569445+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:49.569445+0000","last_peered":"2023-08-18T20:44:49.569445+0000","last_clean":"2023-08-18T20:44:49.569445+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:49.569445+0000","last_undegraded":"2023-08-18T20:44:49.569445+0000","last_fullsized":"2023-08-18T20:44:49.569445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:47:15.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078440+0000","last_change":"2023-08-18T20:44:47.076028+0000","last_active":"2023-08-18T20:44:49.078440+0000","last_peered":"2023-08-18T20:44:49.078440+0000","last_clean":"2023-08-18T20:44:49.078440+0000","last_became_active":"2023-08-18T20:44:47.075780+0000","last_became_peered":"2023-08-18T20:44:47.075780+0000","last_unstale":"2023-08-18T20:44:49.078440+0000","last_undegraded":"2023-08-18T20:44:49.078440+0000","last_fullsized":"2023-08-18T20:44:49.078440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:32.339755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568196+0000","last_change":"2023-08-18T20:44:48.097154+0000","last_active":"2023-08-18T20:44:49.568196+0000","last_peered":"2023-08-18T20:44:49.568196+0000","last_clean":"2023-08-18T20:44:49.568196+0000","last_became_active":"2023-08-18T20:44:48.096913+0000","last_became_peered":"2023-08-18T20:44:48.096913+0000","last_unstale":"2023-08-18T20:44:49.568196+0000","last_undegraded":"2023-08-18T20:44:49.568196+0000","last_fullsized":"2023-08-18T20:44:49.568196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078670+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:49.078670+0000","last_peered":"2023-08-18T20:44:49.078670+0000","last_clean":"2023-08-18T20:44:49.078670+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:49.078670+0000","last_undegraded":"2023-08-18T20:44:49.078670+0000","last_fullsized":"2023-08-18T20:44:49.078670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:18.389307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080536+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:49.080536+0000","last_peered":"2023-08-18T20:44:49.080536+0000","last_clean":"2023-08-18T20:44:49.080536+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:49.080536+0000","last_undegraded":"2023-08-18T20:44:49.080536+0000","last_fullsized":"2023-08-18T20:44:49.080536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:30:55.131499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569669+0000","last_change":"2023-08-18T20:44:47.077497+0000","last_active":"2023-08-18T20:44:49.569669+0000","last_peered":"2023-08-18T20:44:49.569669+0000","last_clean":"2023-08-18T20:44:49.569669+0000","last_became_active":"2023-08-18T20:44:47.076902+0000","last_became_peered":"2023-08-18T20:44:47.076902+0000","last_unstale":"2023-08-18T20:44:49.569669+0000","last_undegraded":"2023-08-18T20:44:49.569669+0000","last_fullsized":"2023-08-18T20:44:49.569669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:35.508283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314863+0000","last_change":"2023-08-18T20:44:48.090548+0000","last_active":"2023-08-18T20:44:49.314863+0000","last_peered":"2023-08-18T20:44:49.314863+0000","last_clean":"2023-08-18T20:44:49.314863+0000","last_became_active":"2023-08-18T20:44:48.090221+0000","last_became_peered":"2023-08-18T20:44:48.090221+0000","last_unstale":"2023-08-18T20:44:49.314863+0000","last_undegraded":"2023-08-18T20:44:49.314863+0000","last_fullsized":"2023-08-18T20:44:49.314863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:44.567470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567675+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:49.567675+0000","last_peered":"2023-08-18T20:44:49.567675+0000","last_clean":"2023-08-18T20:44:49.567675+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:49.567675+0000","last_undegraded":"2023-08-18T20:44:49.567675+0000","last_fullsized":"2023-08-18T20:44:49.567675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:21.316899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078115+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:49.078115+0000","last_peered":"2023-08-18T20:44:49.078115+0000","last_clean":"2023-08-18T20:44:49.078115+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:49.078115+0000","last_undegraded":"2023-08-18T20:44:49.078115+0000","last_fullsized":"2023-08-18T20:44:49.078115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:17:10.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567738+0000","last_change":"2023-08-18T20:44:47.085167+0000","last_active":"2023-08-18T20:44:49.567738+0000","last_peered":"2023-08-18T20:44:49.567738+0000","last_clean":"2023-08-18T20:44:49.567738+0000","last_became_active":"2023-08-18T20:44:47.084842+0000","last_became_peered":"2023-08-18T20:44:47.084842+0000","last_unstale":"2023-08-18T20:44:49.567738+0000","last_undegraded":"2023-08-18T20:44:49.567738+0000","last_fullsized":"2023-08-18T20:44:49.567738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:19.820137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569092+0000","last_change":"2023-08-18T20:44:48.093570+0000","last_active":"2023-08-18T20:44:49.569092+0000","last_peered":"2023-08-18T20:44:49.569092+0000","last_clean":"2023-08-18T20:44:49.569092+0000","last_became_active":"2023-08-18T20:44:48.093239+0000","last_became_peered":"2023-08-18T20:44:48.093239+0000","last_unstale":"2023-08-18T20:44:49.569092+0000","last_undegraded":"2023-08-18T20:44:49.569092+0000","last_fullsized":"2023-08-18T20:44:49.569092+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:46:11.190341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567243+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:49.567243+0000","last_peered":"2023-08-18T20:44:49.567243+0000","last_clean":"2023-08-18T20:44:49.567243+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:49.567243+0000","last_undegraded":"2023-08-18T20:44:49.567243+0000","last_fullsized":"2023-08-18T20:44:49.567243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:18.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569202+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:49.569202+0000","last_peered":"2023-08-18T20:44:49.569202+0000","last_clean":"2023-08-18T20:44:49.569202+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:49.569202+0000","last_undegraded":"2023-08-18T20:44:49.569202+0000","last_fullsized":"2023-08-18T20:44:49.569202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:48:48.910388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314900+0000","last_change":"2023-08-18T20:44:47.082923+0000","last_active":"2023-08-18T20:44:49.314900+0000","last_peered":"2023-08-18T20:44:49.314900+0000","last_clean":"2023-08-18T20:44:49.314900+0000","last_became_active":"2023-08-18T20:44:47.082513+0000","last_became_peered":"2023-08-18T20:44:47.082513+0000","last_unstale":"2023-08-18T20:44:49.314900+0000","last_undegraded":"2023-08-18T20:44:49.314900+0000","last_fullsized":"2023-08-18T20:44:49.314900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:35.448224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569662+0000","last_change":"2023-08-18T20:44:48.090571+0000","last_active":"2023-08-18T20:44:49.569662+0000","last_peered":"2023-08-18T20:44:49.569662+0000","last_clean":"2023-08-18T20:44:49.569662+0000","last_became_active":"2023-08-18T20:44:48.090276+0000","last_became_peered":"2023-08-18T20:44:48.090276+0000","last_unstale":"2023-08-18T20:44:49.569662+0000","last_undegraded":"2023-08-18T20:44:49.569662+0000","last_fullsized":"2023-08-18T20:44:49.569662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:02:11.097041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568616+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:49.568616+0000","last_peered":"2023-08-18T20:44:49.568616+0000","last_clean":"2023-08-18T20:44:49.568616+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:49.568616+0000","last_undegraded":"2023-08-18T20:44:49.568616+0000","last_fullsized":"2023-08-18T20:44:49.568616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:18.283619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570303+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:49.570303+0000","last_peered":"2023-08-18T20:44:49.570303+0000","last_clean":"2023-08-18T20:44:49.570303+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:49.570303+0000","last_undegraded":"2023-08-18T20:44:49.570303+0000","last_fullsized":"2023-08-18T20:44:49.570303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:43:46.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314839+0000","last_change":"2023-08-18T20:44:47.079601+0000","last_active":"2023-08-18T20:44:49.314839+0000","last_peered":"2023-08-18T20:44:49.314839+0000","last_clean":"2023-08-18T20:44:49.314839+0000","last_became_active":"2023-08-18T20:44:47.079329+0000","last_became_peered":"2023-08-18T20:44:47.079329+0000","last_unstale":"2023-08-18T20:44:49.314839+0000","last_undegraded":"2023-08-18T20:44:49.314839+0000","last_fullsized":"2023-08-18T20:44:49.314839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:30.793580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569822+0000","last_change":"2023-08-18T20:44:48.090364+0000","last_active":"2023-08-18T20:44:49.569822+0000","last_peered":"2023-08-18T20:44:49.569822+0000","last_clean":"2023-08-18T20:44:49.569822+0000","last_became_active":"2023-08-18T20:44:48.090052+0000","last_became_peered":"2023-08-18T20:44:48.090052+0000","last_unstale":"2023-08-18T20:44:49.569822+0000","last_undegraded":"2023-08-18T20:44:49.569822+0000","last_fullsized":"2023-08-18T20:44:49.569822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:36:28.247681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570026+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:49.570026+0000","last_peered":"2023-08-18T20:44:49.570026+0000","last_clean":"2023-08-18T20:44:49.570026+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:49.570026+0000","last_undegraded":"2023-08-18T20:44:49.570026+0000","last_fullsized":"2023-08-18T20:44:49.570026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:17.148086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314699+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:49.314699+0000","last_peered":"2023-08-18T20:44:49.314699+0000","last_clean":"2023-08-18T20:44:49.314699+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:49.314699+0000","last_undegraded":"2023-08-18T20:44:49.314699+0000","last_fullsized":"2023-08-18T20:44:49.314699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:09:50.450465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077765+0000","last_change":"2023-08-18T20:44:47.082877+0000","last_active":"2023-08-18T20:44:49.077765+0000","last_peered":"2023-08-18T20:44:49.077765+0000","last_clean":"2023-08-18T20:44:49.077765+0000","last_became_active":"2023-08-18T20:44:47.082601+0000","last_became_peered":"2023-08-18T20:44:47.082601+0000","last_unstale":"2023-08-18T20:44:49.077765+0000","last_undegraded":"2023-08-18T20:44:49.077765+0000","last_fullsized":"2023-08-18T20:44:49.077765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:32.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078853+0000","last_change":"2023-08-18T20:44:48.083521+0000","last_active":"2023-08-18T20:44:49.078853+0000","last_peered":"2023-08-18T20:44:49.078853+0000","last_clean":"2023-08-18T20:44:49.078853+0000","last_became_active":"2023-08-18T20:44:48.083195+0000","last_became_peered":"2023-08-18T20:44:48.083195+0000","last_unstale":"2023-08-18T20:44:49.078853+0000","last_undegraded":"2023-08-18T20:44:49.078853+0000","last_fullsized":"2023-08-18T20:44:49.078853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:15.282862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569783+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:49.569783+0000","last_peered":"2023-08-18T20:44:49.569783+0000","last_clean":"2023-08-18T20:44:49.569783+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:49.569783+0000","last_undegraded":"2023-08-18T20:44:49.569783+0000","last_fullsized":"2023-08-18T20:44:49.569783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:43:45.418498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078424+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:49.078424+0000","last_peered":"2023-08-18T20:44:49.078424+0000","last_clean":"2023-08-18T20:44:49.078424+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:49.078424+0000","last_undegraded":"2023-08-18T20:44:49.078424+0000","last_fullsized":"2023-08-18T20:44:49.078424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:43:53.813564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567781+0000","last_change":"2023-08-18T20:44:47.075077+0000","last_active":"2023-08-18T20:44:49.567781+0000","last_peered":"2023-08-18T20:44:49.567781+0000","last_clean":"2023-08-18T20:44:49.567781+0000","last_became_active":"2023-08-18T20:44:47.074832+0000","last_became_peered":"2023-08-18T20:44:47.074832+0000","last_unstale":"2023-08-18T20:44:49.567781+0000","last_undegraded":"2023-08-18T20:44:49.567781+0000","last_fullsized":"2023-08-18T20:44:49.567781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:30.793580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570513+0000","last_change":"2023-08-18T20:44:48.084496+0000","last_active":"2023-08-18T20:44:49.570513+0000","last_peered":"2023-08-18T20:44:49.570513+0000","last_clean":"2023-08-18T20:44:49.570513+0000","last_became_active":"2023-08-18T20:44:48.084199+0000","last_became_peered":"2023-08-18T20:44:48.084199+0000","last_unstale":"2023-08-18T20:44:49.570513+0000","last_undegraded":"2023-08-18T20:44:49.570513+0000","last_fullsized":"2023-08-18T20:44:49.570513+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:24:59.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567561+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:49.567561+0000","last_peered":"2023-08-18T20:44:49.567561+0000","last_clean":"2023-08-18T20:44:49.567561+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:49.567561+0000","last_undegraded":"2023-08-18T20:44:49.567561+0000","last_fullsized":"2023-08-18T20:44:49.567561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:57:38.621836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568617+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:49.568617+0000","last_peered":"2023-08-18T20:44:49.568617+0000","last_clean":"2023-08-18T20:44:49.568617+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:49.568617+0000","last_undegraded":"2023-08-18T20:44:49.568617+0000","last_fullsized":"2023-08-18T20:44:49.568617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:25.775711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077960+0000","last_change":"2023-08-18T20:44:47.083025+0000","last_active":"2023-08-18T20:44:49.077960+0000","last_peered":"2023-08-18T20:44:49.077960+0000","last_clean":"2023-08-18T20:44:49.077960+0000","last_became_active":"2023-08-18T20:44:47.082742+0000","last_became_peered":"2023-08-18T20:44:47.082742+0000","last_unstale":"2023-08-18T20:44:49.077960+0000","last_undegraded":"2023-08-18T20:44:49.077960+0000","last_fullsized":"2023-08-18T20:44:49.077960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:40.775738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567628+0000","last_change":"2023-08-18T20:44:48.079665+0000","last_active":"2023-08-18T20:44:49.567628+0000","last_peered":"2023-08-18T20:44:49.567628+0000","last_clean":"2023-08-18T20:44:49.567628+0000","last_became_active":"2023-08-18T20:44:48.079223+0000","last_became_peered":"2023-08-18T20:44:48.079223+0000","last_unstale":"2023-08-18T20:44:49.567628+0000","last_undegraded":"2023-08-18T20:44:49.567628+0000","last_fullsized":"2023-08-18T20:44:49.567628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:42:36.504828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315437+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:49.315437+0000","last_peered":"2023-08-18T20:44:49.315437+0000","last_clean":"2023-08-18T20:44:49.315437+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:49.315437+0000","last_undegraded":"2023-08-18T20:44:49.315437+0000","last_fullsized":"2023-08-18T20:44:49.315437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567714+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:49.567714+0000","last_peered":"2023-08-18T20:44:49.567714+0000","last_clean":"2023-08-18T20:44:49.567714+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:49.567714+0000","last_undegraded":"2023-08-18T20:44:49.567714+0000","last_fullsized":"2023-08-18T20:44:49.567714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:24.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570497+0000","last_change":"2023-08-18T20:44:47.081266+0000","last_active":"2023-08-18T20:44:49.570497+0000","last_peered":"2023-08-18T20:44:49.570497+0000","last_clean":"2023-08-18T20:44:49.570497+0000","last_became_active":"2023-08-18T20:44:47.080895+0000","last_became_peered":"2023-08-18T20:44:47.080895+0000","last_unstale":"2023-08-18T20:44:49.570497+0000","last_undegraded":"2023-08-18T20:44:49.570497+0000","last_fullsized":"2023-08-18T20:44:49.570497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:12.284327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077856+0000","last_change":"2023-08-18T20:44:48.098960+0000","last_active":"2023-08-18T20:44:49.077856+0000","last_peered":"2023-08-18T20:44:49.077856+0000","last_clean":"2023-08-18T20:44:49.077856+0000","last_became_active":"2023-08-18T20:44:48.098652+0000","last_became_peered":"2023-08-18T20:44:48.098652+0000","last_unstale":"2023-08-18T20:44:49.077856+0000","last_undegraded":"2023-08-18T20:44:49.077856+0000","last_fullsized":"2023-08-18T20:44:49.077856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:41:04.757317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078502+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:49.078502+0000","last_peered":"2023-08-18T20:44:49.078502+0000","last_clean":"2023-08-18T20:44:49.078502+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:49.078502+0000","last_undegraded":"2023-08-18T20:44:49.078502+0000","last_fullsized":"2023-08-18T20:44:49.078502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:16.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568575+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:49.568575+0000","last_peered":"2023-08-18T20:44:49.568575+0000","last_clean":"2023-08-18T20:44:49.568575+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:49.568575+0000","last_undegraded":"2023-08-18T20:44:49.568575+0000","last_fullsized":"2023-08-18T20:44:49.568575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:47.512696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567842+0000","last_change":"2023-08-18T20:44:47.083043+0000","last_active":"2023-08-18T20:44:49.567842+0000","last_peered":"2023-08-18T20:44:49.567842+0000","last_clean":"2023-08-18T20:44:49.567842+0000","last_became_active":"2023-08-18T20:44:47.082748+0000","last_became_peered":"2023-08-18T20:44:47.082748+0000","last_unstale":"2023-08-18T20:44:49.567842+0000","last_undegraded":"2023-08-18T20:44:49.567842+0000","last_fullsized":"2023-08-18T20:44:49.567842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:41:05.761069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077578+0000","last_change":"2023-08-18T20:44:48.085186+0000","last_active":"2023-08-18T20:44:49.077578+0000","last_peered":"2023-08-18T20:44:49.077578+0000","last_clean":"2023-08-18T20:44:49.077578+0000","last_became_active":"2023-08-18T20:44:48.084883+0000","last_became_peered":"2023-08-18T20:44:48.084883+0000","last_unstale":"2023-08-18T20:44:49.077578+0000","last_undegraded":"2023-08-18T20:44:49.077578+0000","last_fullsized":"2023-08-18T20:44:49.077578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:55:20.099165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569747+0000","last_change":"2023-08-18T20:44:48.084442+0000","last_active":"2023-08-18T20:44:49.569747+0000","last_peered":"2023-08-18T20:44:49.569747+0000","last_clean":"2023-08-18T20:44:49.569747+0000","last_became_active":"2023-08-18T20:44:48.084131+0000","last_became_peered":"2023-08-18T20:44:48.084131+0000","last_unstale":"2023-08-18T20:44:49.569747+0000","last_undegraded":"2023-08-18T20:44:49.569747+0000","last_fullsized":"2023-08-18T20:44:49.569747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:04:41.874781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567140+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:49.567140+0000","last_peered":"2023-08-18T20:44:49.567140+0000","last_clean":"2023-08-18T20:44:49.567140+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:49.567140+0000","last_undegraded":"2023-08-18T20:44:49.567140+0000","last_fullsized":"2023-08-18T20:44:49.567140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:10:46.769121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315476+0000","last_change":"2023-08-18T20:44:48.084411+0000","last_active":"2023-08-18T20:44:49.315476+0000","last_peered":"2023-08-18T20:44:49.315476+0000","last_clean":"2023-08-18T20:44:49.315476+0000","last_became_active":"2023-08-18T20:44:48.084137+0000","last_became_peered":"2023-08-18T20:44:48.084137+0000","last_unstale":"2023-08-18T20:44:49.315476+0000","last_undegraded":"2023-08-18T20:44:49.315476+0000","last_fullsized":"2023-08-18T20:44:49.315476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:32.231834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568683+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:49.568683+0000","last_peered":"2023-08-18T20:44:49.568683+0000","last_clean":"2023-08-18T20:44:49.568683+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:49.568683+0000","last_undegraded":"2023-08-18T20:44:49.568683+0000","last_fullsized":"2023-08-18T20:44:49.568683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:43:53.813564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078440+0000","last_change":"2023-08-18T20:44:48.081486+0000","last_active":"2023-08-18T20:44:49.078440+0000","last_peered":"2023-08-18T20:44:49.078440+0000","last_clean":"2023-08-18T20:44:49.078440+0000","last_became_active":"2023-08-18T20:44:48.080685+0000","last_became_peered":"2023-08-18T20:44:48.080685+0000","last_unstale":"2023-08-18T20:44:49.078440+0000","last_undegraded":"2023-08-18T20:44:49.078440+0000","last_fullsized":"2023-08-18T20:44:49.078440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078639+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:49.078639+0000","last_peered":"2023-08-18T20:44:49.078639+0000","last_clean":"2023-08-18T20:44:49.078639+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:49.078639+0000","last_undegraded":"2023-08-18T20:44:49.078639+0000","last_fullsized":"2023-08-18T20:44:49.078639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:30.510575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315270+0000","last_change":"2023-08-18T20:44:48.083760+0000","last_active":"2023-08-18T20:44:49.315270+0000","last_peered":"2023-08-18T20:44:49.315270+0000","last_clean":"2023-08-18T20:44:49.315270+0000","last_became_active":"2023-08-18T20:44:48.083489+0000","last_became_peered":"2023-08-18T20:44:48.083489+0000","last_unstale":"2023-08-18T20:44:49.315270+0000","last_undegraded":"2023-08-18T20:44:49.315270+0000","last_fullsized":"2023-08-18T20:44:49.315270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:47:42.701833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078292+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:49.078292+0000","last_peered":"2023-08-18T20:44:49.078292+0000","last_clean":"2023-08-18T20:44:49.078292+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:49.078292+0000","last_undegraded":"2023-08-18T20:44:49.078292+0000","last_fullsized":"2023-08-18T20:44:49.078292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:22.397093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077883+0000","last_change":"2023-08-18T20:44:48.084313+0000","last_active":"2023-08-18T20:44:49.077883+0000","last_peered":"2023-08-18T20:44:49.077883+0000","last_clean":"2023-08-18T20:44:49.077883+0000","last_became_active":"2023-08-18T20:44:48.084044+0000","last_became_peered":"2023-08-18T20:44:48.084044+0000","last_unstale":"2023-08-18T20:44:49.077883+0000","last_undegraded":"2023-08-18T20:44:49.077883+0000","last_fullsized":"2023-08-18T20:44:49.077883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:56:05.544102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569229+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:49.569229+0000","last_peered":"2023-08-18T20:44:49.569229+0000","last_clean":"2023-08-18T20:44:49.569229+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:49.569229+0000","last_undegraded":"2023-08-18T20:44:49.569229+0000","last_fullsized":"2023-08-18T20:44:49.569229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:41:59.920334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078061+0000","last_change":"2023-08-18T20:44:48.084292+0000","last_active":"2023-08-18T20:44:49.078061+0000","last_peered":"2023-08-18T20:44:49.078061+0000","last_clean":"2023-08-18T20:44:49.078061+0000","last_became_active":"2023-08-18T20:44:48.083937+0000","last_became_peered":"2023-08-18T20:44:48.083937+0000","last_unstale":"2023-08-18T20:44:49.078061+0000","last_undegraded":"2023-08-18T20:44:49.078061+0000","last_fullsized":"2023-08-18T20:44:49.078061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:21.710779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078104+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:49.078104+0000","last_peered":"2023-08-18T20:44:49.078104+0000","last_clean":"2023-08-18T20:44:49.078104+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:49.078104+0000","last_undegraded":"2023-08-18T20:44:49.078104+0000","last_fullsized":"2023-08-18T20:44:49.078104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:10.336570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314507+0000","last_change":"2023-08-18T20:44:48.097522+0000","last_active":"2023-08-18T20:44:49.314507+0000","last_peered":"2023-08-18T20:44:49.314507+0000","last_clean":"2023-08-18T20:44:49.314507+0000","last_became_active":"2023-08-18T20:44:48.097249+0000","last_became_peered":"2023-08-18T20:44:48.097249+0000","last_unstale":"2023-08-18T20:44:49.314507+0000","last_undegraded":"2023-08-18T20:44:49.314507+0000","last_fullsized":"2023-08-18T20:44:49.314507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:41.781502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567788+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:49.567788+0000","last_peered":"2023-08-18T20:44:49.567788+0000","last_clean":"2023-08-18T20:44:49.567788+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:49.567788+0000","last_undegraded":"2023-08-18T20:44:49.567788+0000","last_fullsized":"2023-08-18T20:44:49.567788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:30.510575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079189+0000","last_change":"2023-08-18T20:44:48.093827+0000","last_active":"2023-08-18T20:44:49.079189+0000","last_peered":"2023-08-18T20:44:49.079189+0000","last_clean":"2023-08-18T20:44:49.079189+0000","last_became_active":"2023-08-18T20:44:48.093575+0000","last_became_peered":"2023-08-18T20:44:48.093575+0000","last_unstale":"2023-08-18T20:44:49.079189+0000","last_undegraded":"2023-08-18T20:44:49.079189+0000","last_fullsized":"2023-08-18T20:44:49.079189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:34:43.668018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078321+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:49.078321+0000","last_peered":"2023-08-18T20:44:49.078321+0000","last_clean":"2023-08-18T20:44:49.078321+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:49.078321+0000","last_undegraded":"2023-08-18T20:44:49.078321+0000","last_fullsized":"2023-08-18T20:44:49.078321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:24.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078360+0000","last_change":"2023-08-18T20:44:48.098872+0000","last_active":"2023-08-18T20:44:49.078360+0000","last_peered":"2023-08-18T20:44:49.078360+0000","last_clean":"2023-08-18T20:44:49.078360+0000","last_became_active":"2023-08-18T20:44:48.098583+0000","last_became_peered":"2023-08-18T20:44:48.098583+0000","last_unstale":"2023-08-18T20:44:49.078360+0000","last_undegraded":"2023-08-18T20:44:49.078360+0000","last_fullsized":"2023-08-18T20:44:49.078360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:44.966932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078969+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:49.078969+0000","last_peered":"2023-08-18T20:44:49.078969+0000","last_clean":"2023-08-18T20:44:49.078969+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:49.078969+0000","last_undegraded":"2023-08-18T20:44:49.078969+0000","last_fullsized":"2023-08-18T20:44:49.078969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:48.104963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315576+0000","last_change":"2023-08-18T20:44:48.091186+0000","last_active":"2023-08-18T20:44:49.315576+0000","last_peered":"2023-08-18T20:44:49.315576+0000","last_clean":"2023-08-18T20:44:49.315576+0000","last_became_active":"2023-08-18T20:44:48.089988+0000","last_became_peered":"2023-08-18T20:44:48.089988+0000","last_unstale":"2023-08-18T20:44:49.315576+0000","last_undegraded":"2023-08-18T20:44:49.315576+0000","last_fullsized":"2023-08-18T20:44:49.315576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569406+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:49.569406+0000","last_peered":"2023-08-18T20:44:49.569406+0000","last_clean":"2023-08-18T20:44:49.569406+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:49.569406+0000","last_undegraded":"2023-08-18T20:44:49.569406+0000","last_fullsized":"2023-08-18T20:44:49.569406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:38:49.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078570+0000","last_change":"2023-08-18T20:44:48.095852+0000","last_active":"2023-08-18T20:44:49.078570+0000","last_peered":"2023-08-18T20:44:49.078570+0000","last_clean":"2023-08-18T20:44:49.078570+0000","last_became_active":"2023-08-18T20:44:48.095565+0000","last_became_peered":"2023-08-18T20:44:48.095565+0000","last_unstale":"2023-08-18T20:44:49.078570+0000","last_undegraded":"2023-08-18T20:44:49.078570+0000","last_fullsized":"2023-08-18T20:44:49.078570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568287+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:49.568287+0000","last_peered":"2023-08-18T20:44:49.568287+0000","last_clean":"2023-08-18T20:44:49.568287+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:49.568287+0000","last_undegraded":"2023-08-18T20:44:49.568287+0000","last_fullsized":"2023-08-18T20:44:49.568287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:48.436600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567921+0000","last_change":"2023-08-18T20:44:48.090603+0000","last_active":"2023-08-18T20:44:49.567921+0000","last_peered":"2023-08-18T20:44:49.567921+0000","last_clean":"2023-08-18T20:44:49.567921+0000","last_became_active":"2023-08-18T20:44:48.090322+0000","last_became_peered":"2023-08-18T20:44:48.090322+0000","last_unstale":"2023-08-18T20:44:49.567921+0000","last_undegraded":"2023-08-18T20:44:49.567921+0000","last_fullsized":"2023-08-18T20:44:49.567921+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:01.348192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570064+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:49.570064+0000","last_peered":"2023-08-18T20:44:49.570064+0000","last_clean":"2023-08-18T20:44:49.570064+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:49.570064+0000","last_undegraded":"2023-08-18T20:44:49.570064+0000","last_fullsized":"2023-08-18T20:44:49.570064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:25.775711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569655+0000","last_change":"2023-08-18T20:44:48.093292+0000","last_active":"2023-08-18T20:44:49.569655+0000","last_peered":"2023-08-18T20:44:49.569655+0000","last_clean":"2023-08-18T20:44:49.569655+0000","last_became_active":"2023-08-18T20:44:48.093023+0000","last_became_peered":"2023-08-18T20:44:48.093023+0000","last_unstale":"2023-08-18T20:44:49.569655+0000","last_undegraded":"2023-08-18T20:44:49.569655+0000","last_fullsized":"2023-08-18T20:44:49.569655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:15.282862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078779+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:49.078779+0000","last_peered":"2023-08-18T20:44:49.078779+0000","last_clean":"2023-08-18T20:44:49.078779+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:49.078779+0000","last_undegraded":"2023-08-18T20:44:49.078779+0000","last_fullsized":"2023-08-18T20:44:49.078779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:49:12.597842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314777+0000","last_change":"2023-08-18T20:44:48.087462+0000","last_active":"2023-08-18T20:44:49.314777+0000","last_peered":"2023-08-18T20:44:49.314777+0000","last_clean":"2023-08-18T20:44:49.314777+0000","last_became_active":"2023-08-18T20:44:48.087200+0000","last_became_peered":"2023-08-18T20:44:48.087200+0000","last_unstale":"2023-08-18T20:44:49.314777+0000","last_undegraded":"2023-08-18T20:44:49.314777+0000","last_fullsized":"2023-08-18T20:44:49.314777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:38.936126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080814+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:49.080814+0000","last_peered":"2023-08-18T20:44:49.080814+0000","last_clean":"2023-08-18T20:44:49.080814+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:49.080814+0000","last_undegraded":"2023-08-18T20:44:49.080814+0000","last_fullsized":"2023-08-18T20:44:49.080814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:45:19.527191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568177+0000","last_change":"2023-08-18T20:44:48.087865+0000","last_active":"2023-08-18T20:44:49.568177+0000","last_peered":"2023-08-18T20:44:49.568177+0000","last_clean":"2023-08-18T20:44:49.568177+0000","last_became_active":"2023-08-18T20:44:48.087572+0000","last_became_peered":"2023-08-18T20:44:48.087572+0000","last_unstale":"2023-08-18T20:44:49.568177+0000","last_undegraded":"2023-08-18T20:44:49.568177+0000","last_fullsized":"2023-08-18T20:44:49.568177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:36.378800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077757+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:49.077757+0000","last_peered":"2023-08-18T20:44:49.077757+0000","last_clean":"2023-08-18T20:44:49.077757+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:49.077757+0000","last_undegraded":"2023-08-18T20:44:49.077757+0000","last_fullsized":"2023-08-18T20:44:49.077757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:50:48.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315043+0000","last_change":"2023-08-18T20:44:48.098108+0000","last_active":"2023-08-18T20:44:49.315043+0000","last_peered":"2023-08-18T20:44:49.315043+0000","last_clean":"2023-08-18T20:44:49.315043+0000","last_became_active":"2023-08-18T20:44:48.097806+0000","last_became_peered":"2023-08-18T20:44:48.097806+0000","last_unstale":"2023-08-18T20:44:49.315043+0000","last_undegraded":"2023-08-18T20:44:49.315043+0000","last_fullsized":"2023-08-18T20:44:49.315043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:09:21.246745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569614+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:49.569614+0000","last_peered":"2023-08-18T20:44:49.569614+0000","last_clean":"2023-08-18T20:44:49.569614+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:49.569614+0000","last_undegraded":"2023-08-18T20:44:49.569614+0000","last_fullsized":"2023-08-18T20:44:49.569614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:09.909788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569793+0000","last_change":"2023-08-18T20:44:48.086363+0000","last_active":"2023-08-18T20:44:49.569793+0000","last_peered":"2023-08-18T20:44:49.569793+0000","last_clean":"2023-08-18T20:44:49.569793+0000","last_became_active":"2023-08-18T20:44:48.086081+0000","last_became_peered":"2023-08-18T20:44:48.086081+0000","last_unstale":"2023-08-18T20:44:49.569793+0000","last_undegraded":"2023-08-18T20:44:49.569793+0000","last_fullsized":"2023-08-18T20:44:49.569793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:44.015640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568157+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:49.568157+0000","last_peered":"2023-08-18T20:44:49.568157+0000","last_clean":"2023-08-18T20:44:49.568157+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:49.568157+0000","last_undegraded":"2023-08-18T20:44:49.568157+0000","last_fullsized":"2023-08-18T20:44:49.568157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:55:59.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567774+0000","last_change":"2023-08-18T20:44:48.085809+0000","last_active":"2023-08-18T20:44:49.567774+0000","last_peered":"2023-08-18T20:44:49.567774+0000","last_clean":"2023-08-18T20:44:49.567774+0000","last_became_active":"2023-08-18T20:44:48.085321+0000","last_became_peered":"2023-08-18T20:44:48.085321+0000","last_unstale":"2023-08-18T20:44:49.567774+0000","last_undegraded":"2023-08-18T20:44:49.567774+0000","last_fullsized":"2023-08-18T20:44:49.567774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570405+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:49.570405+0000","last_peered":"2023-08-18T20:44:49.570405+0000","last_clean":"2023-08-18T20:44:49.570405+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:49.570405+0000","last_undegraded":"2023-08-18T20:44:49.570405+0000","last_fullsized":"2023-08-18T20:44:49.570405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:00:11.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569066+0000","last_change":"2023-08-18T20:44:48.089035+0000","last_active":"2023-08-18T20:44:49.569066+0000","last_peered":"2023-08-18T20:44:49.569066+0000","last_clean":"2023-08-18T20:44:49.569066+0000","last_became_active":"2023-08-18T20:44:48.088786+0000","last_became_peered":"2023-08-18T20:44:48.088786+0000","last_unstale":"2023-08-18T20:44:49.569066+0000","last_undegraded":"2023-08-18T20:44:49.569066+0000","last_fullsized":"2023-08-18T20:44:49.569066+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:32.638770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567991+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:49.567991+0000","last_peered":"2023-08-18T20:44:49.567991+0000","last_clean":"2023-08-18T20:44:49.567991+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:49.567991+0000","last_undegraded":"2023-08-18T20:44:49.567991+0000","last_fullsized":"2023-08-18T20:44:49.567991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:02.879896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314919+0000","last_change":"2023-08-18T20:44:48.098922+0000","last_active":"2023-08-18T20:44:49.314919+0000","last_peered":"2023-08-18T20:44:49.314919+0000","last_clean":"2023-08-18T20:44:49.314919+0000","last_became_active":"2023-08-18T20:44:48.096947+0000","last_became_peered":"2023-08-18T20:44:48.096947+0000","last_unstale":"2023-08-18T20:44:49.314919+0000","last_undegraded":"2023-08-18T20:44:49.314919+0000","last_fullsized":"2023-08-18T20:44:49.314919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:41:06.766833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568947+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:49.568947+0000","last_peered":"2023-08-18T20:44:49.568947+0000","last_clean":"2023-08-18T20:44:49.568947+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:49.568947+0000","last_undegraded":"2023-08-18T20:44:49.568947+0000","last_fullsized":"2023-08-18T20:44:49.568947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:38.024438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567399+0000","last_change":"2023-08-18T20:44:48.087773+0000","last_active":"2023-08-18T20:44:49.567399+0000","last_peered":"2023-08-18T20:44:49.567399+0000","last_clean":"2023-08-18T20:44:49.567399+0000","last_became_active":"2023-08-18T20:44:48.087565+0000","last_became_peered":"2023-08-18T20:44:48.087565+0000","last_unstale":"2023-08-18T20:44:49.567399+0000","last_undegraded":"2023-08-18T20:44:49.567399+0000","last_fullsized":"2023-08-18T20:44:49.567399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:51:02.577013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314861+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:49.314861+0000","last_peered":"2023-08-18T20:44:49.314861+0000","last_clean":"2023-08-18T20:44:49.314861+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:49.314861+0000","last_undegraded":"2023-08-18T20:44:49.314861+0000","last_fullsized":"2023-08-18T20:44:49.314861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:42:47.291297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568064+0000","last_change":"2023-08-18T20:44:48.087378+0000","last_active":"2023-08-18T20:44:49.568064+0000","last_peered":"2023-08-18T20:44:49.568064+0000","last_clean":"2023-08-18T20:44:49.568064+0000","last_became_active":"2023-08-18T20:44:48.087142+0000","last_became_peered":"2023-08-18T20:44:48.087142+0000","last_unstale":"2023-08-18T20:44:49.568064+0000","last_undegraded":"2023-08-18T20:44:49.568064+0000","last_fullsized":"2023-08-18T20:44:49.568064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:59:07.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570255+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:49.570255+0000","last_peered":"2023-08-18T20:44:49.570255+0000","last_clean":"2023-08-18T20:44:49.570255+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:49.570255+0000","last_undegraded":"2023-08-18T20:44:49.570255+0000","last_fullsized":"2023-08-18T20:44:49.570255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:57.040146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078093+0000","last_change":"2023-08-18T20:44:48.082555+0000","last_active":"2023-08-18T20:44:49.078093+0000","last_peered":"2023-08-18T20:44:49.078093+0000","last_clean":"2023-08-18T20:44:49.078093+0000","last_became_active":"2023-08-18T20:44:48.081970+0000","last_became_peered":"2023-08-18T20:44:48.081970+0000","last_unstale":"2023-08-18T20:44:49.078093+0000","last_undegraded":"2023-08-18T20:44:49.078093+0000","last_fullsized":"2023-08-18T20:44:49.078093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:32.638770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570166+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:49.570166+0000","last_peered":"2023-08-18T20:44:49.570166+0000","last_clean":"2023-08-18T20:44:49.570166+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:49.570166+0000","last_undegraded":"2023-08-18T20:44:49.570166+0000","last_fullsized":"2023-08-18T20:44:49.570166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:39:15.175345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314816+0000","last_change":"2023-08-18T20:44:48.098397+0000","last_active":"2023-08-18T20:44:49.314816+0000","last_peered":"2023-08-18T20:44:49.314816+0000","last_clean":"2023-08-18T20:44:49.314816+0000","last_became_active":"2023-08-18T20:44:48.098113+0000","last_became_peered":"2023-08-18T20:44:48.098113+0000","last_unstale":"2023-08-18T20:44:49.314816+0000","last_undegraded":"2023-08-18T20:44:49.314816+0000","last_fullsized":"2023-08-18T20:44:49.314816+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315529+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:49.315529+0000","last_peered":"2023-08-18T20:44:49.315529+0000","last_clean":"2023-08-18T20:44:49.315529+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:49.315529+0000","last_undegraded":"2023-08-18T20:44:49.315529+0000","last_fullsized":"2023-08-18T20:44:49.315529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:53.709433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567683+0000","last_change":"2023-08-18T20:44:48.085622+0000","last_active":"2023-08-18T20:44:49.567683+0000","last_peered":"2023-08-18T20:44:49.567683+0000","last_clean":"2023-08-18T20:44:49.567683+0000","last_became_active":"2023-08-18T20:44:48.085282+0000","last_became_peered":"2023-08-18T20:44:48.085282+0000","last_unstale":"2023-08-18T20:44:49.567683+0000","last_undegraded":"2023-08-18T20:44:49.567683+0000","last_fullsized":"2023-08-18T20:44:49.567683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:36.453989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077720+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:49.077720+0000","last_peered":"2023-08-18T20:44:49.077720+0000","last_clean":"2023-08-18T20:44:49.077720+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:49.077720+0000","last_undegraded":"2023-08-18T20:44:49.077720+0000","last_fullsized":"2023-08-18T20:44:49.077720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:00.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078275+0000","last_change":"2023-08-18T20:44:48.084751+0000","last_active":"2023-08-18T20:44:49.078275+0000","last_peered":"2023-08-18T20:44:49.078275+0000","last_clean":"2023-08-18T20:44:49.078275+0000","last_became_active":"2023-08-18T20:44:48.084457+0000","last_became_peered":"2023-08-18T20:44:48.084457+0000","last_unstale":"2023-08-18T20:44:49.078275+0000","last_undegraded":"2023-08-18T20:44:49.078275+0000","last_fullsized":"2023-08-18T20:44:49.078275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:21:23.803379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570184+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:49.570184+0000","last_peered":"2023-08-18T20:44:49.570184+0000","last_clean":"2023-08-18T20:44:49.570184+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:49.570184+0000","last_undegraded":"2023-08-18T20:44:49.570184+0000","last_fullsized":"2023-08-18T20:44:49.570184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:39:27.487888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078156+0000","last_change":"2023-08-18T20:44:48.080516+0000","last_active":"2023-08-18T20:44:49.078156+0000","last_peered":"2023-08-18T20:44:49.078156+0000","last_clean":"2023-08-18T20:44:49.078156+0000","last_became_active":"2023-08-18T20:44:48.080229+0000","last_became_peered":"2023-08-18T20:44:48.080229+0000","last_unstale":"2023-08-18T20:44:49.078156+0000","last_undegraded":"2023-08-18T20:44:49.078156+0000","last_fullsized":"2023-08-18T20:44:49.078156+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:13.947954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567192+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:49.567192+0000","last_peered":"2023-08-18T20:44:49.567192+0000","last_clean":"2023-08-18T20:44:49.567192+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:49.567192+0000","last_undegraded":"2023-08-18T20:44:49.567192+0000","last_fullsized":"2023-08-18T20:44:49.567192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:40:11.639360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080955+0000","last_change":"2023-08-18T20:44:48.095202+0000","last_active":"2023-08-18T20:44:49.080955+0000","last_peered":"2023-08-18T20:44:49.080955+0000","last_clean":"2023-08-18T20:44:49.080955+0000","last_became_active":"2023-08-18T20:44:48.094943+0000","last_became_peered":"2023-08-18T20:44:48.094943+0000","last_unstale":"2023-08-18T20:44:49.080955+0000","last_undegraded":"2023-08-18T20:44:49.080955+0000","last_fullsized":"2023-08-18T20:44:49.080955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:25.088467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080168+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:49.080168+0000","last_peered":"2023-08-18T20:44:49.080168+0000","last_clean":"2023-08-18T20:44:49.080168+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:49.080168+0000","last_undegraded":"2023-08-18T20:44:49.080168+0000","last_fullsized":"2023-08-18T20:44:49.080168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:05.480939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314932+0000","last_change":"2023-08-18T20:44:48.098110+0000","last_active":"2023-08-18T20:44:49.314932+0000","last_peered":"2023-08-18T20:44:49.314932+0000","last_clean":"2023-08-18T20:44:49.314932+0000","last_became_active":"2023-08-18T20:44:48.097002+0000","last_became_peered":"2023-08-18T20:44:48.097002+0000","last_unstale":"2023-08-18T20:44:49.314932+0000","last_undegraded":"2023-08-18T20:44:49.314932+0000","last_fullsized":"2023-08-18T20:44:49.314932+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:55:26.368075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080426+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:49.080426+0000","last_peered":"2023-08-18T20:44:49.080426+0000","last_clean":"2023-08-18T20:44:49.080426+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:49.080426+0000","last_undegraded":"2023-08-18T20:44:49.080426+0000","last_fullsized":"2023-08-18T20:44:49.080426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:12:34.051852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567451+0000","last_change":"2023-08-18T20:44:48.088847+0000","last_active":"2023-08-18T20:44:49.567451+0000","last_peered":"2023-08-18T20:44:49.567451+0000","last_clean":"2023-08-18T20:44:49.567451+0000","last_became_active":"2023-08-18T20:44:48.088361+0000","last_became_peered":"2023-08-18T20:44:48.088361+0000","last_unstale":"2023-08-18T20:44:49.567451+0000","last_undegraded":"2023-08-18T20:44:49.567451+0000","last_fullsized":"2023-08-18T20:44:49.567451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:27.183029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315435+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:49.315435+0000","last_peered":"2023-08-18T20:44:49.315435+0000","last_clean":"2023-08-18T20:44:49.315435+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:49.315435+0000","last_undegraded":"2023-08-18T20:44:49.315435+0000","last_fullsized":"2023-08-18T20:44:49.315435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:22.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567012+0000","last_change":"2023-08-18T20:44:48.085606+0000","last_active":"2023-08-18T20:44:49.567012+0000","last_peered":"2023-08-18T20:44:49.567012+0000","last_clean":"2023-08-18T20:44:49.567012+0000","last_became_active":"2023-08-18T20:44:48.085287+0000","last_became_peered":"2023-08-18T20:44:48.085287+0000","last_unstale":"2023-08-18T20:44:49.567012+0000","last_undegraded":"2023-08-18T20:44:49.567012+0000","last_fullsized":"2023-08-18T20:44:49.567012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:08.736884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078933+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:49.078933+0000","last_peered":"2023-08-18T20:44:49.078933+0000","last_clean":"2023-08-18T20:44:49.078933+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:49.078933+0000","last_undegraded":"2023-08-18T20:44:49.078933+0000","last_fullsized":"2023-08-18T20:44:49.078933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:09.909788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568347+0000","last_change":"2023-08-18T20:44:48.086300+0000","last_active":"2023-08-18T20:44:49.568347+0000","last_peered":"2023-08-18T20:44:49.568347+0000","last_clean":"2023-08-18T20:44:49.568347+0000","last_became_active":"2023-08-18T20:44:48.086027+0000","last_became_peered":"2023-08-18T20:44:48.086027+0000","last_unstale":"2023-08-18T20:44:49.568347+0000","last_undegraded":"2023-08-18T20:44:49.568347+0000","last_fullsized":"2023-08-18T20:44:49.568347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:52.491300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078640+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:49.078640+0000","last_peered":"2023-08-18T20:44:49.078640+0000","last_clean":"2023-08-18T20:44:49.078640+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:49.078640+0000","last_undegraded":"2023-08-18T20:44:49.078640+0000","last_fullsized":"2023-08-18T20:44:49.078640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:45:57.133446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1036288,"data_stored":773013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.755},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.371},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.60799999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59399999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":0.307}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.25700000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.627}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.5}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.52700000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.501}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.67000000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":181014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.317},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.221},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38500000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":184119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.223},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.29099999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.245},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.28000000000000003}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.61499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.629}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70799999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":179444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.746}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.437},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:56.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:44:56.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.924+0000 7faf10345700 1 Processor -- start 2023-08-18T20:44:56.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.924+0000 7faf10345700 1 -- start start 2023-08-18T20:44:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf10345700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faf080c4170 0x7faf080c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf10345700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf08152fa0 0x7faf080c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf10345700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf08152200 con 0x7faf080a71f0 2023-08-18T20:44:56.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf10345700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080aa740 con 0x7faf080c4170 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf10345700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf081565c0 con 0x7faf08152fa0 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf0e0e1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faf080c4170 0x7faf080c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf0e8e2700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7faf080a71f0 0x7faf080c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49068/0 (socket says 172.21.15.121:49068) 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf0e8e2700 1 -- 172.21.15.121:0/519567653 learned_addr learned my addr 172.21.15.121:0/519567653 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.925+0000 7faf0d8e0700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf08152fa0 0x7faf080c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0e0e1700 1 -- 172.21.15.121:0/519567653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf08152fa0 msgr2=0x7faf080c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0e0e1700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf08152fa0 0x7faf080c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0e0e1700 1 -- 172.21.15.121:0/519567653 >> v1:172.21.15.121:6789/0 conn(0x7faf080a71f0 legacy=0x7faf080c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0e0e1700 1 -- 172.21.15.121:0/519567653 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf081524c0 con 0x7faf080c4170 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0d0df700 1 -- 172.21.15.121:0/519567653 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905974228 0 0) 0x7faf08152200 con 0x7faf080a71f0 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0e0e1700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf080c4170 0x7faf080c5d60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faf04009840 tx=0x7faf04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7351d8003732702e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0d0df700 1 -- 172.21.15.121:0/519567653 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011830 con 0x7faf080c4170 2023-08-18T20:44:56.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0d0df700 1 -- 172.21.15.121:0/519567653 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04011990 con 0x7faf080c4170 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf0d0df700 1 -- 172.21.15.121:0/519567653 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011d20 con 0x7faf080c4170 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 -- 172.21.15.121:0/519567653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf080c4170 msgr2=0x7faf080c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf080c4170 0x7faf080c5d60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faf04009840 tx=0x7faf04009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 -- 172.21.15.121:0/519567653 shutdown_connections 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf080c4170 0x7faf080c5d60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 --2- 172.21.15.121:0/519567653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf08152fa0 0x7faf080c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:56.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.926+0000 7faf10345700 1 -- 172.21.15.121:0/519567653 >> 172.21.15.121:0/519567653 conn(0x7faf080a9a90 msgr2=0x7faf080a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.927+0000 7faf10345700 1 -- 172.21.15.121:0/519567653 shutdown_connections 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.927+0000 7faf10345700 1 -- 172.21.15.121:0/519567653 wait complete. 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 Processor -- start 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 -- start start 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf080a71f0 0x7faf080aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf080c4170 0x7faf0814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081eaf70 con 0x7faf08152fa0 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080ac4c0 con 0x7faf080a71f0 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf10345700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080be5c0 con 0x7faf080c4170 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf0e8e2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.928+0000 7faf0e8e2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42490/0 (socket says 172.21.15.121:42490) 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 -- 172.21.15.121:0/2724529073 learned_addr learned my addr 172.21.15.121:0/2724529073 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e0e1700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf080a71f0 0x7faf080aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0d8e0700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf080c4170 0x7faf0814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 -- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf080c4170 msgr2=0x7faf0814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf080c4170 0x7faf0814d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 -- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf080a71f0 msgr2=0x7faf080aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf080a71f0 0x7faf080aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:56.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 -- 172.21.15.121:0/2724529073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094a0 con 0x7faf08152fa0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf0e8e2700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf0000cba0 tx=0x7faf0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000ab80 con 0x7faf08152fa0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000ad00 con 0x7faf08152fa0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf080be8a0 con 0x7faf08152fa0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00007310 con 0x7faf08152fa0 2023-08-18T20:44:56.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.929+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0814d690 con 0x7faf08152fa0 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.930+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf081561e0 con 0x7faf08152fa0 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.930+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf00007470 con 0x7faf08152fa0 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.931+0000 7faefeffd700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 0x7faeec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.931+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7faf00088620 con 0x7faf08152fa0 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.931+0000 7faf0e0e1700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 0x7faeec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:56.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.931+0000 7faf0e0e1700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 0x7faeec06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf040090b0 tx=0x7faf04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:56.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:56.935+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7faf081561e0 con 0x7faf08152fa0 2023-08-18T20:44:57.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.125+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf08152a80 con 0x7faeec06a0e0 2023-08-18T20:44:57.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.139+0000 7faefeffd700 1 -- 172.21.15.121:0/2724529073 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549872 (secure 0 0 0) 0x7faf04011b80 con 0x7faeec06a0e0 2023-08-18T20:44:57.145 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 msgr2=0x7faeec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 0x7faeec06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf040090b0 tx=0x7faf04008030 comp rx=0 tx=0).stop 2023-08-18T20:44:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 msgr2=0x7faf0814b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf0000cba0 tx=0x7faf0000cf60 comp rx=0 tx=0).stop 2023-08-18T20:44:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 shutdown_connections 2023-08-18T20:44:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7faeec06a0e0 0x7faeec06c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf08152fa0 0x7faf0814b010 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf080a71f0 0x7faf080aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 --2- 172.21.15.121:0/2724529073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf080c4170 0x7faf0814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 >> 172.21.15.121:0/2724529073 conn(0x7faf080a9a90 msgr2=0x7faf080a9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 shutdown_connections 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.144+0000 7faf10345700 1 -- 172.21.15.121:0/2724529073 wait complete. 2023-08-18T20:44:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:44:57.156 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-08-18T20:44:56.932263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596695,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":252,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224824,"kb_used_data":4552,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749896,"statfs":{"total":773094113280,"available":772863893504,"internally_reserved":0,"allocated":4661248,"data_stored":2628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.870672"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078653+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:44:49.078653+0000","last_peered":"2023-08-18T20:44:49.078653+0000","last_clean":"2023-08-18T20:44:49.078653+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:44:49.078653+0000","last_undegraded":"2023-08-18T20:44:49.078653+0000","last_fullsized":"2023-08-18T20:44:49.078653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:39:57.249148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315044+0000","last_change":"2023-08-18T20:44:33.022313+0000","last_active":"2023-08-18T20:44:49.315044+0000","last_peered":"2023-08-18T20:44:49.315044+0000","last_clean":"2023-08-18T20:44:49.315044+0000","last_became_active":"2023-08-18T20:44:33.021599+0000","last_became_peered":"2023-08-18T20:44:33.021599+0000","last_unstale":"2023-08-18T20:44:49.315044+0000","last_undegraded":"2023-08-18T20:44:49.315044+0000","last_fullsized":"2023-08-18T20:44:49.315044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:07:54.696956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314591+0000","last_change":"2023-08-18T20:44:34.026480+0000","last_active":"2023-08-18T20:44:49.314591+0000","last_peered":"2023-08-18T20:44:49.314591+0000","last_clean":"2023-08-18T20:44:49.314591+0000","last_became_active":"2023-08-18T20:44:34.026210+0000","last_became_peered":"2023-08-18T20:44:34.026210+0000","last_unstale":"2023-08-18T20:44:49.314591+0000","last_undegraded":"2023-08-18T20:44:49.314591+0000","last_fullsized":"2023-08-18T20:44:49.314591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:10.336570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567840+0000","last_change":"2023-08-18T20:44:47.080583+0000","last_active":"2023-08-18T20:44:49.567840+0000","last_peered":"2023-08-18T20:44:49.567840+0000","last_clean":"2023-08-18T20:44:49.567840+0000","last_became_active":"2023-08-18T20:44:47.080279+0000","last_became_peered":"2023-08-18T20:44:47.080279+0000","last_unstale":"2023-08-18T20:44:49.567840+0000","last_undegraded":"2023-08-18T20:44:49.567840+0000","last_fullsized":"2023-08-18T20:44:49.567840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:31.226070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315351+0000","last_change":"2023-08-18T20:44:48.097511+0000","last_active":"2023-08-18T20:44:49.315351+0000","last_peered":"2023-08-18T20:44:49.315351+0000","last_clean":"2023-08-18T20:44:49.315351+0000","last_became_active":"2023-08-18T20:44:48.097167+0000","last_became_peered":"2023-08-18T20:44:48.097167+0000","last_unstale":"2023-08-18T20:44:49.315351+0000","last_undegraded":"2023-08-18T20:44:49.315351+0000","last_fullsized":"2023-08-18T20:44:49.315351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:24:57.736900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078292+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:44:49.078292+0000","last_peered":"2023-08-18T20:44:49.078292+0000","last_clean":"2023-08-18T20:44:49.078292+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:44:49.078292+0000","last_undegraded":"2023-08-18T20:44:49.078292+0000","last_fullsized":"2023-08-18T20:44:49.078292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:56:44.166051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077685+0000","last_change":"2023-08-18T20:44:33.023042+0000","last_active":"2023-08-18T20:44:49.077685+0000","last_peered":"2023-08-18T20:44:49.077685+0000","last_clean":"2023-08-18T20:44:49.077685+0000","last_became_active":"2023-08-18T20:44:33.022702+0000","last_became_peered":"2023-08-18T20:44:33.022702+0000","last_unstale":"2023-08-18T20:44:49.077685+0000","last_undegraded":"2023-08-18T20:44:49.077685+0000","last_fullsized":"2023-08-18T20:44:49.077685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:57:12.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567215+0000","last_change":"2023-08-18T20:44:34.035954+0000","last_active":"2023-08-18T20:44:49.567215+0000","last_peered":"2023-08-18T20:44:49.567215+0000","last_clean":"2023-08-18T20:44:49.567215+0000","last_became_active":"2023-08-18T20:44:34.035657+0000","last_became_peered":"2023-08-18T20:44:34.035657+0000","last_unstale":"2023-08-18T20:44:49.567215+0000","last_undegraded":"2023-08-18T20:44:49.567215+0000","last_fullsized":"2023-08-18T20:44:49.567215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:55:06.042269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568344+0000","last_change":"2023-08-18T20:44:47.079058+0000","last_active":"2023-08-18T20:44:49.568344+0000","last_peered":"2023-08-18T20:44:49.568344+0000","last_clean":"2023-08-18T20:44:49.568344+0000","last_became_active":"2023-08-18T20:44:47.078761+0000","last_became_peered":"2023-08-18T20:44:47.078761+0000","last_unstale":"2023-08-18T20:44:49.568344+0000","last_undegraded":"2023-08-18T20:44:49.568344+0000","last_fullsized":"2023-08-18T20:44:49.568344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:19.820137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078319+0000","last_change":"2023-08-18T20:44:48.080277+0000","last_active":"2023-08-18T20:44:49.078319+0000","last_peered":"2023-08-18T20:44:49.078319+0000","last_clean":"2023-08-18T20:44:49.078319+0000","last_became_active":"2023-08-18T20:44:48.079974+0000","last_became_peered":"2023-08-18T20:44:48.079974+0000","last_unstale":"2023-08-18T20:44:49.078319+0000","last_undegraded":"2023-08-18T20:44:49.078319+0000","last_fullsized":"2023-08-18T20:44:49.078319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:30:21.497449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570093+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:44:49.570093+0000","last_peered":"2023-08-18T20:44:49.570093+0000","last_clean":"2023-08-18T20:44:49.570093+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:44:49.570093+0000","last_undegraded":"2023-08-18T20:44:49.570093+0000","last_fullsized":"2023-08-18T20:44:49.570093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:28:40.145306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315321+0000","last_change":"2023-08-18T20:44:33.023631+0000","last_active":"2023-08-18T20:44:49.315321+0000","last_peered":"2023-08-18T20:44:49.315321+0000","last_clean":"2023-08-18T20:44:49.315321+0000","last_became_active":"2023-08-18T20:44:33.023283+0000","last_became_peered":"2023-08-18T20:44:33.023283+0000","last_unstale":"2023-08-18T20:44:49.315321+0000","last_undegraded":"2023-08-18T20:44:49.315321+0000","last_fullsized":"2023-08-18T20:44:49.315321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:32.719211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078459+0000","last_change":"2023-08-18T20:44:34.026701+0000","last_active":"2023-08-18T20:44:49.078459+0000","last_peered":"2023-08-18T20:44:49.078459+0000","last_clean":"2023-08-18T20:44:49.078459+0000","last_became_active":"2023-08-18T20:44:34.026435+0000","last_became_peered":"2023-08-18T20:44:34.026435+0000","last_unstale":"2023-08-18T20:44:49.078459+0000","last_undegraded":"2023-08-18T20:44:49.078459+0000","last_fullsized":"2023-08-18T20:44:49.078459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:36:14.190785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078152+0000","last_change":"2023-08-18T20:44:47.085956+0000","last_active":"2023-08-18T20:44:49.078152+0000","last_peered":"2023-08-18T20:44:49.078152+0000","last_clean":"2023-08-18T20:44:49.078152+0000","last_became_active":"2023-08-18T20:44:47.085671+0000","last_became_peered":"2023-08-18T20:44:47.085671+0000","last_unstale":"2023-08-18T20:44:49.078152+0000","last_undegraded":"2023-08-18T20:44:49.078152+0000","last_fullsized":"2023-08-18T20:44:49.078152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:10:03.501595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568501+0000","last_change":"2023-08-18T20:44:48.087889+0000","last_active":"2023-08-18T20:44:49.568501+0000","last_peered":"2023-08-18T20:44:49.568501+0000","last_clean":"2023-08-18T20:44:49.568501+0000","last_became_active":"2023-08-18T20:44:48.087509+0000","last_became_peered":"2023-08-18T20:44:48.087509+0000","last_unstale":"2023-08-18T20:44:49.568501+0000","last_undegraded":"2023-08-18T20:44:49.568501+0000","last_fullsized":"2023-08-18T20:44:49.568501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:32.231834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567865+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:44:49.567865+0000","last_peered":"2023-08-18T20:44:49.567865+0000","last_clean":"2023-08-18T20:44:49.567865+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:44:49.567865+0000","last_undegraded":"2023-08-18T20:44:49.567865+0000","last_fullsized":"2023-08-18T20:44:49.567865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:35.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568714+0000","last_change":"2023-08-18T20:44:33.025951+0000","last_active":"2023-08-18T20:44:49.568714+0000","last_peered":"2023-08-18T20:44:49.568714+0000","last_clean":"2023-08-18T20:44:49.568714+0000","last_became_active":"2023-08-18T20:44:33.025671+0000","last_became_peered":"2023-08-18T20:44:33.025671+0000","last_unstale":"2023-08-18T20:44:49.568714+0000","last_undegraded":"2023-08-18T20:44:49.568714+0000","last_fullsized":"2023-08-18T20:44:49.568714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:27.742245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570612+0000","last_change":"2023-08-18T20:44:34.031070+0000","last_active":"2023-08-18T20:44:49.570612+0000","last_peered":"2023-08-18T20:44:49.570612+0000","last_clean":"2023-08-18T20:44:49.570612+0000","last_became_active":"2023-08-18T20:44:34.030786+0000","last_became_peered":"2023-08-18T20:44:34.030786+0000","last_unstale":"2023-08-18T20:44:49.570612+0000","last_undegraded":"2023-08-18T20:44:49.570612+0000","last_fullsized":"2023-08-18T20:44:49.570612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:26:48.233232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:50.978133+0000","last_change":"2023-08-18T20:44:47.085151+0000","last_active":"2023-08-18T20:44:50.978133+0000","last_peered":"2023-08-18T20:44:50.978133+0000","last_clean":"2023-08-18T20:44:50.978133+0000","last_became_active":"2023-08-18T20:44:47.084748+0000","last_became_peered":"2023-08-18T20:44:47.084748+0000","last_unstale":"2023-08-18T20:44:50.978133+0000","last_undegraded":"2023-08-18T20:44:50.978133+0000","last_fullsized":"2023-08-18T20:44:50.978133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:51.075569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078006+0000","last_change":"2023-08-18T20:44:48.078855+0000","last_active":"2023-08-18T20:44:49.078006+0000","last_peered":"2023-08-18T20:44:49.078006+0000","last_clean":"2023-08-18T20:44:49.078006+0000","last_became_active":"2023-08-18T20:44:48.078596+0000","last_became_peered":"2023-08-18T20:44:48.078596+0000","last_unstale":"2023-08-18T20:44:49.078006+0000","last_undegraded":"2023-08-18T20:44:49.078006+0000","last_fullsized":"2023-08-18T20:44:49.078006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:27.183029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568461+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:44:49.568461+0000","last_peered":"2023-08-18T20:44:49.568461+0000","last_clean":"2023-08-18T20:44:49.568461+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:44:49.568461+0000","last_undegraded":"2023-08-18T20:44:49.568461+0000","last_fullsized":"2023-08-18T20:44:49.568461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:29:11.979763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"33'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081341+0000","last_change":"2023-08-18T20:44:33.024321+0000","last_active":"2023-08-18T20:44:49.081341+0000","last_peered":"2023-08-18T20:44:49.081341+0000","last_clean":"2023-08-18T20:44:49.081341+0000","last_became_active":"2023-08-18T20:44:33.024018+0000","last_became_peered":"2023-08-18T20:44:33.024018+0000","last_unstale":"2023-08-18T20:44:49.081341+0000","last_undegraded":"2023-08-18T20:44:49.081341+0000","last_fullsized":"2023-08-18T20:44:49.081341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:13:30.681795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568296+0000","last_change":"2023-08-18T20:44:34.040350+0000","last_active":"2023-08-18T20:44:49.568296+0000","last_peered":"2023-08-18T20:44:49.568296+0000","last_clean":"2023-08-18T20:44:49.568296+0000","last_became_active":"2023-08-18T20:44:34.039838+0000","last_became_peered":"2023-08-18T20:44:34.039838+0000","last_unstale":"2023-08-18T20:44:49.568296+0000","last_undegraded":"2023-08-18T20:44:49.568296+0000","last_fullsized":"2023-08-18T20:44:49.568296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:22:26.793949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314974+0000","last_change":"2023-08-18T20:44:47.079935+0000","last_active":"2023-08-18T20:44:49.314974+0000","last_peered":"2023-08-18T20:44:49.314974+0000","last_clean":"2023-08-18T20:44:49.314974+0000","last_became_active":"2023-08-18T20:44:47.079311+0000","last_became_peered":"2023-08-18T20:44:47.079311+0000","last_unstale":"2023-08-18T20:44:49.314974+0000","last_undegraded":"2023-08-18T20:44:49.314974+0000","last_fullsized":"2023-08-18T20:44:49.314974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:49:25.648973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078786+0000","last_change":"2023-08-18T20:44:48.087549+0000","last_active":"2023-08-18T20:44:49.078786+0000","last_peered":"2023-08-18T20:44:49.078786+0000","last_clean":"2023-08-18T20:44:49.078786+0000","last_became_active":"2023-08-18T20:44:48.087284+0000","last_became_peered":"2023-08-18T20:44:48.087284+0000","last_unstale":"2023-08-18T20:44:49.078786+0000","last_undegraded":"2023-08-18T20:44:49.078786+0000","last_fullsized":"2023-08-18T20:44:49.078786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:47:30.036901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567733+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:44:49.567733+0000","last_peered":"2023-08-18T20:44:49.567733+0000","last_clean":"2023-08-18T20:44:49.567733+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:44:49.567733+0000","last_undegraded":"2023-08-18T20:44:49.567733+0000","last_fullsized":"2023-08-18T20:44:49.567733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:56.026416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567547+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:44:49.567547+0000","last_peered":"2023-08-18T20:44:49.567547+0000","last_clean":"2023-08-18T20:44:49.567547+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:44:49.567547+0000","last_undegraded":"2023-08-18T20:44:49.567547+0000","last_fullsized":"2023-08-18T20:44:49.567547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:54.989674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570433+0000","last_change":"2023-08-18T20:44:33.027255+0000","last_active":"2023-08-18T20:44:49.570433+0000","last_peered":"2023-08-18T20:44:49.570433+0000","last_clean":"2023-08-18T20:44:49.570433+0000","last_became_active":"2023-08-18T20:44:33.026965+0000","last_became_peered":"2023-08-18T20:44:33.026965+0000","last_unstale":"2023-08-18T20:44:49.570433+0000","last_undegraded":"2023-08-18T20:44:49.570433+0000","last_fullsized":"2023-08-18T20:44:49.570433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:54:24.732218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567340+0000","last_change":"2023-08-18T20:44:34.030534+0000","last_active":"2023-08-18T20:44:49.567340+0000","last_peered":"2023-08-18T20:44:49.567340+0000","last_clean":"2023-08-18T20:44:49.567340+0000","last_became_active":"2023-08-18T20:44:34.029387+0000","last_became_peered":"2023-08-18T20:44:34.029387+0000","last_unstale":"2023-08-18T20:44:49.567340+0000","last_undegraded":"2023-08-18T20:44:49.567340+0000","last_fullsized":"2023-08-18T20:44:49.567340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:50:52.846958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569916+0000","last_change":"2023-08-18T20:44:47.075209+0000","last_active":"2023-08-18T20:44:49.569916+0000","last_peered":"2023-08-18T20:44:49.569916+0000","last_clean":"2023-08-18T20:44:49.569916+0000","last_became_active":"2023-08-18T20:44:47.074924+0000","last_became_peered":"2023-08-18T20:44:47.074924+0000","last_unstale":"2023-08-18T20:44:49.569916+0000","last_undegraded":"2023-08-18T20:44:49.569916+0000","last_fullsized":"2023-08-18T20:44:49.569916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:07.851397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567594+0000","last_change":"2023-08-18T20:44:48.097341+0000","last_active":"2023-08-18T20:44:49.567594+0000","last_peered":"2023-08-18T20:44:49.567594+0000","last_clean":"2023-08-18T20:44:49.567594+0000","last_became_active":"2023-08-18T20:44:48.097016+0000","last_became_peered":"2023-08-18T20:44:48.097016+0000","last_unstale":"2023-08-18T20:44:49.567594+0000","last_undegraded":"2023-08-18T20:44:49.567594+0000","last_fullsized":"2023-08-18T20:44:49.567594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:24.393465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078273+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:44:49.078273+0000","last_peered":"2023-08-18T20:44:49.078273+0000","last_clean":"2023-08-18T20:44:49.078273+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:44:49.078273+0000","last_undegraded":"2023-08-18T20:44:49.078273+0000","last_fullsized":"2023-08-18T20:44:49.078273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:21:31.333158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078273+0000","last_change":"2023-08-18T20:44:33.023657+0000","last_active":"2023-08-18T20:44:49.078273+0000","last_peered":"2023-08-18T20:44:49.078273+0000","last_clean":"2023-08-18T20:44:49.078273+0000","last_became_active":"2023-08-18T20:44:33.023348+0000","last_became_peered":"2023-08-18T20:44:33.023348+0000","last_unstale":"2023-08-18T20:44:49.078273+0000","last_undegraded":"2023-08-18T20:44:49.078273+0000","last_fullsized":"2023-08-18T20:44:49.078273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:46.507690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569477+0000","last_change":"2023-08-18T20:44:34.041399+0000","last_active":"2023-08-18T20:44:49.569477+0000","last_peered":"2023-08-18T20:44:49.569477+0000","last_clean":"2023-08-18T20:44:49.569477+0000","last_became_active":"2023-08-18T20:44:34.041120+0000","last_became_peered":"2023-08-18T20:44:34.041120+0000","last_unstale":"2023-08-18T20:44:49.569477+0000","last_undegraded":"2023-08-18T20:44:49.569477+0000","last_fullsized":"2023-08-18T20:44:49.569477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:59:47.910919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078725+0000","last_change":"2023-08-18T20:44:47.070129+0000","last_active":"2023-08-18T20:44:49.078725+0000","last_peered":"2023-08-18T20:44:49.078725+0000","last_clean":"2023-08-18T20:44:49.078725+0000","last_became_active":"2023-08-18T20:44:47.069866+0000","last_became_peered":"2023-08-18T20:44:47.069866+0000","last_unstale":"2023-08-18T20:44:49.078725+0000","last_undegraded":"2023-08-18T20:44:49.078725+0000","last_fullsized":"2023-08-18T20:44:49.078725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:02.357199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570259+0000","last_change":"2023-08-18T20:44:48.087114+0000","last_active":"2023-08-18T20:44:49.570259+0000","last_peered":"2023-08-18T20:44:49.570259+0000","last_clean":"2023-08-18T20:44:49.570259+0000","last_became_active":"2023-08-18T20:44:48.086878+0000","last_became_peered":"2023-08-18T20:44:48.086878+0000","last_unstale":"2023-08-18T20:44:49.570259+0000","last_undegraded":"2023-08-18T20:44:49.570259+0000","last_fullsized":"2023-08-18T20:44:49.570259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:49:02.967283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568376+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:44:49.568376+0000","last_peered":"2023-08-18T20:44:49.568376+0000","last_clean":"2023-08-18T20:44:49.568376+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:44:49.568376+0000","last_undegraded":"2023-08-18T20:44:49.568376+0000","last_fullsized":"2023-08-18T20:44:49.568376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:03:22.692301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568012+0000","last_change":"2023-08-18T20:44:33.018480+0000","last_active":"2023-08-18T20:44:49.568012+0000","last_peered":"2023-08-18T20:44:49.568012+0000","last_clean":"2023-08-18T20:44:49.568012+0000","last_became_active":"2023-08-18T20:44:33.018113+0000","last_became_peered":"2023-08-18T20:44:33.018113+0000","last_unstale":"2023-08-18T20:44:49.568012+0000","last_undegraded":"2023-08-18T20:44:49.568012+0000","last_fullsized":"2023-08-18T20:44:49.568012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:39:26.482882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569327+0000","last_change":"2023-08-18T20:44:34.024540+0000","last_active":"2023-08-18T20:44:49.569327+0000","last_peered":"2023-08-18T20:44:49.569327+0000","last_clean":"2023-08-18T20:44:49.569327+0000","last_became_active":"2023-08-18T20:44:34.024209+0000","last_became_peered":"2023-08-18T20:44:34.024209+0000","last_unstale":"2023-08-18T20:44:49.569327+0000","last_undegraded":"2023-08-18T20:44:49.569327+0000","last_fullsized":"2023-08-18T20:44:49.569327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:41:59.920334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078663+0000","last_change":"2023-08-18T20:44:47.078285+0000","last_active":"2023-08-18T20:44:49.078663+0000","last_peered":"2023-08-18T20:44:49.078663+0000","last_clean":"2023-08-18T20:44:49.078663+0000","last_became_active":"2023-08-18T20:44:47.078018+0000","last_became_peered":"2023-08-18T20:44:47.078018+0000","last_unstale":"2023-08-18T20:44:49.078663+0000","last_undegraded":"2023-08-18T20:44:49.078663+0000","last_fullsized":"2023-08-18T20:44:49.078663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:47:48.203761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314856+0000","last_change":"2023-08-18T20:44:48.090556+0000","last_active":"2023-08-18T20:44:49.314856+0000","last_peered":"2023-08-18T20:44:49.314856+0000","last_clean":"2023-08-18T20:44:49.314856+0000","last_became_active":"2023-08-18T20:44:48.090249+0000","last_became_peered":"2023-08-18T20:44:48.090249+0000","last_unstale":"2023-08-18T20:44:49.314856+0000","last_undegraded":"2023-08-18T20:44:49.314856+0000","last_fullsized":"2023-08-18T20:44:49.314856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079070+0000","last_change":"2023-08-18T20:44:33.026217+0000","last_active":"2023-08-18T20:44:49.079070+0000","last_peered":"2023-08-18T20:44:49.079070+0000","last_clean":"2023-08-18T20:44:49.079070+0000","last_became_active":"2023-08-18T20:44:33.025935+0000","last_became_peered":"2023-08-18T20:44:33.025935+0000","last_unstale":"2023-08-18T20:44:49.079070+0000","last_undegraded":"2023-08-18T20:44:49.079070+0000","last_fullsized":"2023-08-18T20:44:49.079070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:13:38.138152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078220+0000","last_change":"2023-08-18T20:44:34.033877+0000","last_active":"2023-08-18T20:44:49.078220+0000","last_peered":"2023-08-18T20:44:49.078220+0000","last_clean":"2023-08-18T20:44:49.078220+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:49.078220+0000","last_undegraded":"2023-08-18T20:44:49.078220+0000","last_fullsized":"2023-08-18T20:44:49.078220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:38.434404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077975+0000","last_change":"2023-08-18T20:44:47.075080+0000","last_active":"2023-08-18T20:44:49.077975+0000","last_peered":"2023-08-18T20:44:49.077975+0000","last_clean":"2023-08-18T20:44:49.077975+0000","last_became_active":"2023-08-18T20:44:47.074818+0000","last_became_peered":"2023-08-18T20:44:47.074818+0000","last_unstale":"2023-08-18T20:44:49.077975+0000","last_undegraded":"2023-08-18T20:44:49.077975+0000","last_fullsized":"2023-08-18T20:44:49.077975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:44.105600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077608+0000","last_change":"2023-08-18T20:44:48.082195+0000","last_active":"2023-08-18T20:44:49.077608+0000","last_peered":"2023-08-18T20:44:49.077608+0000","last_clean":"2023-08-18T20:44:49.077608+0000","last_became_active":"2023-08-18T20:44:48.081945+0000","last_became_peered":"2023-08-18T20:44:48.081945+0000","last_unstale":"2023-08-18T20:44:49.077608+0000","last_undegraded":"2023-08-18T20:44:49.077608+0000","last_fullsized":"2023-08-18T20:44:49.077608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:57:22.812695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568476+0000","last_change":"2023-08-18T20:44:33.018308+0000","last_active":"2023-08-18T20:44:49.568476+0000","last_peered":"2023-08-18T20:44:49.568476+0000","last_clean":"2023-08-18T20:44:49.568476+0000","last_became_active":"2023-08-18T20:44:33.018039+0000","last_became_peered":"2023-08-18T20:44:33.018039+0000","last_unstale":"2023-08-18T20:44:49.568476+0000","last_undegraded":"2023-08-18T20:44:49.568476+0000","last_fullsized":"2023-08-18T20:44:49.568476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:29.905031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570062+0000","last_change":"2023-08-18T20:44:34.038153+0000","last_active":"2023-08-18T20:44:49.570062+0000","last_peered":"2023-08-18T20:44:49.570062+0000","last_clean":"2023-08-18T20:44:49.570062+0000","last_became_active":"2023-08-18T20:44:34.037863+0000","last_became_peered":"2023-08-18T20:44:34.037863+0000","last_unstale":"2023-08-18T20:44:49.570062+0000","last_undegraded":"2023-08-18T20:44:49.570062+0000","last_fullsized":"2023-08-18T20:44:49.570062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:53.058978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567281+0000","last_change":"2023-08-18T20:44:47.079755+0000","last_active":"2023-08-18T20:44:49.567281+0000","last_peered":"2023-08-18T20:44:49.567281+0000","last_clean":"2023-08-18T20:44:49.567281+0000","last_became_active":"2023-08-18T20:44:47.079475+0000","last_became_peered":"2023-08-18T20:44:47.079475+0000","last_unstale":"2023-08-18T20:44:49.567281+0000","last_undegraded":"2023-08-18T20:44:49.567281+0000","last_fullsized":"2023-08-18T20:44:49.567281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:57:21.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569281+0000","last_change":"2023-08-18T20:44:48.082719+0000","last_active":"2023-08-18T20:44:49.569281+0000","last_peered":"2023-08-18T20:44:49.569281+0000","last_clean":"2023-08-18T20:44:49.569281+0000","last_became_active":"2023-08-18T20:44:48.082386+0000","last_became_peered":"2023-08-18T20:44:48.082386+0000","last_unstale":"2023-08-18T20:44:49.569281+0000","last_undegraded":"2023-08-18T20:44:49.569281+0000","last_fullsized":"2023-08-18T20:44:49.569281+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080109+0000","last_change":"2023-08-18T20:44:33.019769+0000","last_active":"2023-08-18T20:44:49.080109+0000","last_peered":"2023-08-18T20:44:49.080109+0000","last_clean":"2023-08-18T20:44:49.080109+0000","last_became_active":"2023-08-18T20:44:33.019217+0000","last_became_peered":"2023-08-18T20:44:33.019217+0000","last_unstale":"2023-08-18T20:44:49.080109+0000","last_undegraded":"2023-08-18T20:44:49.080109+0000","last_fullsized":"2023-08-18T20:44:49.080109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:55:53.475950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314695+0000","last_change":"2023-08-18T20:44:34.031444+0000","last_active":"2023-08-18T20:44:49.314695+0000","last_peered":"2023-08-18T20:44:49.314695+0000","last_clean":"2023-08-18T20:44:49.314695+0000","last_became_active":"2023-08-18T20:44:34.031203+0000","last_became_peered":"2023-08-18T20:44:34.031203+0000","last_unstale":"2023-08-18T20:44:49.314695+0000","last_undegraded":"2023-08-18T20:44:49.314695+0000","last_fullsized":"2023-08-18T20:44:49.314695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:57:39.626842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079461+0000","last_change":"2023-08-18T20:44:47.075035+0000","last_active":"2023-08-18T20:44:49.079461+0000","last_peered":"2023-08-18T20:44:49.079461+0000","last_clean":"2023-08-18T20:44:49.079461+0000","last_became_active":"2023-08-18T20:44:47.074771+0000","last_became_peered":"2023-08-18T20:44:47.074771+0000","last_unstale":"2023-08-18T20:44:49.079461+0000","last_undegraded":"2023-08-18T20:44:49.079461+0000","last_fullsized":"2023-08-18T20:44:49.079461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:33:23.520359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567799+0000","last_change":"2023-08-18T20:44:48.087687+0000","last_active":"2023-08-18T20:44:49.567799+0000","last_peered":"2023-08-18T20:44:49.567799+0000","last_clean":"2023-08-18T20:44:49.567799+0000","last_became_active":"2023-08-18T20:44:48.087435+0000","last_became_peered":"2023-08-18T20:44:48.087435+0000","last_unstale":"2023-08-18T20:44:49.567799+0000","last_undegraded":"2023-08-18T20:44:49.567799+0000","last_fullsized":"2023-08-18T20:44:49.567799+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080203+0000","last_change":"2023-08-18T20:44:33.019071+0000","last_active":"2023-08-18T20:44:49.080203+0000","last_peered":"2023-08-18T20:44:49.080203+0000","last_clean":"2023-08-18T20:44:49.080203+0000","last_became_active":"2023-08-18T20:44:33.018740+0000","last_became_peered":"2023-08-18T20:44:33.018740+0000","last_unstale":"2023-08-18T20:44:49.080203+0000","last_undegraded":"2023-08-18T20:44:49.080203+0000","last_fullsized":"2023-08-18T20:44:49.080203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:12:21.656026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568012+0000","last_change":"2023-08-18T20:44:34.034097+0000","last_active":"2023-08-18T20:44:49.568012+0000","last_peered":"2023-08-18T20:44:49.568012+0000","last_clean":"2023-08-18T20:44:49.568012+0000","last_became_active":"2023-08-18T20:44:34.033428+0000","last_became_peered":"2023-08-18T20:44:34.033428+0000","last_unstale":"2023-08-18T20:44:49.568012+0000","last_undegraded":"2023-08-18T20:44:49.568012+0000","last_fullsized":"2023-08-18T20:44:49.568012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:17:10.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314605+0000","last_change":"2023-08-18T20:44:47.085380+0000","last_active":"2023-08-18T20:44:49.314605+0000","last_peered":"2023-08-18T20:44:49.314605+0000","last_clean":"2023-08-18T20:44:49.314605+0000","last_became_active":"2023-08-18T20:44:47.084974+0000","last_became_peered":"2023-08-18T20:44:47.084974+0000","last_unstale":"2023-08-18T20:44:49.314605+0000","last_undegraded":"2023-08-18T20:44:49.314605+0000","last_fullsized":"2023-08-18T20:44:49.314605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:20.705015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315433+0000","last_change":"2023-08-18T20:44:48.081010+0000","last_active":"2023-08-18T20:44:49.315433+0000","last_peered":"2023-08-18T20:44:49.315433+0000","last_clean":"2023-08-18T20:44:49.315433+0000","last_became_active":"2023-08-18T20:44:48.080662+0000","last_became_peered":"2023-08-18T20:44:48.080662+0000","last_unstale":"2023-08-18T20:44:49.315433+0000","last_undegraded":"2023-08-18T20:44:49.315433+0000","last_fullsized":"2023-08-18T20:44:49.315433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:13:56.473474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567363+0000","last_change":"2023-08-18T20:44:33.014369+0000","last_active":"2023-08-18T20:44:49.567363+0000","last_peered":"2023-08-18T20:44:49.567363+0000","last_clean":"2023-08-18T20:44:49.567363+0000","last_became_active":"2023-08-18T20:44:33.014077+0000","last_became_peered":"2023-08-18T20:44:33.014077+0000","last_unstale":"2023-08-18T20:44:49.567363+0000","last_undegraded":"2023-08-18T20:44:49.567363+0000","last_fullsized":"2023-08-18T20:44:49.567363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:26.719601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081427+0000","last_change":"2023-08-18T20:44:34.028091+0000","last_active":"2023-08-18T20:44:49.081427+0000","last_peered":"2023-08-18T20:44:49.081427+0000","last_clean":"2023-08-18T20:44:49.081427+0000","last_became_active":"2023-08-18T20:44:34.027238+0000","last_became_peered":"2023-08-18T20:44:34.027238+0000","last_unstale":"2023-08-18T20:44:49.081427+0000","last_undegraded":"2023-08-18T20:44:49.081427+0000","last_fullsized":"2023-08-18T20:44:49.081427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:55:44.107172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.081292+0000","last_change":"2023-08-18T20:44:47.080082+0000","last_active":"2023-08-18T20:44:49.081292+0000","last_peered":"2023-08-18T20:44:49.081292+0000","last_clean":"2023-08-18T20:44:49.081292+0000","last_became_active":"2023-08-18T20:44:47.079820+0000","last_became_peered":"2023-08-18T20:44:47.079820+0000","last_unstale":"2023-08-18T20:44:49.081292+0000","last_undegraded":"2023-08-18T20:44:49.081292+0000","last_fullsized":"2023-08-18T20:44:49.081292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:45:32.395157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567093+0000","last_change":"2023-08-18T20:44:48.089995+0000","last_active":"2023-08-18T20:44:49.567093+0000","last_peered":"2023-08-18T20:44:49.567093+0000","last_clean":"2023-08-18T20:44:49.567093+0000","last_became_active":"2023-08-18T20:44:48.089682+0000","last_became_peered":"2023-08-18T20:44:48.089682+0000","last_unstale":"2023-08-18T20:44:49.567093+0000","last_undegraded":"2023-08-18T20:44:49.567093+0000","last_fullsized":"2023-08-18T20:44:49.567093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:10:28.195656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080707+0000","last_change":"2023-08-18T20:44:33.021046+0000","last_active":"2023-08-18T20:44:49.080707+0000","last_peered":"2023-08-18T20:44:49.080707+0000","last_clean":"2023-08-18T20:44:49.080707+0000","last_became_active":"2023-08-18T20:44:33.020762+0000","last_became_peered":"2023-08-18T20:44:33.020762+0000","last_unstale":"2023-08-18T20:44:49.080707+0000","last_undegraded":"2023-08-18T20:44:49.080707+0000","last_fullsized":"2023-08-18T20:44:49.080707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:00:22.996680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568736+0000","last_change":"2023-08-18T20:44:34.024728+0000","last_active":"2023-08-18T20:44:49.568736+0000","last_peered":"2023-08-18T20:44:49.568736+0000","last_clean":"2023-08-18T20:44:49.568736+0000","last_became_active":"2023-08-18T20:44:34.024430+0000","last_became_peered":"2023-08-18T20:44:34.024430+0000","last_unstale":"2023-08-18T20:44:49.568736+0000","last_undegraded":"2023-08-18T20:44:49.568736+0000","last_fullsized":"2023-08-18T20:44:49.568736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:29:35.606097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315615+0000","last_change":"2023-08-18T20:44:47.085149+0000","last_active":"2023-08-18T20:44:49.315615+0000","last_peered":"2023-08-18T20:44:49.315615+0000","last_clean":"2023-08-18T20:44:49.315615+0000","last_became_active":"2023-08-18T20:44:47.084745+0000","last_became_peered":"2023-08-18T20:44:47.084745+0000","last_unstale":"2023-08-18T20:44:49.315615+0000","last_undegraded":"2023-08-18T20:44:49.315615+0000","last_fullsized":"2023-08-18T20:44:49.315615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:43:01.487731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078850+0000","last_change":"2023-08-18T20:44:48.082724+0000","last_active":"2023-08-18T20:44:49.078850+0000","last_peered":"2023-08-18T20:44:49.078850+0000","last_clean":"2023-08-18T20:44:49.078850+0000","last_became_active":"2023-08-18T20:44:48.082284+0000","last_became_peered":"2023-08-18T20:44:48.082284+0000","last_unstale":"2023-08-18T20:44:49.078850+0000","last_undegraded":"2023-08-18T20:44:49.078850+0000","last_fullsized":"2023-08-18T20:44:49.078850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:00:01.967814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568479+0000","last_change":"2023-08-18T20:44:33.024362+0000","last_active":"2023-08-18T20:44:49.568479+0000","last_peered":"2023-08-18T20:44:49.568479+0000","last_clean":"2023-08-18T20:44:49.568479+0000","last_became_active":"2023-08-18T20:44:33.024076+0000","last_became_peered":"2023-08-18T20:44:33.024076+0000","last_unstale":"2023-08-18T20:44:49.568479+0000","last_undegraded":"2023-08-18T20:44:49.568479+0000","last_fullsized":"2023-08-18T20:44:49.568479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:52.053973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570115+0000","last_change":"2023-08-18T20:44:34.038753+0000","last_active":"2023-08-18T20:44:49.570115+0000","last_peered":"2023-08-18T20:44:49.570115+0000","last_clean":"2023-08-18T20:44:49.570115+0000","last_became_active":"2023-08-18T20:44:34.038482+0000","last_became_peered":"2023-08-18T20:44:34.038482+0000","last_unstale":"2023-08-18T20:44:49.570115+0000","last_undegraded":"2023-08-18T20:44:49.570115+0000","last_fullsized":"2023-08-18T20:44:49.570115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:59.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078748+0000","last_change":"2023-08-18T20:44:47.081221+0000","last_active":"2023-08-18T20:44:49.078748+0000","last_peered":"2023-08-18T20:44:49.078748+0000","last_clean":"2023-08-18T20:44:49.078748+0000","last_became_active":"2023-08-18T20:44:47.080932+0000","last_became_peered":"2023-08-18T20:44:47.080932+0000","last_unstale":"2023-08-18T20:44:49.078748+0000","last_undegraded":"2023-08-18T20:44:49.078748+0000","last_fullsized":"2023-08-18T20:44:49.078748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:55:25.362311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567292+0000","last_change":"2023-08-18T20:44:48.074356+0000","last_active":"2023-08-18T20:44:49.567292+0000","last_peered":"2023-08-18T20:44:49.567292+0000","last_clean":"2023-08-18T20:44:49.567292+0000","last_became_active":"2023-08-18T20:44:48.074087+0000","last_became_peered":"2023-08-18T20:44:48.074087+0000","last_unstale":"2023-08-18T20:44:49.567292+0000","last_undegraded":"2023-08-18T20:44:49.567292+0000","last_fullsized":"2023-08-18T20:44:49.567292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:57:27.612365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570553+0000","last_change":"2023-08-18T20:44:33.024621+0000","last_active":"2023-08-18T20:44:49.570553+0000","last_peered":"2023-08-18T20:44:49.570553+0000","last_clean":"2023-08-18T20:44:49.570553+0000","last_became_active":"2023-08-18T20:44:33.024308+0000","last_became_peered":"2023-08-18T20:44:33.024308+0000","last_unstale":"2023-08-18T20:44:49.570553+0000","last_undegraded":"2023-08-18T20:44:49.570553+0000","last_fullsized":"2023-08-18T20:44:49.570553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:17:47.436741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079176+0000","last_change":"2023-08-18T20:44:34.036122+0000","last_active":"2023-08-18T20:44:49.079176+0000","last_peered":"2023-08-18T20:44:49.079176+0000","last_clean":"2023-08-18T20:44:49.079176+0000","last_became_active":"2023-08-18T20:44:34.035841+0000","last_became_peered":"2023-08-18T20:44:34.035841+0000","last_unstale":"2023-08-18T20:44:49.079176+0000","last_undegraded":"2023-08-18T20:44:49.079176+0000","last_fullsized":"2023-08-18T20:44:49.079176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:04:27.817885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077780+0000","last_change":"2023-08-18T20:44:47.085143+0000","last_active":"2023-08-18T20:44:49.077780+0000","last_peered":"2023-08-18T20:44:49.077780+0000","last_clean":"2023-08-18T20:44:49.077780+0000","last_became_active":"2023-08-18T20:44:47.084826+0000","last_became_peered":"2023-08-18T20:44:47.084826+0000","last_unstale":"2023-08-18T20:44:49.077780+0000","last_undegraded":"2023-08-18T20:44:49.077780+0000","last_fullsized":"2023-08-18T20:44:49.077780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:05.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568191+0000","last_change":"2023-08-18T20:44:48.090848+0000","last_active":"2023-08-18T20:44:49.568191+0000","last_peered":"2023-08-18T20:44:49.568191+0000","last_clean":"2023-08-18T20:44:49.568191+0000","last_became_active":"2023-08-18T20:44:48.090264+0000","last_became_peered":"2023-08-18T20:44:48.090264+0000","last_unstale":"2023-08-18T20:44:49.568191+0000","last_undegraded":"2023-08-18T20:44:49.568191+0000","last_fullsized":"2023-08-18T20:44:49.568191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:52.081333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315246+0000","last_change":"2023-08-18T20:44:48.095390+0000","last_active":"2023-08-18T20:44:49.315246+0000","last_peered":"2023-08-18T20:44:49.315246+0000","last_clean":"2023-08-18T20:44:49.315246+0000","last_became_active":"2023-08-18T20:44:48.095072+0000","last_became_peered":"2023-08-18T20:44:48.095072+0000","last_unstale":"2023-08-18T20:44:49.315246+0000","last_undegraded":"2023-08-18T20:44:49.315246+0000","last_fullsized":"2023-08-18T20:44:49.315246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:06.639831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"32'8","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567993+0000","last_change":"2023-08-18T20:44:33.017668+0000","last_active":"2023-08-18T20:44:49.567993+0000","last_peered":"2023-08-18T20:44:49.567993+0000","last_clean":"2023-08-18T20:44:49.567993+0000","last_became_active":"2023-08-18T20:44:33.017412+0000","last_became_peered":"2023-08-18T20:44:33.017412+0000","last_unstale":"2023-08-18T20:44:49.567993+0000","last_undegraded":"2023-08-18T20:44:49.567993+0000","last_fullsized":"2023-08-18T20:44:49.567993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079732+0000","last_change":"2023-08-18T20:44:34.026185+0000","last_active":"2023-08-18T20:44:49.079732+0000","last_peered":"2023-08-18T20:44:49.079732+0000","last_clean":"2023-08-18T20:44:49.079732+0000","last_became_active":"2023-08-18T20:44:34.025913+0000","last_became_peered":"2023-08-18T20:44:34.025913+0000","last_unstale":"2023-08-18T20:44:49.079732+0000","last_undegraded":"2023-08-18T20:44:49.079732+0000","last_fullsized":"2023-08-18T20:44:49.079732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:40:54.800266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078741+0000","last_change":"2023-08-18T20:44:47.085267+0000","last_active":"2023-08-18T20:44:49.078741+0000","last_peered":"2023-08-18T20:44:49.078741+0000","last_clean":"2023-08-18T20:44:49.078741+0000","last_became_active":"2023-08-18T20:44:47.084983+0000","last_became_peered":"2023-08-18T20:44:47.084983+0000","last_unstale":"2023-08-18T20:44:49.078741+0000","last_undegraded":"2023-08-18T20:44:49.078741+0000","last_fullsized":"2023-08-18T20:44:49.078741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:00.342428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077473+0000","last_change":"2023-08-18T20:44:33.015018+0000","last_active":"2023-08-18T20:44:49.077473+0000","last_peered":"2023-08-18T20:44:49.077473+0000","last_clean":"2023-08-18T20:44:49.077473+0000","last_became_active":"2023-08-18T20:44:33.014608+0000","last_became_peered":"2023-08-18T20:44:33.014608+0000","last_unstale":"2023-08-18T20:44:49.077473+0000","last_undegraded":"2023-08-18T20:44:49.077473+0000","last_fullsized":"2023-08-18T20:44:49.077473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:40:10.634354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568258+0000","last_change":"2023-08-18T20:44:34.030543+0000","last_active":"2023-08-18T20:44:49.568258+0000","last_peered":"2023-08-18T20:44:49.568258+0000","last_clean":"2023-08-18T20:44:49.568258+0000","last_became_active":"2023-08-18T20:44:34.030260+0000","last_became_peered":"2023-08-18T20:44:34.030260+0000","last_unstale":"2023-08-18T20:44:49.568258+0000","last_undegraded":"2023-08-18T20:44:49.568258+0000","last_fullsized":"2023-08-18T20:44:49.568258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:21:09.746484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315096+0000","last_change":"2023-08-18T20:44:47.082756+0000","last_active":"2023-08-18T20:44:49.315096+0000","last_peered":"2023-08-18T20:44:49.315096+0000","last_clean":"2023-08-18T20:44:49.315096+0000","last_became_active":"2023-08-18T20:44:47.082215+0000","last_became_peered":"2023-08-18T20:44:47.082215+0000","last_unstale":"2023-08-18T20:44:49.315096+0000","last_undegraded":"2023-08-18T20:44:49.315096+0000","last_fullsized":"2023-08-18T20:44:49.315096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:35.048626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568688+0000","last_change":"2023-08-18T20:44:48.085105+0000","last_active":"2023-08-18T20:44:49.568688+0000","last_peered":"2023-08-18T20:44:49.568688+0000","last_clean":"2023-08-18T20:44:49.568688+0000","last_became_active":"2023-08-18T20:44:48.084470+0000","last_became_peered":"2023-08-18T20:44:48.084470+0000","last_unstale":"2023-08-18T20:44:49.568688+0000","last_undegraded":"2023-08-18T20:44:49.568688+0000","last_fullsized":"2023-08-18T20:44:49.568688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:16.936791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315767+0000","last_change":"2023-08-18T20:44:48.081649+0000","last_active":"2023-08-18T20:44:49.315767+0000","last_peered":"2023-08-18T20:44:49.315767+0000","last_clean":"2023-08-18T20:44:49.315767+0000","last_became_active":"2023-08-18T20:44:48.081451+0000","last_became_peered":"2023-08-18T20:44:48.081451+0000","last_unstale":"2023-08-18T20:44:49.315767+0000","last_undegraded":"2023-08-18T20:44:49.315767+0000","last_fullsized":"2023-08-18T20:44:49.315767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:32.209987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567503+0000","last_change":"2023-08-18T20:44:33.025091+0000","last_active":"2023-08-18T20:44:49.567503+0000","last_peered":"2023-08-18T20:44:49.567503+0000","last_clean":"2023-08-18T20:44:49.567503+0000","last_became_active":"2023-08-18T20:44:33.024761+0000","last_became_peered":"2023-08-18T20:44:33.024761+0000","last_unstale":"2023-08-18T20:44:49.567503+0000","last_undegraded":"2023-08-18T20:44:49.567503+0000","last_fullsized":"2023-08-18T20:44:49.567503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:06.648878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077837+0000","last_change":"2023-08-18T20:44:34.022337+0000","last_active":"2023-08-18T20:44:49.077837+0000","last_peered":"2023-08-18T20:44:49.077837+0000","last_clean":"2023-08-18T20:44:49.077837+0000","last_became_active":"2023-08-18T20:44:34.021383+0000","last_became_peered":"2023-08-18T20:44:34.021383+0000","last_unstale":"2023-08-18T20:44:49.077837+0000","last_undegraded":"2023-08-18T20:44:49.077837+0000","last_fullsized":"2023-08-18T20:44:49.077837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:42:22.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078601+0000","last_change":"2023-08-18T20:44:47.075736+0000","last_active":"2023-08-18T20:44:49.078601+0000","last_peered":"2023-08-18T20:44:49.078601+0000","last_clean":"2023-08-18T20:44:49.078601+0000","last_became_active":"2023-08-18T20:44:47.074145+0000","last_became_peered":"2023-08-18T20:44:47.074145+0000","last_unstale":"2023-08-18T20:44:49.078601+0000","last_undegraded":"2023-08-18T20:44:49.078601+0000","last_fullsized":"2023-08-18T20:44:49.078601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:41.798382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079087+0000","last_change":"2023-08-18T20:44:48.086355+0000","last_active":"2023-08-18T20:44:49.079087+0000","last_peered":"2023-08-18T20:44:49.079087+0000","last_clean":"2023-08-18T20:44:49.079087+0000","last_became_active":"2023-08-18T20:44:48.086053+0000","last_became_peered":"2023-08-18T20:44:48.086053+0000","last_unstale":"2023-08-18T20:44:49.079087+0000","last_undegraded":"2023-08-18T20:44:49.079087+0000","last_fullsized":"2023-08-18T20:44:49.079087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:36.514048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077949+0000","last_change":"2023-08-18T20:44:33.023196+0000","last_active":"2023-08-18T20:44:49.077949+0000","last_peered":"2023-08-18T20:44:49.077949+0000","last_clean":"2023-08-18T20:44:49.077949+0000","last_became_active":"2023-08-18T20:44:33.022770+0000","last_became_peered":"2023-08-18T20:44:33.022770+0000","last_unstale":"2023-08-18T20:44:49.077949+0000","last_undegraded":"2023-08-18T20:44:49.077949+0000","last_fullsized":"2023-08-18T20:44:49.077949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314504+0000","last_change":"2023-08-18T20:44:34.029945+0000","last_active":"2023-08-18T20:44:49.314504+0000","last_peered":"2023-08-18T20:44:49.314504+0000","last_clean":"2023-08-18T20:44:49.314504+0000","last_became_active":"2023-08-18T20:44:34.029672+0000","last_became_peered":"2023-08-18T20:44:34.029672+0000","last_unstale":"2023-08-18T20:44:49.314504+0000","last_undegraded":"2023-08-18T20:44:49.314504+0000","last_fullsized":"2023-08-18T20:44:49.314504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:13.126133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568845+0000","last_change":"2023-08-18T20:44:47.083159+0000","last_active":"2023-08-18T20:44:49.568845+0000","last_peered":"2023-08-18T20:44:49.568845+0000","last_clean":"2023-08-18T20:44:49.568845+0000","last_became_active":"2023-08-18T20:44:47.082845+0000","last_became_peered":"2023-08-18T20:44:47.082845+0000","last_unstale":"2023-08-18T20:44:49.568845+0000","last_undegraded":"2023-08-18T20:44:49.568845+0000","last_fullsized":"2023-08-18T20:44:49.568845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:47:48.203761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"33'9","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079368+0000","last_change":"2023-08-18T20:44:33.018436+0000","last_active":"2023-08-18T20:44:49.079368+0000","last_peered":"2023-08-18T20:44:49.079368+0000","last_clean":"2023-08-18T20:44:49.079368+0000","last_became_active":"2023-08-18T20:44:33.018118+0000","last_became_peered":"2023-08-18T20:44:33.018118+0000","last_unstale":"2023-08-18T20:44:49.079368+0000","last_undegraded":"2023-08-18T20:44:49.079368+0000","last_fullsized":"2023-08-18T20:44:49.079368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:28.953739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568792+0000","last_change":"2023-08-18T20:44:34.033222+0000","last_active":"2023-08-18T20:44:49.568792+0000","last_peered":"2023-08-18T20:44:49.568792+0000","last_clean":"2023-08-18T20:44:49.568792+0000","last_became_active":"2023-08-18T20:44:34.029577+0000","last_became_peered":"2023-08-18T20:44:34.029577+0000","last_unstale":"2023-08-18T20:44:49.568792+0000","last_undegraded":"2023-08-18T20:44:49.568792+0000","last_fullsized":"2023-08-18T20:44:49.568792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:59.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568905+0000","last_change":"2023-08-18T20:44:47.085732+0000","last_active":"2023-08-18T20:44:49.568905+0000","last_peered":"2023-08-18T20:44:49.568905+0000","last_clean":"2023-08-18T20:44:49.568905+0000","last_became_active":"2023-08-18T20:44:47.085433+0000","last_became_peered":"2023-08-18T20:44:47.085433+0000","last_unstale":"2023-08-18T20:44:49.568905+0000","last_undegraded":"2023-08-18T20:44:49.568905+0000","last_fullsized":"2023-08-18T20:44:49.568905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:39:28.226476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570026+0000","last_change":"2023-08-18T20:44:48.082524+0000","last_active":"2023-08-18T20:44:49.570026+0000","last_peered":"2023-08-18T20:44:49.570026+0000","last_clean":"2023-08-18T20:44:49.570026+0000","last_became_active":"2023-08-18T20:44:48.082189+0000","last_became_peered":"2023-08-18T20:44:48.082189+0000","last_unstale":"2023-08-18T20:44:49.570026+0000","last_undegraded":"2023-08-18T20:44:49.570026+0000","last_fullsized":"2023-08-18T20:44:49.570026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:43:02.493496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"32'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570385+0000","last_change":"2023-08-18T20:44:33.027297+0000","last_active":"2023-08-18T20:44:49.570385+0000","last_peered":"2023-08-18T20:44:49.570385+0000","last_clean":"2023-08-18T20:44:49.570385+0000","last_became_active":"2023-08-18T20:44:33.027041+0000","last_became_peered":"2023-08-18T20:44:33.027041+0000","last_unstale":"2023-08-18T20:44:49.570385+0000","last_undegraded":"2023-08-18T20:44:49.570385+0000","last_fullsized":"2023-08-18T20:44:49.570385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:38:18.627807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315482+0000","last_change":"2023-08-18T20:44:34.031434+0000","last_active":"2023-08-18T20:44:49.315482+0000","last_peered":"2023-08-18T20:44:49.315482+0000","last_clean":"2023-08-18T20:44:49.315482+0000","last_became_active":"2023-08-18T20:44:34.031169+0000","last_became_peered":"2023-08-18T20:44:34.031169+0000","last_unstale":"2023-08-18T20:44:49.315482+0000","last_undegraded":"2023-08-18T20:44:49.315482+0000","last_fullsized":"2023-08-18T20:44:49.315482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:02.879896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569513+0000","last_change":"2023-08-18T20:44:47.079918+0000","last_active":"2023-08-18T20:44:49.569513+0000","last_peered":"2023-08-18T20:44:49.569513+0000","last_clean":"2023-08-18T20:44:49.569513+0000","last_became_active":"2023-08-18T20:44:47.079619+0000","last_became_peered":"2023-08-18T20:44:47.079619+0000","last_unstale":"2023-08-18T20:44:49.569513+0000","last_undegraded":"2023-08-18T20:44:49.569513+0000","last_fullsized":"2023-08-18T20:44:49.569513+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:32.445444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567565+0000","last_change":"2023-08-18T20:44:48.091462+0000","last_active":"2023-08-18T20:44:49.567565+0000","last_peered":"2023-08-18T20:44:49.567565+0000","last_clean":"2023-08-18T20:44:49.567565+0000","last_became_active":"2023-08-18T20:44:48.091137+0000","last_became_peered":"2023-08-18T20:44:48.091137+0000","last_unstale":"2023-08-18T20:44:49.567565+0000","last_undegraded":"2023-08-18T20:44:49.567565+0000","last_fullsized":"2023-08-18T20:44:49.567565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:13:56.473474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568801+0000","last_change":"2023-08-18T20:44:33.026961+0000","last_active":"2023-08-18T20:44:49.568801+0000","last_peered":"2023-08-18T20:44:49.568801+0000","last_clean":"2023-08-18T20:44:49.568801+0000","last_became_active":"2023-08-18T20:44:33.026702+0000","last_became_peered":"2023-08-18T20:44:33.026702+0000","last_unstale":"2023-08-18T20:44:49.568801+0000","last_undegraded":"2023-08-18T20:44:49.568801+0000","last_fullsized":"2023-08-18T20:44:49.568801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:52.704427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569445+0000","last_change":"2023-08-18T20:44:34.040558+0000","last_active":"2023-08-18T20:44:49.569445+0000","last_peered":"2023-08-18T20:44:49.569445+0000","last_clean":"2023-08-18T20:44:49.569445+0000","last_became_active":"2023-08-18T20:44:34.040167+0000","last_became_peered":"2023-08-18T20:44:34.040167+0000","last_unstale":"2023-08-18T20:44:49.569445+0000","last_undegraded":"2023-08-18T20:44:49.569445+0000","last_fullsized":"2023-08-18T20:44:49.569445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:47:15.980006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078440+0000","last_change":"2023-08-18T20:44:47.076028+0000","last_active":"2023-08-18T20:44:49.078440+0000","last_peered":"2023-08-18T20:44:49.078440+0000","last_clean":"2023-08-18T20:44:49.078440+0000","last_became_active":"2023-08-18T20:44:47.075780+0000","last_became_peered":"2023-08-18T20:44:47.075780+0000","last_unstale":"2023-08-18T20:44:49.078440+0000","last_undegraded":"2023-08-18T20:44:49.078440+0000","last_fullsized":"2023-08-18T20:44:49.078440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:32.339755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568196+0000","last_change":"2023-08-18T20:44:48.097154+0000","last_active":"2023-08-18T20:44:49.568196+0000","last_peered":"2023-08-18T20:44:49.568196+0000","last_clean":"2023-08-18T20:44:49.568196+0000","last_became_active":"2023-08-18T20:44:48.096913+0000","last_became_peered":"2023-08-18T20:44:48.096913+0000","last_unstale":"2023-08-18T20:44:49.568196+0000","last_undegraded":"2023-08-18T20:44:49.568196+0000","last_fullsized":"2023-08-18T20:44:49.568196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078670+0000","last_change":"2023-08-18T20:44:33.024320+0000","last_active":"2023-08-18T20:44:49.078670+0000","last_peered":"2023-08-18T20:44:49.078670+0000","last_clean":"2023-08-18T20:44:49.078670+0000","last_became_active":"2023-08-18T20:44:33.024071+0000","last_became_peered":"2023-08-18T20:44:33.024071+0000","last_unstale":"2023-08-18T20:44:49.078670+0000","last_undegraded":"2023-08-18T20:44:49.078670+0000","last_fullsized":"2023-08-18T20:44:49.078670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:18.389307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080536+0000","last_change":"2023-08-18T20:44:34.027684+0000","last_active":"2023-08-18T20:44:49.080536+0000","last_peered":"2023-08-18T20:44:49.080536+0000","last_clean":"2023-08-18T20:44:49.080536+0000","last_became_active":"2023-08-18T20:44:34.027293+0000","last_became_peered":"2023-08-18T20:44:34.027293+0000","last_unstale":"2023-08-18T20:44:49.080536+0000","last_undegraded":"2023-08-18T20:44:49.080536+0000","last_fullsized":"2023-08-18T20:44:49.080536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:30:55.131499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569669+0000","last_change":"2023-08-18T20:44:47.077497+0000","last_active":"2023-08-18T20:44:49.569669+0000","last_peered":"2023-08-18T20:44:49.569669+0000","last_clean":"2023-08-18T20:44:49.569669+0000","last_became_active":"2023-08-18T20:44:47.076902+0000","last_became_peered":"2023-08-18T20:44:47.076902+0000","last_unstale":"2023-08-18T20:44:49.569669+0000","last_undegraded":"2023-08-18T20:44:49.569669+0000","last_fullsized":"2023-08-18T20:44:49.569669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:35.508283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314863+0000","last_change":"2023-08-18T20:44:48.090548+0000","last_active":"2023-08-18T20:44:49.314863+0000","last_peered":"2023-08-18T20:44:49.314863+0000","last_clean":"2023-08-18T20:44:49.314863+0000","last_became_active":"2023-08-18T20:44:48.090221+0000","last_became_peered":"2023-08-18T20:44:48.090221+0000","last_unstale":"2023-08-18T20:44:49.314863+0000","last_undegraded":"2023-08-18T20:44:49.314863+0000","last_fullsized":"2023-08-18T20:44:49.314863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:44.567470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567675+0000","last_change":"2023-08-18T20:44:33.017556+0000","last_active":"2023-08-18T20:44:49.567675+0000","last_peered":"2023-08-18T20:44:49.567675+0000","last_clean":"2023-08-18T20:44:49.567675+0000","last_became_active":"2023-08-18T20:44:33.017249+0000","last_became_peered":"2023-08-18T20:44:33.017249+0000","last_unstale":"2023-08-18T20:44:49.567675+0000","last_undegraded":"2023-08-18T20:44:49.567675+0000","last_fullsized":"2023-08-18T20:44:49.567675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:21.316899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078115+0000","last_change":"2023-08-18T20:44:34.034087+0000","last_active":"2023-08-18T20:44:49.078115+0000","last_peered":"2023-08-18T20:44:49.078115+0000","last_clean":"2023-08-18T20:44:49.078115+0000","last_became_active":"2023-08-18T20:44:34.033793+0000","last_became_peered":"2023-08-18T20:44:34.033793+0000","last_unstale":"2023-08-18T20:44:49.078115+0000","last_undegraded":"2023-08-18T20:44:49.078115+0000","last_fullsized":"2023-08-18T20:44:49.078115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:17:10.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567738+0000","last_change":"2023-08-18T20:44:47.085167+0000","last_active":"2023-08-18T20:44:49.567738+0000","last_peered":"2023-08-18T20:44:49.567738+0000","last_clean":"2023-08-18T20:44:49.567738+0000","last_became_active":"2023-08-18T20:44:47.084842+0000","last_became_peered":"2023-08-18T20:44:47.084842+0000","last_unstale":"2023-08-18T20:44:49.567738+0000","last_undegraded":"2023-08-18T20:44:49.567738+0000","last_fullsized":"2023-08-18T20:44:49.567738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:19.820137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569092+0000","last_change":"2023-08-18T20:44:48.093570+0000","last_active":"2023-08-18T20:44:49.569092+0000","last_peered":"2023-08-18T20:44:49.569092+0000","last_clean":"2023-08-18T20:44:49.569092+0000","last_became_active":"2023-08-18T20:44:48.093239+0000","last_became_peered":"2023-08-18T20:44:48.093239+0000","last_unstale":"2023-08-18T20:44:49.569092+0000","last_undegraded":"2023-08-18T20:44:49.569092+0000","last_fullsized":"2023-08-18T20:44:49.569092+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:46:11.190341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567243+0000","last_change":"2023-08-18T20:44:33.025059+0000","last_active":"2023-08-18T20:44:49.567243+0000","last_peered":"2023-08-18T20:44:49.567243+0000","last_clean":"2023-08-18T20:44:49.567243+0000","last_became_active":"2023-08-18T20:44:33.024788+0000","last_became_peered":"2023-08-18T20:44:33.024788+0000","last_unstale":"2023-08-18T20:44:49.567243+0000","last_undegraded":"2023-08-18T20:44:49.567243+0000","last_fullsized":"2023-08-18T20:44:49.567243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:18.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569202+0000","last_change":"2023-08-18T20:44:34.028867+0000","last_active":"2023-08-18T20:44:49.569202+0000","last_peered":"2023-08-18T20:44:49.569202+0000","last_clean":"2023-08-18T20:44:49.569202+0000","last_became_active":"2023-08-18T20:44:34.028594+0000","last_became_peered":"2023-08-18T20:44:34.028594+0000","last_unstale":"2023-08-18T20:44:49.569202+0000","last_undegraded":"2023-08-18T20:44:49.569202+0000","last_fullsized":"2023-08-18T20:44:49.569202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:48:48.910388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314900+0000","last_change":"2023-08-18T20:44:47.082923+0000","last_active":"2023-08-18T20:44:49.314900+0000","last_peered":"2023-08-18T20:44:49.314900+0000","last_clean":"2023-08-18T20:44:49.314900+0000","last_became_active":"2023-08-18T20:44:47.082513+0000","last_became_peered":"2023-08-18T20:44:47.082513+0000","last_unstale":"2023-08-18T20:44:49.314900+0000","last_undegraded":"2023-08-18T20:44:49.314900+0000","last_fullsized":"2023-08-18T20:44:49.314900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:35.448224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569662+0000","last_change":"2023-08-18T20:44:48.090571+0000","last_active":"2023-08-18T20:44:49.569662+0000","last_peered":"2023-08-18T20:44:49.569662+0000","last_clean":"2023-08-18T20:44:49.569662+0000","last_became_active":"2023-08-18T20:44:48.090276+0000","last_became_peered":"2023-08-18T20:44:48.090276+0000","last_unstale":"2023-08-18T20:44:49.569662+0000","last_undegraded":"2023-08-18T20:44:49.569662+0000","last_fullsized":"2023-08-18T20:44:49.569662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:02:11.097041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568616+0000","last_change":"2023-08-18T20:44:33.021201+0000","last_active":"2023-08-18T20:44:49.568616+0000","last_peered":"2023-08-18T20:44:49.568616+0000","last_clean":"2023-08-18T20:44:49.568616+0000","last_became_active":"2023-08-18T20:44:33.020923+0000","last_became_peered":"2023-08-18T20:44:33.020923+0000","last_unstale":"2023-08-18T20:44:49.568616+0000","last_undegraded":"2023-08-18T20:44:49.568616+0000","last_fullsized":"2023-08-18T20:44:49.568616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:33:18.283619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570303+0000","last_change":"2023-08-18T20:44:34.038590+0000","last_active":"2023-08-18T20:44:49.570303+0000","last_peered":"2023-08-18T20:44:49.570303+0000","last_clean":"2023-08-18T20:44:49.570303+0000","last_became_active":"2023-08-18T20:44:34.038311+0000","last_became_peered":"2023-08-18T20:44:34.038311+0000","last_unstale":"2023-08-18T20:44:49.570303+0000","last_undegraded":"2023-08-18T20:44:49.570303+0000","last_fullsized":"2023-08-18T20:44:49.570303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:43:46.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314839+0000","last_change":"2023-08-18T20:44:47.079601+0000","last_active":"2023-08-18T20:44:49.314839+0000","last_peered":"2023-08-18T20:44:49.314839+0000","last_clean":"2023-08-18T20:44:49.314839+0000","last_became_active":"2023-08-18T20:44:47.079329+0000","last_became_peered":"2023-08-18T20:44:47.079329+0000","last_unstale":"2023-08-18T20:44:49.314839+0000","last_undegraded":"2023-08-18T20:44:49.314839+0000","last_fullsized":"2023-08-18T20:44:49.314839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:30.793580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569822+0000","last_change":"2023-08-18T20:44:48.090364+0000","last_active":"2023-08-18T20:44:49.569822+0000","last_peered":"2023-08-18T20:44:49.569822+0000","last_clean":"2023-08-18T20:44:49.569822+0000","last_became_active":"2023-08-18T20:44:48.090052+0000","last_became_peered":"2023-08-18T20:44:48.090052+0000","last_unstale":"2023-08-18T20:44:49.569822+0000","last_undegraded":"2023-08-18T20:44:49.569822+0000","last_fullsized":"2023-08-18T20:44:49.569822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:36:28.247681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570026+0000","last_change":"2023-08-18T20:44:33.028045+0000","last_active":"2023-08-18T20:44:49.570026+0000","last_peered":"2023-08-18T20:44:49.570026+0000","last_clean":"2023-08-18T20:44:49.570026+0000","last_became_active":"2023-08-18T20:44:33.027750+0000","last_became_peered":"2023-08-18T20:44:33.027750+0000","last_unstale":"2023-08-18T20:44:49.570026+0000","last_undegraded":"2023-08-18T20:44:49.570026+0000","last_fullsized":"2023-08-18T20:44:49.570026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:17.148086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314699+0000","last_change":"2023-08-18T20:44:34.019990+0000","last_active":"2023-08-18T20:44:49.314699+0000","last_peered":"2023-08-18T20:44:49.314699+0000","last_clean":"2023-08-18T20:44:49.314699+0000","last_became_active":"2023-08-18T20:44:34.019613+0000","last_became_peered":"2023-08-18T20:44:34.019613+0000","last_unstale":"2023-08-18T20:44:49.314699+0000","last_undegraded":"2023-08-18T20:44:49.314699+0000","last_fullsized":"2023-08-18T20:44:49.314699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:09:50.450465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077765+0000","last_change":"2023-08-18T20:44:47.082877+0000","last_active":"2023-08-18T20:44:49.077765+0000","last_peered":"2023-08-18T20:44:49.077765+0000","last_clean":"2023-08-18T20:44:49.077765+0000","last_became_active":"2023-08-18T20:44:47.082601+0000","last_became_peered":"2023-08-18T20:44:47.082601+0000","last_unstale":"2023-08-18T20:44:49.077765+0000","last_undegraded":"2023-08-18T20:44:49.077765+0000","last_fullsized":"2023-08-18T20:44:49.077765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:32.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078853+0000","last_change":"2023-08-18T20:44:48.083521+0000","last_active":"2023-08-18T20:44:49.078853+0000","last_peered":"2023-08-18T20:44:49.078853+0000","last_clean":"2023-08-18T20:44:49.078853+0000","last_became_active":"2023-08-18T20:44:48.083195+0000","last_became_peered":"2023-08-18T20:44:48.083195+0000","last_unstale":"2023-08-18T20:44:49.078853+0000","last_undegraded":"2023-08-18T20:44:49.078853+0000","last_fullsized":"2023-08-18T20:44:49.078853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:15.282862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569783+0000","last_change":"2023-08-18T20:44:33.018638+0000","last_active":"2023-08-18T20:44:49.569783+0000","last_peered":"2023-08-18T20:44:49.569783+0000","last_clean":"2023-08-18T20:44:49.569783+0000","last_became_active":"2023-08-18T20:44:33.018102+0000","last_became_peered":"2023-08-18T20:44:33.018102+0000","last_unstale":"2023-08-18T20:44:49.569783+0000","last_undegraded":"2023-08-18T20:44:49.569783+0000","last_fullsized":"2023-08-18T20:44:49.569783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:43:45.418498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078424+0000","last_change":"2023-08-18T20:44:34.037952+0000","last_active":"2023-08-18T20:44:49.078424+0000","last_peered":"2023-08-18T20:44:49.078424+0000","last_clean":"2023-08-18T20:44:49.078424+0000","last_became_active":"2023-08-18T20:44:34.037689+0000","last_became_peered":"2023-08-18T20:44:34.037689+0000","last_unstale":"2023-08-18T20:44:49.078424+0000","last_undegraded":"2023-08-18T20:44:49.078424+0000","last_fullsized":"2023-08-18T20:44:49.078424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:43:53.813564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567781+0000","last_change":"2023-08-18T20:44:47.075077+0000","last_active":"2023-08-18T20:44:49.567781+0000","last_peered":"2023-08-18T20:44:49.567781+0000","last_clean":"2023-08-18T20:44:49.567781+0000","last_became_active":"2023-08-18T20:44:47.074832+0000","last_became_peered":"2023-08-18T20:44:47.074832+0000","last_unstale":"2023-08-18T20:44:49.567781+0000","last_undegraded":"2023-08-18T20:44:49.567781+0000","last_fullsized":"2023-08-18T20:44:49.567781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:30.793580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570513+0000","last_change":"2023-08-18T20:44:48.084496+0000","last_active":"2023-08-18T20:44:49.570513+0000","last_peered":"2023-08-18T20:44:49.570513+0000","last_clean":"2023-08-18T20:44:49.570513+0000","last_became_active":"2023-08-18T20:44:48.084199+0000","last_became_peered":"2023-08-18T20:44:48.084199+0000","last_unstale":"2023-08-18T20:44:49.570513+0000","last_undegraded":"2023-08-18T20:44:49.570513+0000","last_fullsized":"2023-08-18T20:44:49.570513+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:24:59.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567561+0000","last_change":"2023-08-18T20:44:33.013199+0000","last_active":"2023-08-18T20:44:49.567561+0000","last_peered":"2023-08-18T20:44:49.567561+0000","last_clean":"2023-08-18T20:44:49.567561+0000","last_became_active":"2023-08-18T20:44:33.012921+0000","last_became_peered":"2023-08-18T20:44:33.012921+0000","last_unstale":"2023-08-18T20:44:49.567561+0000","last_undegraded":"2023-08-18T20:44:49.567561+0000","last_fullsized":"2023-08-18T20:44:49.567561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:57:38.621836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568617+0000","last_change":"2023-08-18T20:44:34.037602+0000","last_active":"2023-08-18T20:44:49.568617+0000","last_peered":"2023-08-18T20:44:49.568617+0000","last_clean":"2023-08-18T20:44:49.568617+0000","last_became_active":"2023-08-18T20:44:34.037326+0000","last_became_peered":"2023-08-18T20:44:34.037326+0000","last_unstale":"2023-08-18T20:44:49.568617+0000","last_undegraded":"2023-08-18T20:44:49.568617+0000","last_fullsized":"2023-08-18T20:44:49.568617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:25.775711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077960+0000","last_change":"2023-08-18T20:44:47.083025+0000","last_active":"2023-08-18T20:44:49.077960+0000","last_peered":"2023-08-18T20:44:49.077960+0000","last_clean":"2023-08-18T20:44:49.077960+0000","last_became_active":"2023-08-18T20:44:47.082742+0000","last_became_peered":"2023-08-18T20:44:47.082742+0000","last_unstale":"2023-08-18T20:44:49.077960+0000","last_undegraded":"2023-08-18T20:44:49.077960+0000","last_fullsized":"2023-08-18T20:44:49.077960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:40.775738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567628+0000","last_change":"2023-08-18T20:44:48.079665+0000","last_active":"2023-08-18T20:44:49.567628+0000","last_peered":"2023-08-18T20:44:49.567628+0000","last_clean":"2023-08-18T20:44:49.567628+0000","last_became_active":"2023-08-18T20:44:48.079223+0000","last_became_peered":"2023-08-18T20:44:48.079223+0000","last_unstale":"2023-08-18T20:44:49.567628+0000","last_undegraded":"2023-08-18T20:44:49.567628+0000","last_fullsized":"2023-08-18T20:44:49.567628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:42:36.504828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"32'1","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315437+0000","last_change":"2023-08-18T20:44:33.022605+0000","last_active":"2023-08-18T20:44:49.315437+0000","last_peered":"2023-08-18T20:44:49.315437+0000","last_clean":"2023-08-18T20:44:49.315437+0000","last_became_active":"2023-08-18T20:44:33.022355+0000","last_became_peered":"2023-08-18T20:44:33.022355+0000","last_unstale":"2023-08-18T20:44:49.315437+0000","last_undegraded":"2023-08-18T20:44:49.315437+0000","last_fullsized":"2023-08-18T20:44:49.315437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:15:05.764001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567714+0000","last_change":"2023-08-18T20:44:34.031324+0000","last_active":"2023-08-18T20:44:49.567714+0000","last_peered":"2023-08-18T20:44:49.567714+0000","last_clean":"2023-08-18T20:44:49.567714+0000","last_became_active":"2023-08-18T20:44:34.031008+0000","last_became_peered":"2023-08-18T20:44:34.031008+0000","last_unstale":"2023-08-18T20:44:49.567714+0000","last_undegraded":"2023-08-18T20:44:49.567714+0000","last_fullsized":"2023-08-18T20:44:49.567714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:24.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570497+0000","last_change":"2023-08-18T20:44:47.081266+0000","last_active":"2023-08-18T20:44:49.570497+0000","last_peered":"2023-08-18T20:44:49.570497+0000","last_clean":"2023-08-18T20:44:49.570497+0000","last_became_active":"2023-08-18T20:44:47.080895+0000","last_became_peered":"2023-08-18T20:44:47.080895+0000","last_unstale":"2023-08-18T20:44:49.570497+0000","last_undegraded":"2023-08-18T20:44:49.570497+0000","last_fullsized":"2023-08-18T20:44:49.570497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:12.284327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077856+0000","last_change":"2023-08-18T20:44:48.098960+0000","last_active":"2023-08-18T20:44:49.077856+0000","last_peered":"2023-08-18T20:44:49.077856+0000","last_clean":"2023-08-18T20:44:49.077856+0000","last_became_active":"2023-08-18T20:44:48.098652+0000","last_became_peered":"2023-08-18T20:44:48.098652+0000","last_unstale":"2023-08-18T20:44:49.077856+0000","last_undegraded":"2023-08-18T20:44:49.077856+0000","last_fullsized":"2023-08-18T20:44:49.077856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:41:04.757317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078502+0000","last_change":"2023-08-18T20:44:33.014913+0000","last_active":"2023-08-18T20:44:49.078502+0000","last_peered":"2023-08-18T20:44:49.078502+0000","last_clean":"2023-08-18T20:44:49.078502+0000","last_became_active":"2023-08-18T20:44:33.014649+0000","last_became_peered":"2023-08-18T20:44:33.014649+0000","last_unstale":"2023-08-18T20:44:49.078502+0000","last_undegraded":"2023-08-18T20:44:49.078502+0000","last_fullsized":"2023-08-18T20:44:49.078502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:31.992454+0000","last_clean_scrub_stamp":"2023-08-18T20:44:31.992454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:16.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568575+0000","last_change":"2023-08-18T20:44:34.033666+0000","last_active":"2023-08-18T20:44:49.568575+0000","last_peered":"2023-08-18T20:44:49.568575+0000","last_clean":"2023-08-18T20:44:49.568575+0000","last_became_active":"2023-08-18T20:44:34.033370+0000","last_became_peered":"2023-08-18T20:44:34.033370+0000","last_unstale":"2023-08-18T20:44:49.568575+0000","last_undegraded":"2023-08-18T20:44:49.568575+0000","last_fullsized":"2023-08-18T20:44:49.568575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:04:47.512696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567842+0000","last_change":"2023-08-18T20:44:47.083043+0000","last_active":"2023-08-18T20:44:49.567842+0000","last_peered":"2023-08-18T20:44:49.567842+0000","last_clean":"2023-08-18T20:44:49.567842+0000","last_became_active":"2023-08-18T20:44:47.082748+0000","last_became_peered":"2023-08-18T20:44:47.082748+0000","last_unstale":"2023-08-18T20:44:49.567842+0000","last_undegraded":"2023-08-18T20:44:49.567842+0000","last_fullsized":"2023-08-18T20:44:49.567842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:46.048590+0000","last_clean_scrub_stamp":"2023-08-18T20:44:46.048590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:41:05.761069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077578+0000","last_change":"2023-08-18T20:44:48.085186+0000","last_active":"2023-08-18T20:44:49.077578+0000","last_peered":"2023-08-18T20:44:49.077578+0000","last_clean":"2023-08-18T20:44:49.077578+0000","last_became_active":"2023-08-18T20:44:48.084883+0000","last_became_peered":"2023-08-18T20:44:48.084883+0000","last_unstale":"2023-08-18T20:44:49.077578+0000","last_undegraded":"2023-08-18T20:44:49.077578+0000","last_fullsized":"2023-08-18T20:44:49.077578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:55:20.099165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569747+0000","last_change":"2023-08-18T20:44:48.084442+0000","last_active":"2023-08-18T20:44:49.569747+0000","last_peered":"2023-08-18T20:44:49.569747+0000","last_clean":"2023-08-18T20:44:49.569747+0000","last_became_active":"2023-08-18T20:44:48.084131+0000","last_became_peered":"2023-08-18T20:44:48.084131+0000","last_unstale":"2023-08-18T20:44:49.569747+0000","last_undegraded":"2023-08-18T20:44:49.569747+0000","last_fullsized":"2023-08-18T20:44:49.569747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:04:41.874781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567140+0000","last_change":"2023-08-18T20:44:34.027091+0000","last_active":"2023-08-18T20:44:49.567140+0000","last_peered":"2023-08-18T20:44:49.567140+0000","last_clean":"2023-08-18T20:44:49.567140+0000","last_became_active":"2023-08-18T20:44:34.026801+0000","last_became_peered":"2023-08-18T20:44:34.026801+0000","last_unstale":"2023-08-18T20:44:49.567140+0000","last_undegraded":"2023-08-18T20:44:49.567140+0000","last_fullsized":"2023-08-18T20:44:49.567140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:10:46.769121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315476+0000","last_change":"2023-08-18T20:44:48.084411+0000","last_active":"2023-08-18T20:44:49.315476+0000","last_peered":"2023-08-18T20:44:49.315476+0000","last_clean":"2023-08-18T20:44:49.315476+0000","last_became_active":"2023-08-18T20:44:48.084137+0000","last_became_peered":"2023-08-18T20:44:48.084137+0000","last_unstale":"2023-08-18T20:44:49.315476+0000","last_undegraded":"2023-08-18T20:44:49.315476+0000","last_fullsized":"2023-08-18T20:44:49.315476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:32.231834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568683+0000","last_change":"2023-08-18T20:44:34.031382+0000","last_active":"2023-08-18T20:44:49.568683+0000","last_peered":"2023-08-18T20:44:49.568683+0000","last_clean":"2023-08-18T20:44:49.568683+0000","last_became_active":"2023-08-18T20:44:34.031141+0000","last_became_peered":"2023-08-18T20:44:34.031141+0000","last_unstale":"2023-08-18T20:44:49.568683+0000","last_undegraded":"2023-08-18T20:44:49.568683+0000","last_fullsized":"2023-08-18T20:44:49.568683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:43:53.813564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078440+0000","last_change":"2023-08-18T20:44:48.081486+0000","last_active":"2023-08-18T20:44:49.078440+0000","last_peered":"2023-08-18T20:44:49.078440+0000","last_clean":"2023-08-18T20:44:49.078440+0000","last_became_active":"2023-08-18T20:44:48.080685+0000","last_became_peered":"2023-08-18T20:44:48.080685+0000","last_unstale":"2023-08-18T20:44:49.078440+0000","last_undegraded":"2023-08-18T20:44:49.078440+0000","last_fullsized":"2023-08-18T20:44:49.078440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078639+0000","last_change":"2023-08-18T20:44:34.030699+0000","last_active":"2023-08-18T20:44:49.078639+0000","last_peered":"2023-08-18T20:44:49.078639+0000","last_clean":"2023-08-18T20:44:49.078639+0000","last_became_active":"2023-08-18T20:44:34.030434+0000","last_became_peered":"2023-08-18T20:44:34.030434+0000","last_unstale":"2023-08-18T20:44:49.078639+0000","last_undegraded":"2023-08-18T20:44:49.078639+0000","last_fullsized":"2023-08-18T20:44:49.078639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:30.510575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315270+0000","last_change":"2023-08-18T20:44:48.083760+0000","last_active":"2023-08-18T20:44:49.315270+0000","last_peered":"2023-08-18T20:44:49.315270+0000","last_clean":"2023-08-18T20:44:49.315270+0000","last_became_active":"2023-08-18T20:44:48.083489+0000","last_became_peered":"2023-08-18T20:44:48.083489+0000","last_unstale":"2023-08-18T20:44:49.315270+0000","last_undegraded":"2023-08-18T20:44:49.315270+0000","last_fullsized":"2023-08-18T20:44:49.315270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:47:42.701833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078292+0000","last_change":"2023-08-18T20:44:34.036473+0000","last_active":"2023-08-18T20:44:49.078292+0000","last_peered":"2023-08-18T20:44:49.078292+0000","last_clean":"2023-08-18T20:44:49.078292+0000","last_became_active":"2023-08-18T20:44:34.036190+0000","last_became_peered":"2023-08-18T20:44:34.036190+0000","last_unstale":"2023-08-18T20:44:49.078292+0000","last_undegraded":"2023-08-18T20:44:49.078292+0000","last_fullsized":"2023-08-18T20:44:49.078292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:22.397093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077883+0000","last_change":"2023-08-18T20:44:48.084313+0000","last_active":"2023-08-18T20:44:49.077883+0000","last_peered":"2023-08-18T20:44:49.077883+0000","last_clean":"2023-08-18T20:44:49.077883+0000","last_became_active":"2023-08-18T20:44:48.084044+0000","last_became_peered":"2023-08-18T20:44:48.084044+0000","last_unstale":"2023-08-18T20:44:49.077883+0000","last_undegraded":"2023-08-18T20:44:49.077883+0000","last_fullsized":"2023-08-18T20:44:49.077883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:56:05.544102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569229+0000","last_change":"2023-08-18T20:44:34.029522+0000","last_active":"2023-08-18T20:44:49.569229+0000","last_peered":"2023-08-18T20:44:49.569229+0000","last_clean":"2023-08-18T20:44:49.569229+0000","last_became_active":"2023-08-18T20:44:34.029236+0000","last_became_peered":"2023-08-18T20:44:34.029236+0000","last_unstale":"2023-08-18T20:44:49.569229+0000","last_undegraded":"2023-08-18T20:44:49.569229+0000","last_fullsized":"2023-08-18T20:44:49.569229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:41:59.920334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078061+0000","last_change":"2023-08-18T20:44:48.084292+0000","last_active":"2023-08-18T20:44:49.078061+0000","last_peered":"2023-08-18T20:44:49.078061+0000","last_clean":"2023-08-18T20:44:49.078061+0000","last_became_active":"2023-08-18T20:44:48.083937+0000","last_became_peered":"2023-08-18T20:44:48.083937+0000","last_unstale":"2023-08-18T20:44:49.078061+0000","last_undegraded":"2023-08-18T20:44:49.078061+0000","last_fullsized":"2023-08-18T20:44:49.078061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:21.710779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078104+0000","last_change":"2023-08-18T20:44:34.035329+0000","last_active":"2023-08-18T20:44:49.078104+0000","last_peered":"2023-08-18T20:44:49.078104+0000","last_clean":"2023-08-18T20:44:49.078104+0000","last_became_active":"2023-08-18T20:44:34.034716+0000","last_became_peered":"2023-08-18T20:44:34.034716+0000","last_unstale":"2023-08-18T20:44:49.078104+0000","last_undegraded":"2023-08-18T20:44:49.078104+0000","last_fullsized":"2023-08-18T20:44:49.078104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:10.336570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314507+0000","last_change":"2023-08-18T20:44:48.097522+0000","last_active":"2023-08-18T20:44:49.314507+0000","last_peered":"2023-08-18T20:44:49.314507+0000","last_clean":"2023-08-18T20:44:49.314507+0000","last_became_active":"2023-08-18T20:44:48.097249+0000","last_became_peered":"2023-08-18T20:44:48.097249+0000","last_unstale":"2023-08-18T20:44:49.314507+0000","last_undegraded":"2023-08-18T20:44:49.314507+0000","last_fullsized":"2023-08-18T20:44:49.314507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:41.781502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567788+0000","last_change":"2023-08-18T20:44:34.031277+0000","last_active":"2023-08-18T20:44:49.567788+0000","last_peered":"2023-08-18T20:44:49.567788+0000","last_clean":"2023-08-18T20:44:49.567788+0000","last_became_active":"2023-08-18T20:44:34.031000+0000","last_became_peered":"2023-08-18T20:44:34.031000+0000","last_unstale":"2023-08-18T20:44:49.567788+0000","last_undegraded":"2023-08-18T20:44:49.567788+0000","last_fullsized":"2023-08-18T20:44:49.567788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:30.510575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.079189+0000","last_change":"2023-08-18T20:44:48.093827+0000","last_active":"2023-08-18T20:44:49.079189+0000","last_peered":"2023-08-18T20:44:49.079189+0000","last_clean":"2023-08-18T20:44:49.079189+0000","last_became_active":"2023-08-18T20:44:48.093575+0000","last_became_peered":"2023-08-18T20:44:48.093575+0000","last_unstale":"2023-08-18T20:44:49.079189+0000","last_undegraded":"2023-08-18T20:44:49.079189+0000","last_fullsized":"2023-08-18T20:44:49.079189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:34:43.668018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078321+0000","last_change":"2023-08-18T20:44:34.034922+0000","last_active":"2023-08-18T20:44:49.078321+0000","last_peered":"2023-08-18T20:44:49.078321+0000","last_clean":"2023-08-18T20:44:49.078321+0000","last_became_active":"2023-08-18T20:44:34.034632+0000","last_became_peered":"2023-08-18T20:44:34.034632+0000","last_unstale":"2023-08-18T20:44:49.078321+0000","last_undegraded":"2023-08-18T20:44:49.078321+0000","last_fullsized":"2023-08-18T20:44:49.078321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:24.879231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078360+0000","last_change":"2023-08-18T20:44:48.098872+0000","last_active":"2023-08-18T20:44:49.078360+0000","last_peered":"2023-08-18T20:44:49.078360+0000","last_clean":"2023-08-18T20:44:49.078360+0000","last_became_active":"2023-08-18T20:44:48.098583+0000","last_became_peered":"2023-08-18T20:44:48.098583+0000","last_unstale":"2023-08-18T20:44:49.078360+0000","last_undegraded":"2023-08-18T20:44:49.078360+0000","last_fullsized":"2023-08-18T20:44:49.078360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:44.966932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078969+0000","last_change":"2023-08-18T20:44:34.033184+0000","last_active":"2023-08-18T20:44:49.078969+0000","last_peered":"2023-08-18T20:44:49.078969+0000","last_clean":"2023-08-18T20:44:49.078969+0000","last_became_active":"2023-08-18T20:44:34.032898+0000","last_became_peered":"2023-08-18T20:44:34.032898+0000","last_unstale":"2023-08-18T20:44:49.078969+0000","last_undegraded":"2023-08-18T20:44:49.078969+0000","last_fullsized":"2023-08-18T20:44:49.078969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:03:48.104963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315576+0000","last_change":"2023-08-18T20:44:48.091186+0000","last_active":"2023-08-18T20:44:49.315576+0000","last_peered":"2023-08-18T20:44:49.315576+0000","last_clean":"2023-08-18T20:44:49.315576+0000","last_became_active":"2023-08-18T20:44:48.089988+0000","last_became_peered":"2023-08-18T20:44:48.089988+0000","last_unstale":"2023-08-18T20:44:49.315576+0000","last_undegraded":"2023-08-18T20:44:49.315576+0000","last_fullsized":"2023-08-18T20:44:49.315576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:39:32.459429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569406+0000","last_change":"2023-08-18T20:44:34.031966+0000","last_active":"2023-08-18T20:44:49.569406+0000","last_peered":"2023-08-18T20:44:49.569406+0000","last_clean":"2023-08-18T20:44:49.569406+0000","last_became_active":"2023-08-18T20:44:34.031632+0000","last_became_peered":"2023-08-18T20:44:34.031632+0000","last_unstale":"2023-08-18T20:44:49.569406+0000","last_undegraded":"2023-08-18T20:44:49.569406+0000","last_fullsized":"2023-08-18T20:44:49.569406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:38:49.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078570+0000","last_change":"2023-08-18T20:44:48.095852+0000","last_active":"2023-08-18T20:44:49.078570+0000","last_peered":"2023-08-18T20:44:49.078570+0000","last_clean":"2023-08-18T20:44:49.078570+0000","last_became_active":"2023-08-18T20:44:48.095565+0000","last_became_peered":"2023-08-18T20:44:48.095565+0000","last_unstale":"2023-08-18T20:44:49.078570+0000","last_undegraded":"2023-08-18T20:44:49.078570+0000","last_fullsized":"2023-08-18T20:44:49.078570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:07:16.606633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568287+0000","last_change":"2023-08-18T20:44:34.032496+0000","last_active":"2023-08-18T20:44:49.568287+0000","last_peered":"2023-08-18T20:44:49.568287+0000","last_clean":"2023-08-18T20:44:49.568287+0000","last_became_active":"2023-08-18T20:44:34.032220+0000","last_became_peered":"2023-08-18T20:44:34.032220+0000","last_unstale":"2023-08-18T20:44:49.568287+0000","last_undegraded":"2023-08-18T20:44:49.568287+0000","last_fullsized":"2023-08-18T20:44:49.568287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:48.436600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567921+0000","last_change":"2023-08-18T20:44:48.090603+0000","last_active":"2023-08-18T20:44:49.567921+0000","last_peered":"2023-08-18T20:44:49.567921+0000","last_clean":"2023-08-18T20:44:49.567921+0000","last_became_active":"2023-08-18T20:44:48.090322+0000","last_became_peered":"2023-08-18T20:44:48.090322+0000","last_unstale":"2023-08-18T20:44:49.567921+0000","last_undegraded":"2023-08-18T20:44:49.567921+0000","last_fullsized":"2023-08-18T20:44:49.567921+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:01.348192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570064+0000","last_change":"2023-08-18T20:44:34.028356+0000","last_active":"2023-08-18T20:44:49.570064+0000","last_peered":"2023-08-18T20:44:49.570064+0000","last_clean":"2023-08-18T20:44:49.570064+0000","last_became_active":"2023-08-18T20:44:34.028074+0000","last_became_peered":"2023-08-18T20:44:34.028074+0000","last_unstale":"2023-08-18T20:44:49.570064+0000","last_undegraded":"2023-08-18T20:44:49.570064+0000","last_fullsized":"2023-08-18T20:44:49.570064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:42:25.775711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569655+0000","last_change":"2023-08-18T20:44:48.093292+0000","last_active":"2023-08-18T20:44:49.569655+0000","last_peered":"2023-08-18T20:44:49.569655+0000","last_clean":"2023-08-18T20:44:49.569655+0000","last_became_active":"2023-08-18T20:44:48.093023+0000","last_became_peered":"2023-08-18T20:44:48.093023+0000","last_unstale":"2023-08-18T20:44:49.569655+0000","last_undegraded":"2023-08-18T20:44:49.569655+0000","last_fullsized":"2023-08-18T20:44:49.569655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:15.282862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078779+0000","last_change":"2023-08-18T20:44:34.037508+0000","last_active":"2023-08-18T20:44:49.078779+0000","last_peered":"2023-08-18T20:44:49.078779+0000","last_clean":"2023-08-18T20:44:49.078779+0000","last_became_active":"2023-08-18T20:44:34.037197+0000","last_became_peered":"2023-08-18T20:44:34.037197+0000","last_unstale":"2023-08-18T20:44:49.078779+0000","last_undegraded":"2023-08-18T20:44:49.078779+0000","last_fullsized":"2023-08-18T20:44:49.078779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:49:12.597842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314777+0000","last_change":"2023-08-18T20:44:48.087462+0000","last_active":"2023-08-18T20:44:49.314777+0000","last_peered":"2023-08-18T20:44:49.314777+0000","last_clean":"2023-08-18T20:44:49.314777+0000","last_became_active":"2023-08-18T20:44:48.087200+0000","last_became_peered":"2023-08-18T20:44:48.087200+0000","last_unstale":"2023-08-18T20:44:49.314777+0000","last_undegraded":"2023-08-18T20:44:49.314777+0000","last_fullsized":"2023-08-18T20:44:49.314777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:54:38.936126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080814+0000","last_change":"2023-08-18T20:44:34.027266+0000","last_active":"2023-08-18T20:44:49.080814+0000","last_peered":"2023-08-18T20:44:49.080814+0000","last_clean":"2023-08-18T20:44:49.080814+0000","last_became_active":"2023-08-18T20:44:34.026978+0000","last_became_peered":"2023-08-18T20:44:34.026978+0000","last_unstale":"2023-08-18T20:44:49.080814+0000","last_undegraded":"2023-08-18T20:44:49.080814+0000","last_fullsized":"2023-08-18T20:44:49.080814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:45:19.527191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568177+0000","last_change":"2023-08-18T20:44:48.087865+0000","last_active":"2023-08-18T20:44:49.568177+0000","last_peered":"2023-08-18T20:44:49.568177+0000","last_clean":"2023-08-18T20:44:49.568177+0000","last_became_active":"2023-08-18T20:44:48.087572+0000","last_became_peered":"2023-08-18T20:44:48.087572+0000","last_unstale":"2023-08-18T20:44:49.568177+0000","last_undegraded":"2023-08-18T20:44:49.568177+0000","last_fullsized":"2023-08-18T20:44:49.568177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:36.378800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077757+0000","last_change":"2023-08-18T20:44:34.035911+0000","last_active":"2023-08-18T20:44:49.077757+0000","last_peered":"2023-08-18T20:44:49.077757+0000","last_clean":"2023-08-18T20:44:49.077757+0000","last_became_active":"2023-08-18T20:44:34.035535+0000","last_became_peered":"2023-08-18T20:44:34.035535+0000","last_unstale":"2023-08-18T20:44:49.077757+0000","last_undegraded":"2023-08-18T20:44:49.077757+0000","last_fullsized":"2023-08-18T20:44:49.077757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:50:48.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315043+0000","last_change":"2023-08-18T20:44:48.098108+0000","last_active":"2023-08-18T20:44:49.315043+0000","last_peered":"2023-08-18T20:44:49.315043+0000","last_clean":"2023-08-18T20:44:49.315043+0000","last_became_active":"2023-08-18T20:44:48.097806+0000","last_became_peered":"2023-08-18T20:44:48.097806+0000","last_unstale":"2023-08-18T20:44:49.315043+0000","last_undegraded":"2023-08-18T20:44:49.315043+0000","last_fullsized":"2023-08-18T20:44:49.315043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:09:21.246745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569614+0000","last_change":"2023-08-18T20:44:34.033866+0000","last_active":"2023-08-18T20:44:49.569614+0000","last_peered":"2023-08-18T20:44:49.569614+0000","last_clean":"2023-08-18T20:44:49.569614+0000","last_became_active":"2023-08-18T20:44:34.032918+0000","last_became_peered":"2023-08-18T20:44:34.032918+0000","last_unstale":"2023-08-18T20:44:49.569614+0000","last_undegraded":"2023-08-18T20:44:49.569614+0000","last_fullsized":"2023-08-18T20:44:49.569614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:09.909788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569793+0000","last_change":"2023-08-18T20:44:48.086363+0000","last_active":"2023-08-18T20:44:49.569793+0000","last_peered":"2023-08-18T20:44:49.569793+0000","last_clean":"2023-08-18T20:44:49.569793+0000","last_became_active":"2023-08-18T20:44:48.086081+0000","last_became_peered":"2023-08-18T20:44:48.086081+0000","last_unstale":"2023-08-18T20:44:49.569793+0000","last_undegraded":"2023-08-18T20:44:49.569793+0000","last_fullsized":"2023-08-18T20:44:49.569793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:07:44.015640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568157+0000","last_change":"2023-08-18T20:44:34.034342+0000","last_active":"2023-08-18T20:44:49.568157+0000","last_peered":"2023-08-18T20:44:49.568157+0000","last_clean":"2023-08-18T20:44:49.568157+0000","last_became_active":"2023-08-18T20:44:34.033933+0000","last_became_peered":"2023-08-18T20:44:34.033933+0000","last_unstale":"2023-08-18T20:44:49.568157+0000","last_undegraded":"2023-08-18T20:44:49.568157+0000","last_fullsized":"2023-08-18T20:44:49.568157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:55:59.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567774+0000","last_change":"2023-08-18T20:44:48.085809+0000","last_active":"2023-08-18T20:44:49.567774+0000","last_peered":"2023-08-18T20:44:49.567774+0000","last_clean":"2023-08-18T20:44:49.567774+0000","last_became_active":"2023-08-18T20:44:48.085321+0000","last_became_peered":"2023-08-18T20:44:48.085321+0000","last_unstale":"2023-08-18T20:44:49.567774+0000","last_undegraded":"2023-08-18T20:44:49.567774+0000","last_fullsized":"2023-08-18T20:44:49.567774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570405+0000","last_change":"2023-08-18T20:44:34.030783+0000","last_active":"2023-08-18T20:44:49.570405+0000","last_peered":"2023-08-18T20:44:49.570405+0000","last_clean":"2023-08-18T20:44:49.570405+0000","last_became_active":"2023-08-18T20:44:34.030484+0000","last_became_peered":"2023-08-18T20:44:34.030484+0000","last_unstale":"2023-08-18T20:44:49.570405+0000","last_undegraded":"2023-08-18T20:44:49.570405+0000","last_fullsized":"2023-08-18T20:44:49.570405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:00:11.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.569066+0000","last_change":"2023-08-18T20:44:48.089035+0000","last_active":"2023-08-18T20:44:49.569066+0000","last_peered":"2023-08-18T20:44:49.569066+0000","last_clean":"2023-08-18T20:44:49.569066+0000","last_became_active":"2023-08-18T20:44:48.088786+0000","last_became_peered":"2023-08-18T20:44:48.088786+0000","last_unstale":"2023-08-18T20:44:49.569066+0000","last_undegraded":"2023-08-18T20:44:49.569066+0000","last_fullsized":"2023-08-18T20:44:49.569066+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:32.638770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567991+0000","last_change":"2023-08-18T20:44:34.039075+0000","last_active":"2023-08-18T20:44:49.567991+0000","last_peered":"2023-08-18T20:44:49.567991+0000","last_clean":"2023-08-18T20:44:49.567991+0000","last_became_active":"2023-08-18T20:44:34.038788+0000","last_became_peered":"2023-08-18T20:44:34.038788+0000","last_unstale":"2023-08-18T20:44:49.567991+0000","last_undegraded":"2023-08-18T20:44:49.567991+0000","last_fullsized":"2023-08-18T20:44:49.567991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:33:02.879896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314919+0000","last_change":"2023-08-18T20:44:48.098922+0000","last_active":"2023-08-18T20:44:49.314919+0000","last_peered":"2023-08-18T20:44:49.314919+0000","last_clean":"2023-08-18T20:44:49.314919+0000","last_became_active":"2023-08-18T20:44:48.096947+0000","last_became_peered":"2023-08-18T20:44:48.096947+0000","last_unstale":"2023-08-18T20:44:49.314919+0000","last_undegraded":"2023-08-18T20:44:49.314919+0000","last_fullsized":"2023-08-18T20:44:49.314919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:41:06.766833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568947+0000","last_change":"2023-08-18T20:44:34.030518+0000","last_active":"2023-08-18T20:44:49.568947+0000","last_peered":"2023-08-18T20:44:49.568947+0000","last_clean":"2023-08-18T20:44:49.568947+0000","last_became_active":"2023-08-18T20:44:34.030194+0000","last_became_peered":"2023-08-18T20:44:34.030194+0000","last_unstale":"2023-08-18T20:44:49.568947+0000","last_undegraded":"2023-08-18T20:44:49.568947+0000","last_fullsized":"2023-08-18T20:44:49.568947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:32:38.024438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567399+0000","last_change":"2023-08-18T20:44:48.087773+0000","last_active":"2023-08-18T20:44:49.567399+0000","last_peered":"2023-08-18T20:44:49.567399+0000","last_clean":"2023-08-18T20:44:49.567399+0000","last_became_active":"2023-08-18T20:44:48.087565+0000","last_became_peered":"2023-08-18T20:44:48.087565+0000","last_unstale":"2023-08-18T20:44:49.567399+0000","last_undegraded":"2023-08-18T20:44:49.567399+0000","last_fullsized":"2023-08-18T20:44:49.567399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:51:02.577013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314861+0000","last_change":"2023-08-18T20:44:34.028529+0000","last_active":"2023-08-18T20:44:49.314861+0000","last_peered":"2023-08-18T20:44:49.314861+0000","last_clean":"2023-08-18T20:44:49.314861+0000","last_became_active":"2023-08-18T20:44:34.028249+0000","last_became_peered":"2023-08-18T20:44:34.028249+0000","last_unstale":"2023-08-18T20:44:49.314861+0000","last_undegraded":"2023-08-18T20:44:49.314861+0000","last_fullsized":"2023-08-18T20:44:49.314861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:42:47.291297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568064+0000","last_change":"2023-08-18T20:44:48.087378+0000","last_active":"2023-08-18T20:44:49.568064+0000","last_peered":"2023-08-18T20:44:49.568064+0000","last_clean":"2023-08-18T20:44:49.568064+0000","last_became_active":"2023-08-18T20:44:48.087142+0000","last_became_peered":"2023-08-18T20:44:48.087142+0000","last_unstale":"2023-08-18T20:44:49.568064+0000","last_undegraded":"2023-08-18T20:44:49.568064+0000","last_fullsized":"2023-08-18T20:44:49.568064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:59:07.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570255+0000","last_change":"2023-08-18T20:44:34.026226+0000","last_active":"2023-08-18T20:44:49.570255+0000","last_peered":"2023-08-18T20:44:49.570255+0000","last_clean":"2023-08-18T20:44:49.570255+0000","last_became_active":"2023-08-18T20:44:34.025928+0000","last_became_peered":"2023-08-18T20:44:34.025928+0000","last_unstale":"2023-08-18T20:44:49.570255+0000","last_undegraded":"2023-08-18T20:44:49.570255+0000","last_fullsized":"2023-08-18T20:44:49.570255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:57.040146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078093+0000","last_change":"2023-08-18T20:44:48.082555+0000","last_active":"2023-08-18T20:44:49.078093+0000","last_peered":"2023-08-18T20:44:49.078093+0000","last_clean":"2023-08-18T20:44:49.078093+0000","last_became_active":"2023-08-18T20:44:48.081970+0000","last_became_peered":"2023-08-18T20:44:48.081970+0000","last_unstale":"2023-08-18T20:44:49.078093+0000","last_undegraded":"2023-08-18T20:44:49.078093+0000","last_fullsized":"2023-08-18T20:44:49.078093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:03:32.638770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570166+0000","last_change":"2023-08-18T20:44:34.034047+0000","last_active":"2023-08-18T20:44:49.570166+0000","last_peered":"2023-08-18T20:44:49.570166+0000","last_clean":"2023-08-18T20:44:49.570166+0000","last_became_active":"2023-08-18T20:44:34.033628+0000","last_became_peered":"2023-08-18T20:44:34.033628+0000","last_unstale":"2023-08-18T20:44:49.570166+0000","last_undegraded":"2023-08-18T20:44:49.570166+0000","last_fullsized":"2023-08-18T20:44:49.570166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:39:15.175345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314816+0000","last_change":"2023-08-18T20:44:48.098397+0000","last_active":"2023-08-18T20:44:49.314816+0000","last_peered":"2023-08-18T20:44:49.314816+0000","last_clean":"2023-08-18T20:44:49.314816+0000","last_became_active":"2023-08-18T20:44:48.098113+0000","last_became_peered":"2023-08-18T20:44:48.098113+0000","last_unstale":"2023-08-18T20:44:49.314816+0000","last_undegraded":"2023-08-18T20:44:49.314816+0000","last_fullsized":"2023-08-18T20:44:49.314816+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:36.276402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315529+0000","last_change":"2023-08-18T20:44:34.029992+0000","last_active":"2023-08-18T20:44:49.315529+0000","last_peered":"2023-08-18T20:44:49.315529+0000","last_clean":"2023-08-18T20:44:49.315529+0000","last_became_active":"2023-08-18T20:44:34.029725+0000","last_became_peered":"2023-08-18T20:44:34.029725+0000","last_unstale":"2023-08-18T20:44:49.315529+0000","last_undegraded":"2023-08-18T20:44:49.315529+0000","last_fullsized":"2023-08-18T20:44:49.315529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:53.709433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567683+0000","last_change":"2023-08-18T20:44:48.085622+0000","last_active":"2023-08-18T20:44:49.567683+0000","last_peered":"2023-08-18T20:44:49.567683+0000","last_clean":"2023-08-18T20:44:49.567683+0000","last_became_active":"2023-08-18T20:44:48.085282+0000","last_became_peered":"2023-08-18T20:44:48.085282+0000","last_unstale":"2023-08-18T20:44:49.567683+0000","last_undegraded":"2023-08-18T20:44:49.567683+0000","last_fullsized":"2023-08-18T20:44:49.567683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:41:36.453989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.077720+0000","last_change":"2023-08-18T20:44:34.030742+0000","last_active":"2023-08-18T20:44:49.077720+0000","last_peered":"2023-08-18T20:44:49.077720+0000","last_clean":"2023-08-18T20:44:49.077720+0000","last_became_active":"2023-08-18T20:44:34.029324+0000","last_became_peered":"2023-08-18T20:44:34.029324+0000","last_unstale":"2023-08-18T20:44:49.077720+0000","last_undegraded":"2023-08-18T20:44:49.077720+0000","last_fullsized":"2023-08-18T20:44:49.077720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:14:00.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078275+0000","last_change":"2023-08-18T20:44:48.084751+0000","last_active":"2023-08-18T20:44:49.078275+0000","last_peered":"2023-08-18T20:44:49.078275+0000","last_clean":"2023-08-18T20:44:49.078275+0000","last_became_active":"2023-08-18T20:44:48.084457+0000","last_became_peered":"2023-08-18T20:44:48.084457+0000","last_unstale":"2023-08-18T20:44:49.078275+0000","last_undegraded":"2023-08-18T20:44:49.078275+0000","last_fullsized":"2023-08-18T20:44:49.078275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:21:23.803379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.570184+0000","last_change":"2023-08-18T20:44:34.030343+0000","last_active":"2023-08-18T20:44:49.570184+0000","last_peered":"2023-08-18T20:44:49.570184+0000","last_clean":"2023-08-18T20:44:49.570184+0000","last_became_active":"2023-08-18T20:44:34.029946+0000","last_became_peered":"2023-08-18T20:44:34.029946+0000","last_unstale":"2023-08-18T20:44:49.570184+0000","last_undegraded":"2023-08-18T20:44:49.570184+0000","last_fullsized":"2023-08-18T20:44:49.570184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:39:27.487888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078156+0000","last_change":"2023-08-18T20:44:48.080516+0000","last_active":"2023-08-18T20:44:49.078156+0000","last_peered":"2023-08-18T20:44:49.078156+0000","last_clean":"2023-08-18T20:44:49.078156+0000","last_became_active":"2023-08-18T20:44:48.080229+0000","last_became_peered":"2023-08-18T20:44:48.080229+0000","last_unstale":"2023-08-18T20:44:49.078156+0000","last_undegraded":"2023-08-18T20:44:49.078156+0000","last_fullsized":"2023-08-18T20:44:49.078156+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:56:13.947954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567192+0000","last_change":"2023-08-18T20:44:34.026485+0000","last_active":"2023-08-18T20:44:49.567192+0000","last_peered":"2023-08-18T20:44:49.567192+0000","last_clean":"2023-08-18T20:44:49.567192+0000","last_became_active":"2023-08-18T20:44:34.026184+0000","last_became_peered":"2023-08-18T20:44:34.026184+0000","last_unstale":"2023-08-18T20:44:49.567192+0000","last_undegraded":"2023-08-18T20:44:49.567192+0000","last_fullsized":"2023-08-18T20:44:49.567192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:40:11.639360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080955+0000","last_change":"2023-08-18T20:44:48.095202+0000","last_active":"2023-08-18T20:44:49.080955+0000","last_peered":"2023-08-18T20:44:49.080955+0000","last_clean":"2023-08-18T20:44:49.080955+0000","last_became_active":"2023-08-18T20:44:48.094943+0000","last_became_peered":"2023-08-18T20:44:48.094943+0000","last_unstale":"2023-08-18T20:44:49.080955+0000","last_undegraded":"2023-08-18T20:44:49.080955+0000","last_fullsized":"2023-08-18T20:44:49.080955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:11:25.088467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080168+0000","last_change":"2023-08-18T20:44:34.020862+0000","last_active":"2023-08-18T20:44:49.080168+0000","last_peered":"2023-08-18T20:44:49.080168+0000","last_clean":"2023-08-18T20:44:49.080168+0000","last_became_active":"2023-08-18T20:44:34.020573+0000","last_became_peered":"2023-08-18T20:44:34.020573+0000","last_unstale":"2023-08-18T20:44:49.080168+0000","last_undegraded":"2023-08-18T20:44:49.080168+0000","last_fullsized":"2023-08-18T20:44:49.080168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:43:05.480939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.314932+0000","last_change":"2023-08-18T20:44:48.098110+0000","last_active":"2023-08-18T20:44:49.314932+0000","last_peered":"2023-08-18T20:44:49.314932+0000","last_clean":"2023-08-18T20:44:49.314932+0000","last_became_active":"2023-08-18T20:44:48.097002+0000","last_became_peered":"2023-08-18T20:44:48.097002+0000","last_unstale":"2023-08-18T20:44:49.314932+0000","last_undegraded":"2023-08-18T20:44:49.314932+0000","last_fullsized":"2023-08-18T20:44:49.314932+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:55:26.368075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.080426+0000","last_change":"2023-08-18T20:44:34.027812+0000","last_active":"2023-08-18T20:44:49.080426+0000","last_peered":"2023-08-18T20:44:49.080426+0000","last_clean":"2023-08-18T20:44:49.080426+0000","last_became_active":"2023-08-18T20:44:34.027541+0000","last_became_peered":"2023-08-18T20:44:34.027541+0000","last_unstale":"2023-08-18T20:44:49.080426+0000","last_undegraded":"2023-08-18T20:44:49.080426+0000","last_fullsized":"2023-08-18T20:44:49.080426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:12:34.051852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567451+0000","last_change":"2023-08-18T20:44:48.088847+0000","last_active":"2023-08-18T20:44:49.567451+0000","last_peered":"2023-08-18T20:44:49.567451+0000","last_clean":"2023-08-18T20:44:49.567451+0000","last_became_active":"2023-08-18T20:44:48.088361+0000","last_became_peered":"2023-08-18T20:44:48.088361+0000","last_unstale":"2023-08-18T20:44:49.567451+0000","last_undegraded":"2023-08-18T20:44:49.567451+0000","last_fullsized":"2023-08-18T20:44:49.567451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:16:27.183029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.315435+0000","last_change":"2023-08-18T20:44:34.030539+0000","last_active":"2023-08-18T20:44:49.315435+0000","last_peered":"2023-08-18T20:44:49.315435+0000","last_clean":"2023-08-18T20:44:49.315435+0000","last_became_active":"2023-08-18T20:44:34.030276+0000","last_became_peered":"2023-08-18T20:44:34.030276+0000","last_unstale":"2023-08-18T20:44:49.315435+0000","last_undegraded":"2023-08-18T20:44:49.315435+0000","last_fullsized":"2023-08-18T20:44:49.315435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:20:22.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.567012+0000","last_change":"2023-08-18T20:44:48.085606+0000","last_active":"2023-08-18T20:44:49.567012+0000","last_peered":"2023-08-18T20:44:49.567012+0000","last_clean":"2023-08-18T20:44:49.567012+0000","last_became_active":"2023-08-18T20:44:48.085287+0000","last_became_peered":"2023-08-18T20:44:48.085287+0000","last_unstale":"2023-08-18T20:44:49.567012+0000","last_undegraded":"2023-08-18T20:44:49.567012+0000","last_fullsized":"2023-08-18T20:44:49.567012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:08.736884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078933+0000","last_change":"2023-08-18T20:44:34.030013+0000","last_active":"2023-08-18T20:44:49.078933+0000","last_peered":"2023-08-18T20:44:49.078933+0000","last_clean":"2023-08-18T20:44:49.078933+0000","last_became_active":"2023-08-18T20:44:34.029734+0000","last_became_peered":"2023-08-18T20:44:34.029734+0000","last_unstale":"2023-08-18T20:44:49.078933+0000","last_undegraded":"2023-08-18T20:44:49.078933+0000","last_fullsized":"2023-08-18T20:44:49.078933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:04:09.909788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.568347+0000","last_change":"2023-08-18T20:44:48.086300+0000","last_active":"2023-08-18T20:44:49.568347+0000","last_peered":"2023-08-18T20:44:49.568347+0000","last_clean":"2023-08-18T20:44:49.568347+0000","last_became_active":"2023-08-18T20:44:48.086027+0000","last_became_peered":"2023-08-18T20:44:48.086027+0000","last_unstale":"2023-08-18T20:44:49.568347+0000","last_undegraded":"2023-08-18T20:44:49.568347+0000","last_fullsized":"2023-08-18T20:44:49.568347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:47.054355+0000","last_clean_scrub_stamp":"2023-08-18T20:44:47.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:45:52.491300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-18T20:44:49.078640+0000","last_change":"2023-08-18T20:44:34.026367+0000","last_active":"2023-08-18T20:44:49.078640+0000","last_peered":"2023-08-18T20:44:49.078640+0000","last_clean":"2023-08-18T20:44:49.078640+0000","last_became_active":"2023-08-18T20:44:34.026081+0000","last_became_peered":"2023-08-18T20:44:34.026081+0000","last_unstale":"2023-08-18T20:44:49.078640+0000","last_undegraded":"2023-08-18T20:44:49.078640+0000","last_fullsized":"2023-08-18T20:44:49.078640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:44:32.997460+0000","last_clean_scrub_stamp":"2023-08-18T20:44:32.997460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:45:57.133446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1036288,"data_stored":773013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.33400000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.41699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.755},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63300000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.216},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.25},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27900000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.309},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.32100000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.72699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.375},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.439}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":181014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.375}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.626},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.498}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53000000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":184119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.375},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.432},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":179444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.622},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.45000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:44:57.168 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-18T20:44:57.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-08-18T20:44:57.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.322+0000 7f1d65e9f700 1 Processor -- start 2023-08-18T20:44:57.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.322+0000 7f1d65e9f700 1 -- start start 2023-08-18T20:44:57.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d65e9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d65e9f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d65e9f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d60158ae0 con 0x7f1d600a6ed0 2023-08-18T20:44:57.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d65e9f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d60155370 con 0x7f1d600c3740 2023-08-18T20:44:57.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d65e9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d600c7760 con 0x7f1d600c7380 2023-08-18T20:44:57.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d5f7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.323+0000 7f1d5ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5ffff700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52338/0 (socket says 172.21.15.121:52338) 2023-08-18T20:44:57.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:38906/0 (socket says 172.21.15.121:38906) 2023-08-18T20:44:57.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5ffff700 1 -- 172.21.15.121:0/816156646 learned_addr learned my addr 172.21.15.121:0/816156646 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:57.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/816156646 >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 msgr2=0x7f1d600c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:57.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 --2- 172.21.15.121:0/816156646 >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/816156646 >> v1:172.21.15.122:6789/0 conn(0x7f1d600a6ed0 legacy=0x7f1d6006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/816156646 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60154760 con 0x7f1d600c7380 2023-08-18T20:44:57.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5ffff700 1 --2- 172.21.15.121:0/816156646 >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:57.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5f7fe700 1 --2- 172.21.15.121:0/816156646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009840 tx=0x7f1d48009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541d07f0ab75b9e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5e7fc700 1 -- 172.21.15.121:0/816156646 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48011830 con 0x7f1d600c7380 2023-08-18T20:44:57.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5e7fc700 1 -- 172.21.15.121:0/816156646 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48011990 con 0x7f1d600c7380 2023-08-18T20:44:57.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.324+0000 7f1d5e7fc700 1 -- 172.21.15.121:0/816156646 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48011d20 con 0x7f1d600c7380 2023-08-18T20:44:57.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 -- 172.21.15.121:0/816156646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 msgr2=0x7f1d601585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/816156646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009840 tx=0x7f1d48009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:57.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 -- 172.21.15.121:0/816156646 shutdown_connections 2023-08-18T20:44:57.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/816156646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c7380 0x7f1d601585a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/816156646 >> v2:172.21.15.122:3300/0 conn(0x7f1d600c3740 0x7f1d600c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 -- 172.21.15.121:0/816156646 >> 172.21.15.121:0/816156646 conn(0x7f1d600c7bf0 msgr2=0x7f1d600c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:57.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 -- 172.21.15.121:0/816156646 shutdown_connections 2023-08-18T20:44:57.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.325+0000 7f1d65e9f700 1 -- 172.21.15.121:0/816156646 wait complete. 2023-08-18T20:44:57.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.326+0000 7f1d65e9f700 1 Processor -- start 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.326+0000 7f1d65e9f700 1 -- start start 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c3740 0x7f1d60153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 0x7f1d601ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d600ab470 con 0x7f1d600a6ed0 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d601527e0 con 0x7f1d600c7380 2023-08-18T20:44:57.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d65e9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d600ab080 con 0x7f1d600c3740 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42502/0 (socket says 172.21.15.121:42502) 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/3263031138 learned_addr learned my addr 172.21.15.121:0/3263031138 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5ffff700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 0x7f1d601ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5effd700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c3740 0x7f1d60153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c3740 msgr2=0x7f1d60153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c3740 0x7f1d60153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 msgr2=0x7f1d601ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 0x7f1d601ed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5f7fe700 1 -- 172.21.15.121:0/3263031138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58009b30 con 0x7f1d600a6ed0 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.327+0000 7f1d5ffff700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 0x7f1d601ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d5f7fe700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009fd0 tx=0x7f1d48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d480036a0 con 0x7f1d600a6ed0 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4801e070 con 0x7f1d600a6ed0 2023-08-18T20:44:57.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d480094a0 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48003a40 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.328+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d60152190 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.329+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d60074730 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.329+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d48003ba0 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.330+0000 7f1d57fff700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 0x7f1d4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.330+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1d48089940 con 0x7f1d600a6ed0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.330+0000 7f1d5effd700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 0x7f1d4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.330+0000 7f1d5effd700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 0x7f1d4006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d50000f60 tx=0x7f1d50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.334+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1d48054ce0 con 0x7f1d600a6ed0 2023-08-18T20:44:57.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.600+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f1d600c5580 con 0x7f1d600a6ed0 2023-08-18T20:44:57.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.604+0000 7f1d57fff700 1 -- 172.21.15.121:0/3263031138 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v10) v1 ==== 185+0+142 (secure 0 0 0) 0x7f1d48058300 con 0x7f1d600a6ed0 2023-08-18T20:44:57.604 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2023-08-18T20:44:57.605 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A== 2023-08-18T20:44:57.605 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2023-08-18T20:44:57.605 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2023-08-18T20:44:57.605 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-08-18T20:44:57.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 msgr2=0x7f1d4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 0x7f1d4006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d50000f60 tx=0x7f1d50009040 comp rx=0 tx=0).stop 2023-08-18T20:44:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 msgr2=0x7f1d600aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009fd0 tx=0x7f1d48004750 comp rx=0 tx=0).stop 2023-08-18T20:44:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 shutdown_connections 2023-08-18T20:44:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d600c7380 0x7f1d601ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1d4006a0e0 0x7f1d4006c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d600a6ed0 0x7f1d600aab40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 --2- 172.21.15.121:0/3263031138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d600c3740 0x7f1d60153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 >> 172.21.15.121:0/3263031138 conn(0x7f1d600c7bf0 msgr2=0x7f1d60151050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 shutdown_connections 2023-08-18T20:44:57.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.606+0000 7f1d65e9f700 1 -- 172.21.15.121:0/3263031138 wait complete. 2023-08-18T20:44:57.609 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.1 2023-08-18T20:44:57.618 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:57.619 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:57.640 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:44:57.641 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:44:57.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:44:57.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.822+0000 7fa0ecdce700 1 Processor -- start 2023-08-18T20:44:57.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.822+0000 7fa0ecdce700 1 -- start start 2023-08-18T20:44:57.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.823+0000 7fa0ecdce700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa0e814e790 0x7fa0e806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.823+0000 7fa0ecdce700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.823+0000 7fa0ecdce700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e814eb70 con 0x7fa0e8072200 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.823+0000 7fa0ecdce700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e8070790 con 0x7fa0e814e790 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.823+0000 7fa0ecdce700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8154830 con 0x7fa0e806b7f0 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa0e814e790 0x7fa0e806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e6d9d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e6d9d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:38922/0 (socket says 172.21.15.121:38922) 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa0e814e790 0x7fa0e806b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52348/0 (socket says 172.21.15.121:52348) 2023-08-18T20:44:57.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e6d9d700 1 -- 172.21.15.121:0/4280458957 learned_addr learned my addr 172.21.15.121:0/4280458957 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 -- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 msgr2=0x7fa0e815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 -- 172.21.15.121:0/4280458957 >> v1:172.21.15.122:6789/0 conn(0x7fa0e8072200 legacy=0x7fa0e81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 -- 172.21.15.121:0/4280458957 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8154b10 con 0x7fa0e814e790 2023-08-18T20:44:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e6d9d700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e659c700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e814e790 0x7fa0e806b2b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009840 tx=0x7fa0d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e06fd22218ee876 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.824+0000 7fa0e559a700 1 -- 172.21.15.121:0/4280458957 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0011830 con 0x7fa0e814e790 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0e559a700 1 -- 172.21.15.121:0/4280458957 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0011990 con 0x7fa0e814e790 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0e559a700 1 -- 172.21.15.121:0/4280458957 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0011d20 con 0x7fa0e814e790 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 -- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e814e790 msgr2=0x7fa0e806b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e814e790 0x7fa0e806b2b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009840 tx=0x7fa0d0009b50 comp rx=0 tx=0).stop 2023-08-18T20:44:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 -- 172.21.15.121:0/4280458957 shutdown_connections 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e806b7f0 0x7fa0e815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/4280458957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e814e790 0x7fa0e806b2b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 -- 172.21.15.121:0/4280458957 >> 172.21.15.121:0/4280458957 conn(0x7fa0e80c2ca0 msgr2=0x7fa0e80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 -- 172.21.15.121:0/4280458957 shutdown_connections 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.825+0000 7fa0ecdce700 1 -- 172.21.15.121:0/4280458957 wait complete. 2023-08-18T20:44:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.826+0000 7fa0ecdce700 1 Processor -- start 2023-08-18T20:44:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.826+0000 7fa0ecdce700 1 -- start start 2023-08-18T20:44:57.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 0x7fa0e8144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 0x7fa0e8145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80ab470 con 0x7fa0e806b7f0 2023-08-18T20:44:57.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c0670 con 0x7fa0e8072200 2023-08-18T20:44:57.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0ecdce700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c0390 con 0x7fa0e814e790 2023-08-18T20:44:57.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0e659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0e659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42514/0 (socket says 172.21.15.121:42514) 2023-08-18T20:44:57.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0e659c700 1 -- 172.21.15.121:0/2270671103 learned_addr learned my addr 172.21.15.121:0/2270671103 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:57.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0e6d9d700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 0x7fa0e8145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.827+0000 7fa0e5d9b700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 0x7fa0e8144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 -- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 msgr2=0x7fa0e8145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 0x7fa0e8145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 -- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 msgr2=0x7fa0e8144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:57.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 0x7fa0e8144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:57.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 -- 172.21.15.121:0/2270671103 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009b30 con 0x7fa0e806b7f0 2023-08-18T20:44:57.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e6d9d700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 0x7fa0e8145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:57.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e5d9b700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 0x7fa0e8144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:44:57.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0e659c700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00090b0 tx=0x7fa0d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00036a0 con 0x7fa0e806b7f0 2023-08-18T20:44:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d001e070 con 0x7fa0e806b7f0 2023-08-18T20:44:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0003a60 con 0x7fa0e806b7f0 2023-08-18T20:44:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d00094a0 con 0x7fa0e806b7f0 2023-08-18T20:44:57.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.828+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e8152e40 con 0x7fa0e806b7f0 2023-08-18T20:44:57.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.829+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e80aaef0 con 0x7fa0e806b7f0 2023-08-18T20:44:57.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.829+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0d0003bc0 con 0x7fa0e806b7f0 2023-08-18T20:44:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.830+0000 7fa0deffd700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 0x7fa0c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.830+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa0d0089870 con 0x7fa0e806b7f0 2023-08-18T20:44:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.830+0000 7fa0e5d9b700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 0x7fa0c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.830+0000 7fa0e5d9b700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 0x7fa0c806c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8155520 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:57.834+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa0e80aaef0 con 0x7fa0e806b7f0 2023-08-18T20:44:58.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.025+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e80aaef0 con 0x7fa0e806b7f0 2023-08-18T20:44:58.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.026+0000 7fa0deffd700 1 -- 172.21.15.121:0/2270671103 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7fa0e80aaef0 con 0x7fa0e806b7f0 2023-08-18T20:44:58.027 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:44:58.027 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:44:58.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 msgr2=0x7fa0c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 0x7fa0c806c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8155520 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 msgr2=0x7fa0e80c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00090b0 tx=0x7fa0d0004750 comp rx=0 tx=0).stop 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 shutdown_connections 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0e814e790 0x7fa0e8145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa0c806a0e0 0x7fa0c806c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0e806b7f0 0x7fa0e80c5860 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 --2- 172.21.15.121:0/2270671103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8072200 0x7fa0e8144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 >> 172.21.15.121:0/2270671103 conn(0x7fa0e80c2ca0 msgr2=0x7fa0e814c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 shutdown_connections 2023-08-18T20:44:58.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.029+0000 7fa0ecdce700 1 -- 172.21.15.121:0/2270671103 wait complete. 2023-08-18T20:44:58.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:44:31.655910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:44:32.362264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:44:45.110030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:44:46.431796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:44:58.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:44:58.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.168+0000 7fdc67e9c700 1 Processor -- start 2023-08-18T20:44:58.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.168+0000 7fdc67e9c700 1 -- start start 2023-08-18T20:44:58.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdc6006a7e0 0x7fdc600c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdc600a6290 0x7fdc600c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600c5e50 con 0x7fdc600a6290 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600c4f40 con 0x7fdc6006a7e0 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc67e9c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c6120 con 0x7fdc600c0c50 2023-08-18T20:44:58.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdc600a6290 0x7fdc600c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdc600a6290 0x7fdc600c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42526/0 (socket says 172.21.15.121:42526) 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 -- 172.21.15.121:0/1789210095 learned_addr learned my addr 172.21.15.121:0/1789210095 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 -- 172.21.15.121:0/1789210095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 msgr2=0x7fdc6006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 --2- 172.21.15.121:0/1789210095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 -- 172.21.15.121:0/1789210095 >> v2:172.21.15.122:3300/0 conn(0x7fdc6006a7e0 msgr2=0x7fdc600c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 --2- 172.21.15.121:0/1789210095 >> v2:172.21.15.122:3300/0 conn(0x7fdc6006a7e0 0x7fdc600c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 -- 172.21.15.121:0/1789210095 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc601551f0 con 0x7fdc600a6290 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc66439700 1 --2- 172.21.15.121:0/1789210095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc600c5910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdc60067580 tx=0x7fdc5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a326a4c0ef7cd5af server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc64c36700 1 -- 172.21.15.121:0/1789210095 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800e070 con 0x7fdc600a6290 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc64c36700 1 -- 172.21.15.121:0/1789210095 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800b9c0 con 0x7fdc600a6290 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.169+0000 7fdc64c36700 1 -- 172.21.15.121:0/1789210095 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800bd70 con 0x7fdc600a6290 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1789210095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 msgr2=0x7fdc600c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1789210095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc600c5910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdc60067580 tx=0x7fdc5800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1789210095 shutdown_connections 2023-08-18T20:44:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1789210095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc600c5910 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1789210095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1789210095 >> v2:172.21.15.122:3300/0 conn(0x7fdc6006a7e0 0x7fdc600c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1789210095 >> 172.21.15.121:0/1789210095 conn(0x7fdc600c6b10 msgr2=0x7fdc600c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1789210095 shutdown_connections 2023-08-18T20:44:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.170+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1789210095 wait complete. 2023-08-18T20:44:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.171+0000 7fdc67e9c700 1 Processor -- start 2023-08-18T20:44:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.171+0000 7fdc67e9c700 1 -- start start 2023-08-18T20:44:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc6006a7e0 0x7fdc6014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601ecb90 con 0x7fdc600a6290 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601ece70 con 0x7fdc6006a7e0 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc67e9c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601ed150 con 0x7fdc600c0c50 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42528/0 (socket says 172.21.15.121:42528) 2023-08-18T20:44:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 -- 172.21.15.121:0/1660969257 learned_addr learned my addr 172.21.15.121:0/1660969257 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65c38700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc6006a7e0 0x7fdc6014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc66439700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 -- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 msgr2=0x7fdc6014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6014be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 -- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc6006a7e0 msgr2=0x7fdc6014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc6006a7e0 0x7fdc6014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.172+0000 7fdc65437700 1 -- 172.21.15.121:0/1660969257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009b30 con 0x7fdc600a6290 2023-08-18T20:44:58.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc65437700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b530 tx=0x7fdc5000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50011830 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50011990 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc601ed430 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50011d40 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.173+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6014d380 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.174+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc60074730 con 0x7fdc600a6290 2023-08-18T20:44:58.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.174+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc5001a400 con 0x7fdc600a6290 2023-08-18T20:44:58.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.175+0000 7fdc567fc700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 0x7fdc4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.175+0000 7fdc65c38700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 0x7fdc4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.175+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fdc50088810 con 0x7fdc600a6290 2023-08-18T20:44:58.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.175+0000 7fdc65c38700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 0x7fdc4406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009970 tx=0x7fdc5c009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.179+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdc50053cf0 con 0x7fdc600a6290 2023-08-18T20:44:58.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.367+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdc600c4a10 con 0x7fdc600a6290 2023-08-18T20:44:58.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.368+0000 7fdc567fc700 1 -- 172.21.15.121:0/1660969257 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc50057310 con 0x7fdc600a6290 2023-08-18T20:44:58.368 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:44:58.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 msgr2=0x7fdc4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 0x7fdc4406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009970 tx=0x7fdc5c009110 comp rx=0 tx=0).stop 2023-08-18T20:44:58.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 msgr2=0x7fdc6014b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b530 tx=0x7fdc5000b840 comp rx=0 tx=0).stop 2023-08-18T20:44:58.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 shutdown_connections 2023-08-18T20:44:58.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc600c0c50 0x7fdc6014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc6006a7e0 0x7fdc6014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdc4406a0e0 0x7fdc4406c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 --2- 172.21.15.121:0/1660969257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc600a6290 0x7fdc6014b920 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 >> 172.21.15.121:0/1660969257 conn(0x7fdc600c6b10 msgr2=0x7fdc600a71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 shutdown_connections 2023-08-18T20:44:58.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.370+0000 7fdc67e9c700 1 -- 172.21.15.121:0/1660969257 wait complete. 2023-08-18T20:44:58.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:44:58.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.504+0000 7f79c3996700 1 Processor -- start 2023-08-18T20:44:58.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.504+0000 7f79c3996700 1 -- start start 2023-08-18T20:44:58.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c3996700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f79bc0c7380 0x7f79bc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c3996700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc0a6ed0 0x7f79bc06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c3996700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc158ae0 con 0x7f79bc06feb0 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c3996700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc155370 con 0x7f79bc0c7380 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c3996700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0c7760 con 0x7f79bc0a6ed0 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c1732700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f79bc0c7380 0x7f79bc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c1732700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f79bc0c7380 0x7f79bc1585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42536/0 (socket says 172.21.15.121:42536) 2023-08-18T20:44:58.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.505+0000 7f79c1732700 1 -- 172.21.15.121:0/4176214496 learned_addr learned my addr 172.21.15.121:0/4176214496 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c0f31700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc0a6ed0 0x7f79bc06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c1732700 1 -- 172.21.15.121:0/4176214496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc0a6ed0 msgr2=0x7f79bc06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c1732700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc0a6ed0 0x7f79bc06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c1732700 1 -- 172.21.15.121:0/4176214496 >> v1:172.21.15.122:6789/0 conn(0x7f79bc06feb0 legacy=0x7f79bc0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c1732700 1 -- 172.21.15.121:0/4176214496 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc154760 con 0x7f79bc0c7380 2023-08-18T20:44:58.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c1732700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1585a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0098f0 tx=0x7f79ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60958d387282f7b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79b3fff700 1 -- 172.21.15.121:0/4176214496 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac004230 con 0x7f79bc0c7380 2023-08-18T20:44:58.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79b3fff700 1 -- 172.21.15.121:0/4176214496 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac004390 con 0x7f79bc0c7380 2023-08-18T20:44:58.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79b3fff700 1 -- 172.21.15.121:0/4176214496 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0036a0 con 0x7f79bc0c7380 2023-08-18T20:44:58.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c3996700 1 -- 172.21.15.121:0/4176214496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 msgr2=0x7f79bc1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c3996700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1585a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0098f0 tx=0x7f79ac009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:58.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.506+0000 7f79c3996700 1 -- 172.21.15.121:0/4176214496 shutdown_connections 2023-08-18T20:44:58.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.507+0000 7f79c3996700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1585a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.507+0000 7f79c3996700 1 --2- 172.21.15.121:0/4176214496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc0a6ed0 0x7f79bc06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.507+0000 7f79c3996700 1 -- 172.21.15.121:0/4176214496 >> 172.21.15.121:0/4176214496 conn(0x7f79bc0c7bf0 msgr2=0x7f79bc0c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.507+0000 7f79c3996700 1 -- 172.21.15.121:0/4176214496 shutdown_connections 2023-08-18T20:44:58.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.507+0000 7f79c3996700 1 -- 172.21.15.121:0/4176214496 wait complete. 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.508+0000 7f79c3996700 1 Processor -- start 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.508+0000 7f79c3996700 1 -- start start 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc06feb0 0x7f79bc0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79bc0a6ed0 0x7f79bc0c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0bf040 con 0x7f79bc0c7380 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0a8710 con 0x7f79bc0a6ed0 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c3996700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc1eaaa0 con 0x7f79bc06feb0 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42544/0 (socket says 172.21.15.121:42544) 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 -- 172.21.15.121:0/3208318578 learned_addr learned my addr 172.21.15.121:0/3208318578 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1732700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc06feb0 0x7f79bc0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c0f31700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79bc0a6ed0 0x7f79bc0c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 -- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc06feb0 msgr2=0x7f79bc0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc06feb0 0x7f79bc0c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 -- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79bc0a6ed0 msgr2=0x7f79bc0c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79bc0a6ed0 0x7f79bc0c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.509+0000 7f79c1f33700 1 -- 172.21.15.121:0/3208318578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009550 con 0x7f79bc0c7380 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79c1f33700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f79b400b9a0 tx=0x7f79b400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400d850 con 0x7f79bc0c7380 2023-08-18T20:44:58.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400d9b0 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc1eda30 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400dd60 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.510+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc0bfe30 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.511+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc0c0050 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.511+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79b400e420 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.512+0000 7f79b1ffb700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 0x7f79a006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.512+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f79b40889a0 con 0x7f79bc0c7380 2023-08-18T20:44:58.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.512+0000 7f79c1732700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 0x7f79a006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.512+0000 7f79c1732700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 0x7f79a006c5d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009130 tx=0x7f79ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.516+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f79b4053d30 con 0x7f79bc0c7380 2023-08-18T20:44:58.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.704+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79bc074730 con 0x7f79bc0c7380 2023-08-18T20:44:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.704+0000 7f79b1ffb700 1 -- 172.21.15.121:0/3208318578 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79b4057350 con 0x7f79bc0c7380 2023-08-18T20:44:58.705 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:44:58.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 msgr2=0x7f79a006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 0x7f79a006c5d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009130 tx=0x7f79ac008030 comp rx=0 tx=0).stop 2023-08-18T20:44:58.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 msgr2=0x7f79bc1e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f79b400b9a0 tx=0x7f79b400bcb0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 shutdown_connections 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f79a006a110 0x7f79a006c5d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79bc0c7380 0x7f79bc1e95b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79bc06feb0 0x7f79bc0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 --2- 172.21.15.121:0/3208318578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79bc0a6ed0 0x7f79bc0c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.706+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 >> 172.21.15.121:0/3208318578 conn(0x7f79bc0c7bf0 msgr2=0x7f79bc1526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.707+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 shutdown_connections 2023-08-18T20:44:58.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.707+0000 7f79c3996700 1 -- 172.21.15.121:0/3208318578 wait complete. 2023-08-18T20:44:58.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:44:58.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.842+0000 7fc631e83700 1 Processor -- start 2023-08-18T20:44:58.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.842+0000 7fc631e83700 1 -- start start 2023-08-18T20:44:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc631e83700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc62c14fb90 0x7fc62c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc631e83700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc62c155e00 0x7fc62c156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc631e83700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c155970 con 0x7fc62c152250 2023-08-18T20:44:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc631e83700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c14ff70 con 0x7fc62c14fb90 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc631e83700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c1567b0 con 0x7fc62c155e00 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc62c14fb90 0x7fc62c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc62c14fb90 0x7fc62c0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42548/0 (socket says 172.21.15.121:42548) 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 -- 172.21.15.121:0/2090387313 learned_addr learned my addr 172.21.15.121:0/2090387313 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62bfff700 1 --2- 172.21.15.121:0/2090387313 >> v2:172.21.15.122:3300/0 conn(0x7fc62c155e00 0x7fc62c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 -- 172.21.15.121:0/2090387313 >> v2:172.21.15.122:3300/0 conn(0x7fc62c155e00 msgr2=0x7fc62c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 --2- 172.21.15.121:0/2090387313 >> v2:172.21.15.122:3300/0 conn(0x7fc62c155e00 0x7fc62c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 -- 172.21.15.121:0/2090387313 >> v1:172.21.15.122:6789/0 conn(0x7fc62c152250 legacy=0x7fc62c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 -- 172.21.15.121:0/2090387313 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c06e830 con 0x7fc62c14fb90 2023-08-18T20:44:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62b7fe700 1 --2- 172.21.15.121:0/2090387313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c0c5d10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc62c073c60 tx=0x7fc614009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe2d96aacd5b0d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.843+0000 7fc62a7fc700 1 -- 172.21.15.121:0/2090387313 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614004230 con 0x7fc62c14fb90 2023-08-18T20:44:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc62a7fc700 1 -- 172.21.15.121:0/2090387313 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614004390 con 0x7fc62c14fb90 2023-08-18T20:44:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc62a7fc700 1 -- 172.21.15.121:0/2090387313 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140036a0 con 0x7fc62c14fb90 2023-08-18T20:44:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 -- 172.21.15.121:0/2090387313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 msgr2=0x7fc62c0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 --2- 172.21.15.121:0/2090387313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c0c5d10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc62c073c60 tx=0x7fc614009bd0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 -- 172.21.15.121:0/2090387313 shutdown_connections 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 --2- 172.21.15.121:0/2090387313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c0c5d10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 --2- 172.21.15.121:0/2090387313 >> v2:172.21.15.122:3300/0 conn(0x7fc62c155e00 0x7fc62c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 -- 172.21.15.121:0/2090387313 >> 172.21.15.121:0/2090387313 conn(0x7fc62c0c6b10 msgr2=0x7fc62c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 -- 172.21.15.121:0/2090387313 shutdown_connections 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.844+0000 7fc631e83700 1 -- 172.21.15.121:0/2090387313 wait complete. 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.845+0000 7fc631e83700 1 Processor -- start 2023-08-18T20:44:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.845+0000 7fc631e83700 1 -- start start 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc62c152250 0x7fc62c1e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc62c155e00 0x7fc62c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0bc850 con 0x7fc62c14fb90 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0aa240 con 0x7fc62c155e00 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc631e83700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1e8570 con 0x7fc62c152250 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42554/0 (socket says 172.21.15.121:42554) 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 -- 172.21.15.121:0/1755986508 learned_addr learned my addr 172.21.15.121:0/1755986508 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62affd700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc62c152250 0x7fc62c1e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62bfff700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc62c155e00 0x7fc62c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 -- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc62c152250 msgr2=0x7fc62c1e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc62c152250 0x7fc62c1e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 -- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc62c155e00 msgr2=0x7fc62c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc62c155e00 0x7fc62c151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.846+0000 7fc62b7fe700 1 -- 172.21.15.121:0/1755986508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614009550 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc62b7fe700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc614009130 tx=0x7fc614004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614011630 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614011790 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c0a9c80 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614011b40 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.847+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c1eacd0 con 0x7fc62c14fb90 2023-08-18T20:44:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.848+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c074730 con 0x7fc62c14fb90 2023-08-18T20:44:58.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.848+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc614011ca0 con 0x7fc62c14fb90 2023-08-18T20:44:58.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.848+0000 7fc623fff700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 0x7fc60c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:58.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.849+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc614089ed0 con 0x7fc62c14fb90 2023-08-18T20:44:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.849+0000 7fc62affd700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 0x7fc60c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.849+0000 7fc62affd700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 0x7fc60c06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc62c150d60 tx=0x7fc61c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:58.853+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc6140552f0 con 0x7fc62c14fb90 2023-08-18T20:44:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.043+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc62c0c6620 con 0x7fc62c14fb90 2023-08-18T20:44:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.043+0000 7fc623fff700 1 -- 172.21.15.121:0/1755986508 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc614058910 con 0x7fc62c14fb90 2023-08-18T20:44:59.044 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:59.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 msgr2=0x7fc60c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 0x7fc60c06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc62c150d60 tx=0x7fc61c009040 comp rx=0 tx=0).stop 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 msgr2=0x7fc62c1e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc614009130 tx=0x7fc614004750 comp rx=0 tx=0).stop 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 shutdown_connections 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc62c155e00 0x7fc62c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc60c06a0e0 0x7fc60c06c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62c14fb90 0x7fc62c1e8aa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 --2- 172.21.15.121:0/1755986508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc62c152250 0x7fc62c1e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 >> 172.21.15.121:0/1755986508 conn(0x7fc62c0c6b10 msgr2=0x7fc62c14dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 shutdown_connections 2023-08-18T20:44:59.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.045+0000 7fc631e83700 1 -- 172.21.15.121:0/1755986508 wait complete. 2023-08-18T20:44:59.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:44:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 Processor -- start 2023-08-18T20:44:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 -- start start 2023-08-18T20:44:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 0x7f2f740c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f74157c10 0x7f2f741580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f740c21f0 con 0x7f2f7406a510 2023-08-18T20:44:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f740c2ba0 con 0x7f2f74157c10 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.181+0000 7f2f79035700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f740c6300 con 0x7f2f740c1cf0 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f74157c10 0x7f2f741580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f74157c10 0x7f2f741580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42564/0 (socket says 172.21.15.121:42564) 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 -- 172.21.15.121:0/1480572538 learned_addr learned my addr 172.21.15.121:0/1480572538 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1480572538 >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 0x7f2f740c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 -- 172.21.15.121:0/1480572538 >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 msgr2=0x7f2f740c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 --2- 172.21.15.121:0/1480572538 >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 0x7f2f740c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 -- 172.21.15.121:0/1480572538 >> v1:172.21.15.122:6789/0 conn(0x7f2f7406a510 legacy=0x7f2f74151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 -- 172.21.15.121:0/1480572538 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f740c5b20 con 0x7f2f74157c10 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1480572538 >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 0x7f2f740c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f7359e700 1 --2- 172.21.15.121:0/1480572538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f74157c10 0x7f2f741580a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f741556f0 tx=0x7f2f6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894a565b39afdfac server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f71d9b700 1 -- 172.21.15.121:0/1480572538 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00e070 con 0x7f2f74157c10 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f71d9b700 1 -- 172.21.15.121:0/1480572538 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c003a20 con 0x7f2f74157c10 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.182+0000 7f2f71d9b700 1 -- 172.21.15.121:0/1480572538 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c003dd0 con 0x7f2f74157c10 2023-08-18T20:44:59.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 -- 172.21.15.121:0/1480572538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f74157c10 msgr2=0x7f2f741580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 --2- 172.21.15.121:0/1480572538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f74157c10 0x7f2f741580a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f741556f0 tx=0x7f2f6c00b330 comp rx=0 tx=0).stop 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 -- 172.21.15.121:0/1480572538 shutdown_connections 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 --2- 172.21.15.121:0/1480572538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f74157c10 0x7f2f741580a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 --2- 172.21.15.121:0/1480572538 >> v2:172.21.15.122:3300/0 conn(0x7f2f740c1cf0 0x7f2f740c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 -- 172.21.15.121:0/1480572538 >> 172.21.15.121:0/1480572538 conn(0x7f2f740c6b10 msgr2=0x7f2f740c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 -- 172.21.15.121:0/1480572538 shutdown_connections 2023-08-18T20:44:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.183+0000 7f2f79035700 1 -- 172.21.15.121:0/1480572538 wait complete. 2023-08-18T20:44:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.184+0000 7f2f79035700 1 Processor -- start 2023-08-18T20:44:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.184+0000 7f2f79035700 1 -- start start 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 0x7f2f741e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 0x7f2f741e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7406d060 con 0x7f2f7406a510 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740a9f10 con 0x7f2f740c1cf0 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f79035700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740a9c30 con 0x7f2f74157c10 2023-08-18T20:44:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42568/0 (socket says 172.21.15.121:42568) 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 -- 172.21.15.121:0/1474857041 learned_addr learned my addr 172.21.15.121:0/1474857041 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 0x7f2f741e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f7359e700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 0x7f2f741e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 -- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 msgr2=0x7f2f741e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 0x7f2f741e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 -- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 msgr2=0x7f2f741e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 0x7f2f741e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 -- 172.21.15.121:0/1474857041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009b30 con 0x7f2f7406a510 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f7359e700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 0x7f2f741e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 0x7f2f741e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.185+0000 7f2f72d9d700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c4a0 tx=0x7f2f6400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.186+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640054e0 con 0x7f2f7406a510 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.186+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64003680 con 0x7f2f7406a510 2023-08-18T20:44:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.186+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f741ea350 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.186+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64003a30 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.186+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f741eac50 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.187+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f74074730 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.187+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f64003b90 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.187+0000 7f2f5b7fe700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 0x7f2f6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.188+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 0x7f2f6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.188+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f2f64087d80 con 0x7f2f7406a510 2023-08-18T20:44:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.188+0000 7f2f7259c700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 0x7f2f6006c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f740a5c40 tx=0x7f2f68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.192+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2f640531a0 con 0x7f2f7406a510 2023-08-18T20:44:59.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.380+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f740c18c0 con 0x7f2f7406a510 2023-08-18T20:44:59.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.380+0000 7f2f5b7fe700 1 -- 172.21.15.121:0/1474857041 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f640170a0 con 0x7f2f7406a510 2023-08-18T20:44:59.381 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 msgr2=0x7f2f6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 0x7f2f6006c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f740a5c40 tx=0x7f2f68008040 comp rx=0 tx=0).stop 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 msgr2=0x7f2f7414c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c4a0 tx=0x7f2f6400c860 comp rx=0 tx=0).stop 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 shutdown_connections 2023-08-18T20:44:59.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2f74157c10 0x7f2f741e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2f6006a0e0 0x7f2f6006c5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7406a510 0x7f2f7414c930 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 --2- 172.21.15.121:0/1474857041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f740c1cf0 0x7f2f741e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 >> 172.21.15.121:0/1474857041 conn(0x7f2f740c6b10 msgr2=0x7f2f74073340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 shutdown_connections 2023-08-18T20:44:59.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.382+0000 7f2f79035700 1 -- 172.21.15.121:0/1474857041 wait complete. 2023-08-18T20:44:59.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:44:59.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.517+0000 7f3795bd9700 1 Processor -- start 2023-08-18T20:44:59.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.517+0000 7f3795bd9700 1 -- start start 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f3795bd9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f379014ea70 0x7f37900c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f3795bd9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3790151930 0x7f3790151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f3795bd9700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37900c6840 con 0x7f37900a6200 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f3795bd9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900c2de0 con 0x7f3790151930 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f3795bd9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3790152300 con 0x7f379014ea70 2023-08-18T20:44:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f378ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3790151930 0x7f3790151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f378ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3790151930 0x7f3790151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42580/0 (socket says 172.21.15.121:42580) 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f378ffff700 1 -- 172.21.15.121:0/1631874137 learned_addr learned my addr 172.21.15.121:0/1631874137 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.518+0000 7f378f7fe700 1 --2- 172.21.15.121:0/1631874137 >> v2:172.21.15.122:3300/0 conn(0x7f379014ea70 0x7f37900c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378ffff700 1 -- 172.21.15.121:0/1631874137 >> v2:172.21.15.122:3300/0 conn(0x7f379014ea70 msgr2=0x7f37900c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378ffff700 1 --2- 172.21.15.121:0/1631874137 >> v2:172.21.15.122:3300/0 conn(0x7f379014ea70 0x7f37900c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378ffff700 1 -- 172.21.15.121:0/1631874137 >> v1:172.21.15.122:6789/0 conn(0x7f37900a6200 legacy=0x7f37900c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378ffff700 1 -- 172.21.15.121:0/1631874137 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900c1aa0 con 0x7f3790151930 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378ffff700 1 --2- 172.21.15.121:0/1631874137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790151930 0x7f3790151dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f37900a94a0 tx=0x7f378800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c5224de98b25ca server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378e7fc700 1 -- 172.21.15.121:0/1631874137 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800e070 con 0x7f3790151930 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378e7fc700 1 -- 172.21.15.121:0/1631874137 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788003a20 con 0x7f3790151930 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f378e7fc700 1 -- 172.21.15.121:0/1631874137 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788003dd0 con 0x7f3790151930 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 -- 172.21.15.121:0/1631874137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790151930 msgr2=0x7f3790151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 --2- 172.21.15.121:0/1631874137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790151930 0x7f3790151dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f37900a94a0 tx=0x7f378800b330 comp rx=0 tx=0).stop 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 -- 172.21.15.121:0/1631874137 shutdown_connections 2023-08-18T20:44:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 --2- 172.21.15.121:0/1631874137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790151930 0x7f3790151dc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 --2- 172.21.15.121:0/1631874137 >> v2:172.21.15.122:3300/0 conn(0x7f379014ea70 0x7f37900c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 -- 172.21.15.121:0/1631874137 >> 172.21.15.121:0/1631874137 conn(0x7f37900a8800 msgr2=0x7f37900a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 -- 172.21.15.121:0/1631874137 shutdown_connections 2023-08-18T20:44:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.519+0000 7f3795bd9700 1 -- 172.21.15.121:0/1631874137 wait complete. 2023-08-18T20:44:59.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 Processor -- start 2023-08-18T20:44:59.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 -- start start 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37900a6200 0x7f379014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3790151930 0x7f3790149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790148d10 con 0x7f379014ea70 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790150730 con 0x7f3790151930 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.521+0000 7f3795bd9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3790150a10 con 0x7f37900a6200 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42584/0 (socket says 172.21.15.121:42584) 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 -- 172.21.15.121:0/3346673205 learned_addr learned my addr 172.21.15.121:0/3346673205 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378f7fe700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37900a6200 0x7f379014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378ffff700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3790151930 0x7f3790149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 -- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37900a6200 msgr2=0x7f379014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37900a6200 0x7f379014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 -- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3790151930 msgr2=0x7f3790149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3790151930 0x7f3790149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 -- 172.21.15.121:0/3346673205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009b30 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f378effd700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f378000b450 tx=0x7f378000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780011830 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3780011990 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3790150cf0 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780011d40 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.522+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901df510 con 0x7f379014ea70 2023-08-18T20:44:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.523+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790074730 con 0x7f379014ea70 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.524+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f378001a400 con 0x7f379014ea70 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.524+0000 7f3777fff700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 0x7f377c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.524+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3780088460 con 0x7f379014ea70 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.524+0000 7f378f7fe700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 0x7f377c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.524+0000 7f378f7fe700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 0x7f377c06c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3784006b20 tx=0x7f3784008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.528+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3780053880 con 0x7f379014ea70 2023-08-18T20:44:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.717+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37900c44c0 con 0x7f379014ea70 2023-08-18T20:44:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.718+0000 7f3777fff700 1 -- 172.21.15.121:0/3346673205 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v37) v1 ==== 105+0+11 (secure 0 0 0) 0x7f378000be60 con 0x7f379014ea70 2023-08-18T20:44:59.718 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:44:59.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 msgr2=0x7f377c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 0x7f377c06c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3784006b20 tx=0x7f3784008040 comp rx=0 tx=0).stop 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 msgr2=0x7f37901defd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f378000b450 tx=0x7f378000b760 comp rx=0 tx=0).stop 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 shutdown_connections 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3790151930 0x7f3790149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37900a6200 0x7f379014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f377c06a0e0 0x7f377c06c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 --2- 172.21.15.121:0/3346673205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379014ea70 0x7f37901defd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 >> 172.21.15.121:0/3346673205 conn(0x7f37900a8800 msgr2=0x7f37900a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 shutdown_connections 2023-08-18T20:44:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.720+0000 7f3795bd9700 1 -- 172.21.15.121:0/3346673205 wait complete. 2023-08-18T20:44:59.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:44:59.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.854+0000 7fe7d7297700 1 Processor -- start 2023-08-18T20:44:59.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.854+0000 7fe7d7297700 1 -- start start 2023-08-18T20:44:59.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d7297700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe7d006a510 0x7fe7d006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d7297700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe7d0151c70 0x7fe7d006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d7297700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d0155420 con 0x7fe7d00a5d30 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d7297700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d0154f30 con 0x7fe7d006a510 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d7297700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00c05a0 con 0x7fe7d0151c70 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d5033700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe7d006a510 0x7fe7d006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d5033700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe7d006a510 0x7fe7d006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42590/0 (socket says 172.21.15.121:42590) 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d5033700 1 -- 172.21.15.121:0/1797138764 learned_addr learned my addr 172.21.15.121:0/1797138764 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d4832700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe7d00a5d30 0x7fe7d0151560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49174/0 (socket says 172.21.15.121:49174) 2023-08-18T20:44:59.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d5033700 1 -- 172.21.15.121:0/1797138764 >> v2:172.21.15.122:3300/0 conn(0x7fe7d0151c70 msgr2=0x7fe7d006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.855+0000 7fe7d5033700 1 --2- 172.21.15.121:0/1797138764 >> v2:172.21.15.122:3300/0 conn(0x7fe7d0151c70 0x7fe7d006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d5033700 1 -- 172.21.15.121:0/1797138764 >> v1:172.21.15.121:6789/0 conn(0x7fe7d00a5d30 legacy=0x7fe7d0151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d5033700 1 -- 172.21.15.121:0/1797138764 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0155140 con 0x7fe7d006a510 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7c7fff700 1 -- 172.21.15.121:0/1797138764 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464515608 0 0) 0x7fe7d0155420 con 0x7fe7d00a5d30 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d5033700 1 --2- 172.21.15.121:0/1797138764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d006d5b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098f0 tx=0x7fe7c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6048ef0727675808 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7c7fff700 1 -- 172.21.15.121:0/1797138764 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000b860 con 0x7fe7d006a510 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7c7fff700 1 -- 172.21.15.121:0/1797138764 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000b9c0 con 0x7fe7d006a510 2023-08-18T20:44:59.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7c7fff700 1 -- 172.21.15.121:0/1797138764 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000bd50 con 0x7fe7d006a510 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 -- 172.21.15.121:0/1797138764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 msgr2=0x7fe7d006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 --2- 172.21.15.121:0/1797138764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d006d5b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098f0 tx=0x7fe7c0009c00 comp rx=0 tx=0).stop 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 -- 172.21.15.121:0/1797138764 shutdown_connections 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 --2- 172.21.15.121:0/1797138764 >> v2:172.21.15.122:3300/0 conn(0x7fe7d0151c70 0x7fe7d006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 --2- 172.21.15.121:0/1797138764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d006d5b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 -- 172.21.15.121:0/1797138764 >> 172.21.15.121:0/1797138764 conn(0x7fe7d00a8800 msgr2=0x7fe7d00a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:44:59.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 -- 172.21.15.121:0/1797138764 shutdown_connections 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.856+0000 7fe7d7297700 1 -- 172.21.15.121:0/1797138764 wait complete. 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 Processor -- start 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 -- start start 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 0x7fe7d014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7d0151c70 0x7fe7d014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01e9f30 con 0x7fe7d006a510 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01ea3c0 con 0x7fe7d00a5d30 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d7297700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01ecd40 con 0x7fe7d0151c70 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d5033700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d5033700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42596/0 (socket says 172.21.15.121:42596) 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.858+0000 7fe7d5033700 1 -- 172.21.15.121:0/2027865892 learned_addr learned my addr 172.21.15.121:0/2027865892 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 -- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7d0151c70 msgr2=0x7fe7d014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7d0151c70 0x7fe7d014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 -- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 msgr2=0x7fe7d014a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d4832700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 0x7fe7d014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 0x7fe7d014a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 -- 172.21.15.121:0/2027865892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0009550 con 0x7fe7d006a510 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d4832700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 0x7fe7d014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d5033700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009c40 tx=0x7fe7c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00045b0 con 0x7fe7d006a510 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d01eca60 con 0x7fe7d006a510 2023-08-18T20:44:59.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c001f070 con 0x7fe7d006a510 2023-08-18T20:44:59.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00038c0 con 0x7fe7d006a510 2023-08-18T20:44:59.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.859+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d01e98e0 con 0x7fe7d006a510 2023-08-18T20:44:59.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.860+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d01ea210 con 0x7fe7d006a510 2023-08-18T20:44:59.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.860+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7c0021030 con 0x7fe7d006a510 2023-08-18T20:44:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.861+0000 7fe7c5ffb700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 0x7fe7b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:44:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.861+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fe7c0089dc0 con 0x7fe7d006a510 2023-08-18T20:44:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.861+0000 7fe7d4832700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 0x7fe7b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:44:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.861+0000 7fe7d4832700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 0x7fe7b406c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7d006ebe0 tx=0x7fe7cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:44:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:44:59.865+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe7c00551e0 con 0x7fe7d006a510 2023-08-18T20:45:00.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.053+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe7d0074730 con 0x7fe7d006a510 2023-08-18T20:45:00.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.054+0000 7fe7c5ffb700 1 -- 172.21.15.121:0/2027865892 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v37) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe7c0058800 con 0x7fe7d006a510 2023-08-18T20:45:00.054 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:00.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 msgr2=0x7fe7b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 0x7fe7b406c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7d006ebe0 tx=0x7fe7cc009040 comp rx=0 tx=0).stop 2023-08-18T20:45:00.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 msgr2=0x7fe7d0071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009c40 tx=0x7fe7c0004750 comp rx=0 tx=0).stop 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 shutdown_connections 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7d0151c70 0x7fe7d014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe7b406a0e0 0x7fe7b406c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7d006a510 0x7fe7d0071b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 --2- 172.21.15.121:0/2027865892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7d00a5d30 0x7fe7d014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 >> 172.21.15.121:0/2027865892 conn(0x7fe7d00a8800 msgr2=0x7fe7d014dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:00.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 shutdown_connections 2023-08-18T20:45:00.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.056+0000 7fe7d7297700 1 -- 172.21.15.121:0/2027865892 wait complete. 2023-08-18T20:45:00.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:45:00.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.189+0000 7f337c65e700 1 Processor -- start 2023-08-18T20:45:00.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.189+0000 7f337c65e700 1 -- start start 2023-08-18T20:45:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337c65e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f337414afc0 0x7f33740c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337c65e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740ac7b0 con 0x7f33740c7c50 2023-08-18T20:45:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337c65e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740ac100 con 0x7f33740bd3e0 2023-08-18T20:45:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337c65e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337414b3a0 con 0x7f337414afc0 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337a3fa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f337414afc0 0x7f33740c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337abfb700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f33740c7c50 0x7f3374158300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49186/0 (socket says 172.21.15.121:49186) 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337abfb700 1 -- 172.21.15.121:0/2937780509 learned_addr learned my addr 172.21.15.121:0/2937780509 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337a3fa700 1 -- 172.21.15.121:0/2937780509 >> v1:172.21.15.122:6789/0 conn(0x7f33740bd3e0 legacy=0x7f3374157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337a3fa700 1 -- 172.21.15.121:0/2937780509 >> v1:172.21.15.121:6789/0 conn(0x7f33740c7c50 legacy=0x7f3374158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f337a3fa700 1 -- 172.21.15.121:0/2937780509 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374155260 con 0x7f337414afc0 2023-08-18T20:45:00.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.190+0000 7f33793f8700 1 -- 172.21.15.121:0/2937780509 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290800464 0 0) 0x7f33740ac7b0 con 0x7f33740c7c50 2023-08-18T20:45:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337a3fa700 1 --2- 172.21.15.121:0/2937780509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c46d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3364009840 tx=0x7f3364009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de2d9b4b8fcfad1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f33793f8700 1 -- 172.21.15.121:0/2937780509 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364011830 con 0x7f337414afc0 2023-08-18T20:45:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f33793f8700 1 -- 172.21.15.121:0/2937780509 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364011990 con 0x7f337414afc0 2023-08-18T20:45:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f33793f8700 1 -- 172.21.15.121:0/2937780509 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364011d20 con 0x7f337414afc0 2023-08-18T20:45:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 -- 172.21.15.121:0/2937780509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 msgr2=0x7f33740c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 --2- 172.21.15.121:0/2937780509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c46d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3364009840 tx=0x7f3364009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 -- 172.21.15.121:0/2937780509 shutdown_connections 2023-08-18T20:45:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 --2- 172.21.15.121:0/2937780509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c46d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 -- 172.21.15.121:0/2937780509 >> 172.21.15.121:0/2937780509 conn(0x7f33740c9d50 msgr2=0x7f33740ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 -- 172.21.15.121:0/2937780509 shutdown_connections 2023-08-18T20:45:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.191+0000 7f337c65e700 1 -- 172.21.15.121:0/2937780509 wait complete. 2023-08-18T20:45:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.193+0000 7f337c65e700 1 Processor -- start 2023-08-18T20:45:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.193+0000 7f337c65e700 1 -- start start 2023-08-18T20:45:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33740bd3e0 0x7f337414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 0x7f33741538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374151890 con 0x7f337414afc0 2023-08-18T20:45:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33740c0430 con 0x7f33740bd3e0 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337c65e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3374151b30 con 0x7f33740c7c50 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42612/0 (socket says 172.21.15.121:42612) 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 -- 172.21.15.121:0/1518601392 learned_addr learned my addr 172.21.15.121:0/1518601392 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337a3fa700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33740bd3e0 0x7f337414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f3379bf9700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 0x7f33741538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 -- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 msgr2=0x7f33741538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 0x7f33741538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 -- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33740bd3e0 msgr2=0x7f337414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33740bd3e0 0x7f337414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f337abfb700 1 -- 172.21.15.121:0/1518601392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640094a0 con 0x7f337414afc0 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.194+0000 7f3379bf9700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 0x7f33741538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f337abfb700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f336c002230 tx=0x7f336c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00ab70 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00acf0 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33740c06d0 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c007310 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.195+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337414f2e0 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.196+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33740c0e50 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.196+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f336c007470 con 0x7f337414afc0 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.196+0000 7f336affd700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 0x7f335806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.197+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f336c0884e0 con 0x7f337414afc0 2023-08-18T20:45:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.197+0000 7f337a3fa700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 0x7f335806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.197+0000 7f337a3fa700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 0x7f335806c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33640090b0 tx=0x7f336401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.201+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f33740c0e50 con 0x7f337414afc0 2023-08-18T20:45:00.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.404+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f337414f2e0 con 0x7f337414afc0 2023-08-18T20:45:00.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.404+0000 7f336affd700 1 -- 172.21.15.121:0/1518601392 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f337414f2e0 con 0x7f337414afc0 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 msgr2=0x7f335806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 0x7f335806c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33640090b0 tx=0x7f336401c040 comp rx=0 tx=0).stop 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 msgr2=0x7f33740c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f336c002230 tx=0x7f336c00cf50 comp rx=0 tx=0).stop 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 shutdown_connections 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f335806a0e0 0x7f335806c5a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f337414afc0 0x7f33740c1130 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33740bd3e0 0x7f337414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 --2- 172.21.15.121:0/1518601392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33740c7c50 0x7f33741538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 >> 172.21.15.121:0/1518601392 conn(0x7f33740c9d50 msgr2=0x7f3374154630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 shutdown_connections 2023-08-18T20:45:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.406+0000 7f337c65e700 1 -- 172.21.15.121:0/1518601392 wait complete. 2023-08-18T20:45:00.409 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:45:00.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-18T20:45:00.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:00.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:00.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:45:00.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:00.479 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-18T20:45:00.497 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:00.498 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:00.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16734 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-18T20:45:00.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:45:00.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.676+0000 7f0c57e05700 1 Processor -- start 2023-08-18T20:45:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.676+0000 7f0c57e05700 1 -- start start 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c57e05700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c500c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c57e05700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500c21f0 con 0x7f0c50157c10 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c57e05700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500c5b20 con 0x7f0c500c1cf0 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c57e05700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c2ba0 con 0x7f0c5006a510 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c563a2700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0c50157c10 0x7f0c501580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49204/0 (socket says 172.21.15.121:49204) 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c563a2700 1 -- 172.21.15.121:0/3188381154 learned_addr learned my addr 172.21.15.121:0/3188381154 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294138871 0 0) 0x7f0c500c21f0 con 0x7f0c50157c10 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c500c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c0035b0 con 0x7f0c50157c10 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758575254 0 0) 0x7f0c3c0035b0 con 0x7f0c50157c10 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 msgr2=0x7f0c500c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c500c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 >> v1:172.21.15.122:6789/0 conn(0x7f0c500c1cf0 legacy=0x7f0c50151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500c6510 con 0x7f0c50157c10 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f0c480019f0 con 0x7f0c50157c10 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 >> v1:172.21.15.121:6789/0 conn(0x7f0c50157c10 legacy=0x7f0c501580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.677+0000 7f0c54b9f700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c3c003aa0 0x7f0c3c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c3c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c3c0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00bba0 con 0x7f0c3c004850 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00bd10 con 0x7f0c3c003aa0 2023-08-18T20:45:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00bed0 con 0x7f0c5006a510 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c3c003aa0 0x7f0c3c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c3c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c563a2700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c3c0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 -- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 msgr2=0x7f0c3c0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c5006a510 0x7f0c3c0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 -- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c3c003aa0 msgr2=0x7f0c3c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c3c003aa0 0x7f0c3c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 -- 172.21.15.121:0/3188381154 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0035b0 con 0x7f0c3c004850 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c3c003aa0 0x7f0c3c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c553a0700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c3c004cd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c007fd0 tx=0x7f0c3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416597e9641b6e07 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0052d0 con 0x7f0c3c004850 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c005450 con 0x7f0c3c004850 2023-08-18T20:45:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.678+0000 7f0c54b9f700 1 -- 172.21.15.121:0/3188381154 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0038c0 con 0x7f0c3c004850 2023-08-18T20:45:00.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 -- 172.21.15.121:0/3188381154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 msgr2=0x7f0c3c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 --2- 172.21.15.121:0/3188381154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c3c004cd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c007fd0 tx=0x7f0c3c005880 comp rx=0 tx=0).stop 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c563a2700 1 -- 172.21.15.121:0/3188381154 reap_dead start 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 -- 172.21.15.121:0/3188381154 shutdown_connections 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 -- 172.21.15.121:0/3188381154 >> 172.21.15.121:0/3188381154 conn(0x7f0c500c6b10 msgr2=0x7f0c500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 -- 172.21.15.121:0/3188381154 shutdown_connections 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.679+0000 7f0c57e05700 1 -- 172.21.15.121:0/3188381154 wait complete. 2023-08-18T20:45:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.680+0000 7f0c57e05700 1 Processor -- start 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.680+0000 7f0c57e05700 1 -- start start 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c501ea690 0x7f0c50148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c5014b5e0 0x7f0c50154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501ed960 con 0x7f0c3c004850 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500ac650 con 0x7f0c5014b5e0 2023-08-18T20:45:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5006e690 con 0x7f0c501ea690 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42630/0 (socket says 172.21.15.121:42630) 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 -- 172.21.15.121:0/1749473374 learned_addr learned my addr 172.21.15.121:0/1749473374 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c553a0700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c501ea690 0x7f0c50148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c563a2700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c5014b5e0 0x7f0c50154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 -- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c501ea690 msgr2=0x7f0c50148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c501ea690 0x7f0c50148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 -- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c5014b5e0 msgr2=0x7f0c50154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c5014b5e0 0x7f0c50154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 -- 172.21.15.121:0/1749473374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c501ed2a0 con 0x7f0c3c004850 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c55ba1700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c40011cd0 tx=0x7f0c40009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004020 con 0x7f0c3c004850 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c40004180 con 0x7f0c3c004850 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c501ed580 con 0x7f0c3c004850 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004510 con 0x7f0c3c004850 2023-08-18T20:45:00.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.681+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5006d6d0 con 0x7f0c3c004850 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.682+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c50072a20 con 0x7f0c3c004850 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.683+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0c4000f940 con 0x7f0c3c004850 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.683+0000 7f0c467fc700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 0x7f0c3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.683+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f0c40088d50 con 0x7f0c3c004850 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.683+0000 7f0c553a0700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 0x7f0c3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.684+0000 7f0c553a0700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 0x7f0c3406c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005040 tx=0x7f0c4c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:00.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.688+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0c50072a20 con 0x7f0c3c004850 2023-08-18T20:45:00.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.924+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c50074730 con 0x7f0c3c004850 2023-08-18T20:45:00.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.924+0000 7f0c467fc700 1 -- 172.21.15.121:0/1749473374 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7f0c40022020 con 0x7f0c3c004850 2023-08-18T20:45:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:45:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 msgr2=0x7f0c3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 0x7f0c3406c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005040 tx=0x7f0c4c009030 comp rx=0 tx=0).stop 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 msgr2=0x7f0c501edd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c40011cd0 tx=0x7f0c40009e70 comp rx=0 tx=0).stop 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 shutdown_connections 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c5014b5e0 0x7f0c50154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0c3406a0e0 0x7f0c3406c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c3c004850 0x7f0c501edd80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 --2- 172.21.15.121:0/1749473374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c501ea690 0x7f0c50148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:00.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 >> 172.21.15.121:0/1749473374 conn(0x7f0c500c6b10 msgr2=0x7f0c50157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:00.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 shutdown_connections 2023-08-18T20:45:00.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:00.926+0000 7f0c57e05700 1 -- 172.21.15.121:0/1749473374 wait complete. 2023-08-18T20:45:00.939 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-08-18T20:45:00.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:45:00.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-08-18T20:45:00.940 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-18T20:45:00.940 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:00.940 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-08-18T20:45:00.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:45:00.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:45:00.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:00.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:00.941 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-08-18T20:45:00.962 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:45:00.962 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:00.963 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:45:00.964 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42151sec preferred_lft 42151sec 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc56:1d53:8eb3:4926/64 scope link noprefixroute 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c41:ffff:fe33:4b6a/64 scope link 2023-08-18T20:45:00.965 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.966 INFO:teuthology.orchestra.run.smithi122.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:45:00.966 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-18T20:45:00.966 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::e4bf:e4ff:fe4b:8325/64 scope link 2023-08-18T20:45:00.966 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:00.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:00.967 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:45:01.033 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:45:01.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.035 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-08-18T20:45:01.096 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-08-18T20:45:01.096 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:45:01.097 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:45:01.097 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:45:01.097 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:45:01.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.098 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:45:01.098 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:45:01.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:45:01.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:45:01.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:45:01.100 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:45:01.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.219 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:45:01.239 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-18T20:45:01.239 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:01.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-08-18T20:45:01.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:01.312 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:01.372 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:01.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:01.373 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:01.432 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-08-18T20:45:01.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:01.527 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:01.527 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:01.554 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:01.554 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:01.555 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:01.592 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:01.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:01.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:01.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:45:01.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:45:01.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs2,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:45:01.595 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:45:01.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.595 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:01.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:01.629 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:45:01.716 INFO:teuthology.orchestra.run.smithi122.stdout:client4973 2023-08-18T20:45:01.716 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:01.717 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:01.733 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-08-18T20:45:01.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.864+0000 7f184201a700 1 Processor -- start 2023-08-18T20:45:01.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.864+0000 7f184201a700 1 -- start start 2023-08-18T20:45:01.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f184201a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f184201a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f183c0c0230 0x7f183c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f184201a700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c0c6700 con 0x7f183c06a7e0 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f184201a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183c1554d0 con 0x7f183c0c0230 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f184201a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0a64b0 con 0x7f183c14b0c0 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f183affd700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f183c0c0230 0x7f183c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f183affd700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f183c0c0230 0x7f183c06a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52476/0 (socket says 172.21.15.121:52476) 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39048/0 (socket says 172.21.15.121:39048) 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.865+0000 7f183affd700 1 -- 172.21.15.121:0/1990588408 learned_addr learned my addr 172.21.15.121:0/1990588408 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183affd700 1 -- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 msgr2=0x7f183c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183affd700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183affd700 1 -- 172.21.15.121:0/1990588408 >> v1:172.21.15.122:6789/0 conn(0x7f183c06a7e0 legacy=0x7f183c06d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183affd700 1 -- 172.21.15.121:0/1990588408 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0a5ef0 con 0x7f183c0c0230 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183b7fe700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:01.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183a7fc700 1 -- 172.21.15.121:0/1990588408 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963894150 0 0) 0x7f183c0c6700 con 0x7f183c06a7e0 2023-08-18T20:45:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183affd700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c0c0230 0x7f183c06a2a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f182c0098f0 tx=0x7f182c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea53d93ca49ed3d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183a7fc700 1 -- 172.21.15.121:0/1990588408 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c011830 con 0x7f183c0c0230 2023-08-18T20:45:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183a7fc700 1 -- 172.21.15.121:0/1990588408 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c011990 con 0x7f183c0c0230 2023-08-18T20:45:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.866+0000 7f183a7fc700 1 -- 172.21.15.121:0/1990588408 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c011d20 con 0x7f183c0c0230 2023-08-18T20:45:01.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 -- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c0c0230 msgr2=0x7f183c06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c0c0230 0x7f183c06a2a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f182c0098f0 tx=0x7f182c009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 -- 172.21.15.121:0/1990588408 shutdown_connections 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 --2- 172.21.15.121:0/1990588408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c0c0230 0x7f183c06a2a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 -- 172.21.15.121:0/1990588408 >> 172.21.15.121:0/1990588408 conn(0x7f183c0a8770 msgr2=0x7f183c0a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 -- 172.21.15.121:0/1990588408 shutdown_connections 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.867+0000 7f184201a700 1 -- 172.21.15.121:0/1990588408 wait complete. 2023-08-18T20:45:01.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.868+0000 7f184201a700 1 Processor -- start 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.868+0000 7f184201a700 1 -- start start 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.868+0000 7f184201a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c06a7e0 0x7f183c0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.868+0000 7f184201a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1e9290 con 0x7f183c0c0230 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1586d0 con 0x7f183c06a7e0 2023-08-18T20:45:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1e9af0 con 0x7f183c14b0c0 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42646/0 (socket says 172.21.15.121:42646) 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 -- 172.21.15.121:0/1875456782 learned_addr learned my addr 172.21.15.121:0/1875456782 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183b7fe700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c06a7e0 0x7f183c0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183bfff700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 -- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 msgr2=0x7f183c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 -- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c06a7e0 msgr2=0x7f183c0c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c06a7e0 0x7f183c0c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 -- 172.21.15.121:0/1875456782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18240094a0 con 0x7f183c0c0230 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f183affd700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f182c009c40 tx=0x7f182c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c004300 con 0x7f183c0c0230 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c01f070 con 0x7f183c0c0230 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c009550 con 0x7f183c0c0230 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0036a0 con 0x7f183c0c0230 2023-08-18T20:45:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.869+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c1e94a0 con 0x7f183c0c0230 2023-08-18T20:45:01.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.870+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c074730 con 0x7f183c0c0230 2023-08-18T20:45:01.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.871+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f182c021030 con 0x7f183c0c0230 2023-08-18T20:45:01.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.871+0000 7f1833fff700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:01.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.871+0000 7f183b7fe700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:01.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.871+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f182c089c30 con 0x7f183c0c0230 2023-08-18T20:45:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.872+0000 7f183b7fe700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 0x7f181c06c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1824009cd0 tx=0x7f1824009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:01.876+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f182c0550f0 con 0x7f183c0c0230 2023-08-18T20:45:02.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.110+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f183c0c49b0 con 0x7f183c0c0230 2023-08-18T20:45:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.114+0000 7f1833fff700 1 -- 172.21.15.121:0/1875456782 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v11) v1 ==== 134+0+185 (secure 0 0 0) 0x7f182c0150c0 con 0x7f183c0c0230 2023-08-18T20:45:02.115 INFO:teuthology.orchestra.run.smithi121.stdout:[client.testuser] 2023-08-18T20:45:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA== 2023-08-18T20:45:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow rw fsname=cephfs" 2023-08-18T20:45:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r fsname=cephfs" 2023-08-18T20:45:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-18T20:45:02.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 msgr2=0x7f181c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 0x7f181c06c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1824009cd0 tx=0x7f1824009210 comp rx=0 tx=0).stop 2023-08-18T20:45:02.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 msgr2=0x7f183c1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f182c009c40 tx=0x7f182c004750 comp rx=0 tx=0).stop 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 shutdown_connections 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f183c14b0c0 0x7f183c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f183c06a7e0 0x7f183c0c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 --2- 172.21.15.121:0/1875456782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183c0c0230 0x7f183c1558b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.116+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 >> 172.21.15.121:0/1875456782 conn(0x7f183c0a8770 msgr2=0x7f183c070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.117+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 shutdown_connections 2023-08-18T20:45:02.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.117+0000 7f184201a700 1 -- 172.21.15.121:0/1875456782 wait complete. 2023-08-18T20:45:02.129 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2023-08-18T20:45:02.145 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.OPRbsNtg17 2023-08-18T20:45:02.145 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:02.146 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/tmp/tmp.OPRbsNtg17 2023-08-18T20:45:02.201 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:02.201 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:02.257 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:02.258 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:02.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:02.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.472+0000 7f8ede62a700 1 Processor -- start 2023-08-18T20:45:02.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.472+0000 7f8ede62a700 1 -- start start 2023-08-18T20:45:02.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ede62a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 0x7f8ed80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ede62a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ed8157c10 0x7f8ed81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ede62a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80c21f0 con 0x7f8ed80c1cf0 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ede62a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80c2ba0 con 0x7f8ed8157c10 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ede62a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c6300 con 0x7f8ed806a510 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ed8157c10 0x7f8ed81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed77fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8ed80c1cf0 0x7f8ed8151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49236/0 (socket says 172.21.15.121:49236) 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed77fe700 1 -- 172.21.15.121:0/2514372311 learned_addr learned my addr 172.21.15.121:0/2514372311 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:02.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed7fff700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 0x7f8ed80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 -- 172.21.15.121:0/2514372311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 msgr2=0x7f8ed80c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 0x7f8ed80c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 -- 172.21.15.121:0/2514372311 >> v1:172.21.15.121:6789/0 conn(0x7f8ed80c1cf0 legacy=0x7f8ed8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 -- 172.21.15.121:0/2514372311 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80c5b20 con 0x7f8ed8157c10 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed6ffd700 1 -- 172.21.15.121:0/2514372311 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328313794 0 0) 0x7f8ed80c21f0 con 0x7f8ed80c1cf0 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed7fff700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 0x7f8ed80c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8edcbc7700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed8157c10 0x7f8ed81580a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009d90 tx=0x7f8ed000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c170211f4b5fc6de server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed6ffd700 1 -- 172.21.15.121:0/2514372311 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000e070 con 0x7f8ed8157c10 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed6ffd700 1 -- 172.21.15.121:0/2514372311 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000bbd0 con 0x7f8ed8157c10 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.473+0000 7f8ed6ffd700 1 -- 172.21.15.121:0/2514372311 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0012430 con 0x7f8ed8157c10 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 -- 172.21.15.121:0/2514372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed8157c10 msgr2=0x7f8ed81580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed8157c10 0x7f8ed81580a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009d90 tx=0x7f8ed000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 -- 172.21.15.121:0/2514372311 shutdown_connections 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed8157c10 0x7f8ed81580a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 --2- 172.21.15.121:0/2514372311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed806a510 0x7f8ed80c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 -- 172.21.15.121:0/2514372311 >> 172.21.15.121:0/2514372311 conn(0x7f8ed80c6b10 msgr2=0x7f8ed80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:02.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 -- 172.21.15.121:0/2514372311 shutdown_connections 2023-08-18T20:45:02.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.474+0000 7f8ede62a700 1 -- 172.21.15.121:0/2514372311 wait complete. 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.475+0000 7f8ede62a700 1 Processor -- start 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.475+0000 7f8ede62a700 1 -- start start 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed80c1cf0 0x7f8ed81534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed8157c10 0x7f8ed81ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806cf10 con 0x7f8ed806a510 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81edc30 con 0x7f8ed80c1cf0 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ede62a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806d710 con 0x7f8ed8157c10 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42658/0 (socket says 172.21.15.121:42658) 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 -- 172.21.15.121:0/1846335030 learned_addr learned my addr 172.21.15.121:0/1846335030 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8edcbc7700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed8157c10 0x7f8ed81ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed77fe700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed80c1cf0 0x7f8ed81534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 -- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed8157c10 msgr2=0x7f8ed81ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed8157c10 0x7f8ed81ece40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 -- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed80c1cf0 msgr2=0x7f8ed81534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed80c1cf0 0x7f8ed81534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.476+0000 7f8ed7fff700 1 -- 172.21.15.121:0/1846335030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0009a70 con 0x7f8ed806a510 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ed7fff700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c820 tx=0x7f8ecc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011800 con 0x7f8ed806a510 2023-08-18T20:45:02.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc011960 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80a9c20 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011cf0 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.477+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed81ed950 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.478+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed806d9f0 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.478+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ecc0233a0 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.478+0000 7f8ed4ff9700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 0x7f8ec406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.479+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8ecc088a40 con 0x7f8ed806a510 2023-08-18T20:45:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.479+0000 7f8ed77fe700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 0x7f8ec406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.479+0000 7f8ed77fe700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 0x7f8ec406c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007fd0 tx=0x7f8ec8007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.483+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8ecc08ae60 con 0x7f8ed806a510 2023-08-18T20:45:02.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.671+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ed8074730 con 0x7f8ed806a510 2023-08-18T20:45:02.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.673+0000 7f8ed4ff9700 1 -- 172.21.15.121:0/1846335030 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7f8ecc057860 con 0x7f8ed806a510 2023-08-18T20:45:02.674 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:02.674 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:02.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 msgr2=0x7f8ec406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 0x7f8ec406c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007fd0 tx=0x7f8ec8007de0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 msgr2=0x7f8ed806dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c820 tx=0x7f8ecc00cb30 comp rx=0 tx=0).stop 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 shutdown_connections 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ed8157c10 0x7f8ed81ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ec406a0e0 0x7f8ec406c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ed806a510 0x7f8ed806dba0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 --2- 172.21.15.121:0/1846335030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed80c1cf0 0x7f8ed81534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 >> 172.21.15.121:0/1846335030 conn(0x7f8ed80c6b10 msgr2=0x7f8ed8156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:02.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 shutdown_connections 2023-08-18T20:45:02.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.675+0000 7f8ede62a700 1 -- 172.21.15.121:0/1846335030 wait complete. 2023-08-18T20:45:02.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:44:31.655910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:44:32.362264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:44:45.110030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:44:46.431796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:02.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:02.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.810+0000 7f28a5fcc700 1 Processor -- start 2023-08-18T20:45:02.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.810+0000 7f28a5fcc700 1 -- start start 2023-08-18T20:45:02.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f28a5fcc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f28a00c5a90 0x7f28a00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f28a5fcc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a01554d0 con 0x7f28a014e6c0 2023-08-18T20:45:02.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f28a5fcc700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a006f920 con 0x7f28a0155070 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f28a5fcc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a006e980 con 0x7f28a00c5a90 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f289ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f28a00c5a90 0x7f28a00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f289f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f28a014e6c0 0x7f28a00a6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49248/0 (socket says 172.21.15.121:49248) 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.811+0000 7f289f7fe700 1 -- 172.21.15.121:0/2975838266 learned_addr learned my addr 172.21.15.121:0/2975838266 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289ffff700 1 -- 172.21.15.121:0/2975838266 >> v1:172.21.15.122:6789/0 conn(0x7f28a0155070 legacy=0x7f28a00c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289ffff700 1 -- 172.21.15.121:0/2975838266 >> v1:172.21.15.121:6789/0 conn(0x7f28a014e6c0 legacy=0x7f28a00a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289ffff700 1 -- 172.21.15.121:0/2975838266 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a006eb60 con 0x7f28a00c5a90 2023-08-18T20:45:02.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289e7fc700 1 -- 172.21.15.121:0/2975838266 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035112755 0 0) 0x7f28a01554d0 con 0x7f28a014e6c0 2023-08-18T20:45:02.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289ffff700 1 --2- 172.21.15.121:0/2975838266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a00c5a90 0x7f28a00c5ea0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2898009d90 tx=0x7f289800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604261184ae103eb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289e7fc700 1 -- 172.21.15.121:0/2975838266 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800e070 con 0x7f28a00c5a90 2023-08-18T20:45:02.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289e7fc700 1 -- 172.21.15.121:0/2975838266 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289800bb90 con 0x7f28a00c5a90 2023-08-18T20:45:02.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f289e7fc700 1 -- 172.21.15.121:0/2975838266 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898003a20 con 0x7f28a00c5a90 2023-08-18T20:45:02.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 -- 172.21.15.121:0/2975838266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a00c5a90 msgr2=0x7f28a00c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/2975838266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a00c5a90 0x7f28a00c5ea0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2898009d90 tx=0x7f289800b330 comp rx=0 tx=0).stop 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 -- 172.21.15.121:0/2975838266 shutdown_connections 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/2975838266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a00c5a90 0x7f28a00c5ea0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 -- 172.21.15.121:0/2975838266 >> 172.21.15.121:0/2975838266 conn(0x7f28a00a96a0 msgr2=0x7f28a00a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 -- 172.21.15.121:0/2975838266 shutdown_connections 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.812+0000 7f28a5fcc700 1 -- 172.21.15.121:0/2975838266 wait complete. 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 Processor -- start 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 -- start start 2023-08-18T20:45:02.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a00c5a90 0x7f28a014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28a014e6c0 0x7f28a0154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00a8c70 con 0x7f28a0155070 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01ea160 con 0x7f28a00c5a90 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.814+0000 7f28a5fcc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0148a40 con 0x7f28a014e6c0 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42674/0 (socket says 172.21.15.121:42674) 2023-08-18T20:45:02.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 -- 172.21.15.121:0/1008416335 learned_addr learned my addr 172.21.15.121:0/1008416335 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289f7fe700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a00c5a90 0x7f28a014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289effd700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28a014e6c0 0x7f28a0154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 -- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28a014e6c0 msgr2=0x7f28a0154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28a014e6c0 0x7f28a0154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 -- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a00c5a90 msgr2=0x7f28a014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a00c5a90 0x7f28a014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 -- 172.21.15.121:0/1008416335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009a70 con 0x7f28a0155070 2023-08-18T20:45:02.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f289ffff700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f289800b730 tx=0x7f2898004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898012630 con 0x7f28a0155070 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980127b0 con 0x7f28a0155070 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0148e20 con 0x7f28a0155070 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898012b60 con 0x7f28a0155070 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.815+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0154680 con 0x7f28a0155070 2023-08-18T20:45:02.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.816+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a0074730 con 0x7f28a0155070 2023-08-18T20:45:02.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.816+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2898012cc0 con 0x7f28a0155070 2023-08-18T20:45:02.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.817+0000 7f2887fff700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 0x7f288c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:02.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.817+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f289808b260 con 0x7f28a0155070 2023-08-18T20:45:02.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.817+0000 7f289f7fe700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 0x7f288c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:02.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.817+0000 7f289f7fe700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 0x7f288c06c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2894000f60 tx=0x7f2894007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:02.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:02.821+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f289805a110 con 0x7f28a0155070 2023-08-18T20:45:03.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.009+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28a00c6760 con 0x7f28a0155070 2023-08-18T20:45:03.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.009+0000 7f2887fff700 1 -- 172.21.15.121:0/1008416335 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2898059ca0 con 0x7f28a0155070 2023-08-18T20:45:03.010 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:03.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 msgr2=0x7f288c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 0x7f288c06c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2894000f60 tx=0x7f2894007be0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 msgr2=0x7f28a01ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f289800b730 tx=0x7f2898004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 shutdown_connections 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f288c06a0e0 0x7f288c06c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a0155070 0x7f28a01ea5f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a00c5a90 0x7f28a014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 --2- 172.21.15.121:0/1008416335 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28a014e6c0 0x7f28a0154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 >> 172.21.15.121:0/1008416335 conn(0x7f28a00a96a0 msgr2=0x7f28a00c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 shutdown_connections 2023-08-18T20:45:03.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.011+0000 7f28a5fcc700 1 -- 172.21.15.121:0/1008416335 wait complete. 2023-08-18T20:45:03.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:03.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 Processor -- start 2023-08-18T20:45:03.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 -- start start 2023-08-18T20:45:03.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 0x7f4b0c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c155970 con 0x7f4b0c14fb90 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c1567d0 con 0x7f4b0c152250 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.149+0000 7f4b122a3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14ff70 con 0x7f4b0c155e00 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b0b7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 0x7f4b0c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39090/0 (socket says 172.21.15.121:39090) 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b0b7fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 0x7f4b0c0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52518/0 (socket says 172.21.15.121:52518) 2023-08-18T20:45:03.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 -- 172.21.15.121:0/4130565403 learned_addr learned my addr 172.21.15.121:0/4130565403 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 -- 172.21.15.121:0/4130565403 >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 msgr2=0x7f4b0c0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 --2- 172.21.15.121:0/4130565403 >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 0x7f4b0c0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 -- 172.21.15.121:0/4130565403 >> v1:172.21.15.122:6789/0 conn(0x7f4b0c14fb90 legacy=0x7f4b0c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 -- 172.21.15.121:0/4130565403 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c06e830 con 0x7f4b0c155e00 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.150+0000 7f4b10840700 1 --2- 172.21.15.121:0/4130565403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009e50 tx=0x7f4b0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb8da41632221e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b0affd700 1 -- 172.21.15.121:0/4130565403 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400e070 con 0x7f4b0c155e00 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b0affd700 1 -- 172.21.15.121:0/4130565403 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0400b910 con 0x7f4b0c155e00 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b0affd700 1 -- 172.21.15.121:0/4130565403 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400bcc0 con 0x7f4b0c155e00 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 -- 172.21.15.121:0/4130565403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 msgr2=0x7f4b0c156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 --2- 172.21.15.121:0/4130565403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009e50 tx=0x7f4b0400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 -- 172.21.15.121:0/4130565403 shutdown_connections 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 --2- 172.21.15.121:0/4130565403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c155e00 0x7f4b0c156290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 --2- 172.21.15.121:0/4130565403 >> v2:172.21.15.122:3300/0 conn(0x7f4b0c152250 0x7f4b0c0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 -- 172.21.15.121:0/4130565403 >> 172.21.15.121:0/4130565403 conn(0x7f4b0c0c6b10 msgr2=0x7f4b0c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 -- 172.21.15.121:0/4130565403 shutdown_connections 2023-08-18T20:45:03.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.151+0000 7f4b122a3700 1 -- 172.21.15.121:0/4130565403 wait complete. 2023-08-18T20:45:03.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.152+0000 7f4b122a3700 1 Processor -- start 2023-08-18T20:45:03.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.152+0000 7f4b122a3700 1 -- start start 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c14fb90 0x7f4b0c14cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b0c152250 0x7f4b0c0ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14c7c0 con 0x7f4b0c155e00 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14d500 con 0x7f4b0c152250 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b122a3700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14c200 con 0x7f4b0c14fb90 2023-08-18T20:45:03.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b10840700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b10840700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42688/0 (socket says 172.21.15.121:42688) 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b10840700 1 -- 172.21.15.121:0/197111331 learned_addr learned my addr 172.21.15.121:0/197111331 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b0bfff700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c14fb90 0x7f4b0c14cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.153+0000 7f4b0b7fe700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b0c152250 0x7f4b0c0ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 -- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c14fb90 msgr2=0x7f4b0c14cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c14fb90 0x7f4b0c14cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 -- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b0c152250 msgr2=0x7f4b0c0ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b0c152250 0x7f4b0c0ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 -- 172.21.15.121:0/197111331 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009b30 con 0x7f4b0c155e00 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b10840700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c067fa0 tx=0x7f4b04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04004840 con 0x7f4b0c155e00 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040099b0 con 0x7f4b0c155e00 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c14c4e0 con 0x7f4b0c155e00 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0401c650 con 0x7f4b0c155e00 2023-08-18T20:45:03.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.154+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0ac310 con 0x7f4b0c155e00 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.155+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c0abe90 con 0x7f4b0c155e00 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.155+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b0401c7b0 con 0x7f4b0c155e00 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.156+0000 7f4b08ff9700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 0x7f4af806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.156+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4b0408a460 con 0x7f4b0c155e00 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.156+0000 7f4b0bfff700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 0x7f4af806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.156+0000 7f4b0bfff700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 0x7f4af806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c0fc0 tx=0x7f4afc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.160+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4b0c0abe90 con 0x7f4b0c155e00 2023-08-18T20:45:03.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.348+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b0c0abe90 con 0x7f4b0c155e00 2023-08-18T20:45:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.348+0000 7f4b08ff9700 1 -- 172.21.15.121:0/197111331 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b0c0abe90 con 0x7f4b0c155e00 2023-08-18T20:45:03.349 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.350+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 msgr2=0x7f4af806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.350+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 0x7f4af806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c0fc0 tx=0x7f4afc009040 comp rx=0 tx=0).stop 2023-08-18T20:45:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.350+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 msgr2=0x7f4b0c1e7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.350+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c067fa0 tx=0x7f4b04004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 shutdown_connections 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4af806a0e0 0x7f4af806c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b0c155e00 0x7f4b0c1e7bb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b0c14fb90 0x7f4b0c14cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 --2- 172.21.15.121:0/197111331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b0c152250 0x7f4b0c0ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 >> 172.21.15.121:0/197111331 conn(0x7f4b0c0c6b10 msgr2=0x7f4b0c1500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 shutdown_connections 2023-08-18T20:45:03.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.351+0000 7f4b122a3700 1 -- 172.21.15.121:0/197111331 wait complete. 2023-08-18T20:45:03.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:45:03.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.487+0000 7f80fa5df700 1 Processor -- start 2023-08-18T20:45:03.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.487+0000 7f80fa5df700 1 -- start start 2023-08-18T20:45:03.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80fa5df700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f80f40c0c50 0x7f80f406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80fa5df700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80fa5df700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f40c4f40 con 0x7f80f40a6290 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80fa5df700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f40c6120 con 0x7f80f40c0c50 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80fa5df700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41551f0 con 0x7f80f406a7e0 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f80f40c0c50 0x7f80f406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f8b7c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f80f40a6290 0x7f80f4071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49278/0 (socket says 172.21.15.121:49278) 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f8b7c700 1 -- 172.21.15.121:0/4021395042 learned_addr learned my addr 172.21.15.121:0/4021395042 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f37fe700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 -- 172.21.15.121:0/4021395042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 msgr2=0x7f80f40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 -- 172.21.15.121:0/4021395042 >> v1:172.21.15.121:6789/0 conn(0x7f80f40a6290 legacy=0x7f80f4071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 -- 172.21.15.121:0/4021395042 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40c63a0 con 0x7f80f40c0c50 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f2ffd700 1 -- 172.21.15.121:0/4021395042 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439862705 0 0) 0x7f80f40c4f40 con 0x7f80f40a6290 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f37fe700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f3fff700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40c0c50 0x7f80f406a2a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009840 tx=0x7f80e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a50b29866b90cd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f2ffd700 1 -- 172.21.15.121:0/4021395042 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011830 con 0x7f80f40c0c50 2023-08-18T20:45:03.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f2ffd700 1 -- 172.21.15.121:0/4021395042 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4011990 con 0x7f80f40c0c50 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.488+0000 7f80f2ffd700 1 -- 172.21.15.121:0/4021395042 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011d20 con 0x7f80f40c0c50 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 -- 172.21.15.121:0/4021395042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40c0c50 msgr2=0x7f80f406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40c0c50 0x7f80f406a2a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009840 tx=0x7f80e4009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 -- 172.21.15.121:0/4021395042 shutdown_connections 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40c0c50 0x7f80f406a2a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 --2- 172.21.15.121:0/4021395042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 -- 172.21.15.121:0/4021395042 >> 172.21.15.121:0/4021395042 conn(0x7f80f40c6b10 msgr2=0x7f80f40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 -- 172.21.15.121:0/4021395042 shutdown_connections 2023-08-18T20:45:03.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.489+0000 7f80fa5df700 1 -- 172.21.15.121:0/4021395042 wait complete. 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.490+0000 7f80fa5df700 1 Processor -- start 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.490+0000 7f80fa5df700 1 -- start start 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40c0c50 0x7f80f4071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41e96a0 con 0x7f80f40a6290 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41e9940 con 0x7f80f40c0c50 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41e9c20 con 0x7f80f406a7e0 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42700/0 (socket says 172.21.15.121:42700) 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 -- 172.21.15.121:0/107029182 learned_addr learned my addr 172.21.15.121:0/107029182 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f3fff700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f8b7c700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40c0c50 0x7f80f4071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 -- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 msgr2=0x7f80f40ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 -- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40c0c50 msgr2=0x7f80f4071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40c0c50 0x7f80f4071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 -- 172.21.15.121:0/107029182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40094a0 con 0x7f80f40a6290 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f3fff700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f37fe700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e810 tx=0x7f80e800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800c020 con 0x7f80f40a6290 2023-08-18T20:45:03.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8004250 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.491+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f41e9f00 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.492+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80036a0 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.492+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f41ea420 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.492+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4074730 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.493+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80e8003800 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.493+0000 7f80f0ff9700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 0x7f80e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.493+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f80e80882f0 con 0x7f80f40a6290 2023-08-18T20:45:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.493+0000 7f80f3fff700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 0x7f80e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.494+0000 7f80f3fff700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 0x7f80e006c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009b90 tx=0x7f80e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.498+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f80e8053710 con 0x7f80f40a6290 2023-08-18T20:45:03.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.687+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80f4151d90 con 0x7f80f40a6290 2023-08-18T20:45:03.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.687+0000 7f80f0ff9700 1 -- 172.21.15.121:0/107029182 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80e8056d30 con 0x7f80f40a6290 2023-08-18T20:45:03.688 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:03.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 msgr2=0x7f80e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 0x7f80e006c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009b90 tx=0x7f80e4008030 comp rx=0 tx=0).stop 2023-08-18T20:45:03.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 msgr2=0x7f80f4157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e810 tx=0x7f80e800ebd0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 shutdown_connections 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40c0c50 0x7f80f4071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f406a7e0 0x7f80f40ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f80e006a0e0 0x7f80e006c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 --2- 172.21.15.121:0/107029182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80f40a6290 0x7f80f4157c80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 >> 172.21.15.121:0/107029182 conn(0x7f80f40c6b10 msgr2=0x7f80f406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.689+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 shutdown_connections 2023-08-18T20:45:03.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.690+0000 7f80fa5df700 1 -- 172.21.15.121:0/107029182 wait complete. 2023-08-18T20:45:03.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:45:03.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.824+0000 7f0dde01d700 1 Processor -- start 2023-08-18T20:45:03.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.824+0000 7f0dde01d700 1 -- start start 2023-08-18T20:45:03.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dde01d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd80c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dde01d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0dd80c1b10 0x7f0dd80c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dde01d700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd80c4f40 con 0x7f0dd80c0c50 2023-08-18T20:45:03.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dde01d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80c5e50 con 0x7f0dd80c1b10 2023-08-18T20:45:03.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dde01d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c6120 con 0x7f0dd80a6290 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0dd80c1b10 0x7f0dd80c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0dd80c1b10 0x7f0dd80c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42710/0 (socket says 172.21.15.121:42710) 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 -- 172.21.15.121:0/862442783 learned_addr learned my addr 172.21.15.121:0/862442783 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd6ffd700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd80c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 -- 172.21.15.121:0/862442783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 msgr2=0x7f0dd80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd80c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 -- 172.21.15.121:0/862442783 >> v1:172.21.15.122:6789/0 conn(0x7f0dd80c0c50 legacy=0x7f0dd806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 -- 172.21.15.121:0/862442783 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd81551f0 con 0x7f0dd80c1b10 2023-08-18T20:45:03.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd6ffd700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd80c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:03.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.825+0000 7f0dd7fff700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c1b10 0x7f0dd80c5910 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009e50 tx=0x7f0dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2892d99ae07204 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dd67fc700 1 -- 172.21.15.121:0/862442783 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000e070 con 0x7f0dd80c1b10 2023-08-18T20:45:03.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dd67fc700 1 -- 172.21.15.121:0/862442783 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000b9c0 con 0x7f0dd80c1b10 2023-08-18T20:45:03.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dd67fc700 1 -- 172.21.15.121:0/862442783 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000bd70 con 0x7f0dd80c1b10 2023-08-18T20:45:03.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 -- 172.21.15.121:0/862442783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c1b10 msgr2=0x7f0dd80c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c1b10 0x7f0dd80c5910 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009e50 tx=0x7f0dd000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 -- 172.21.15.121:0/862442783 shutdown_connections 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c1b10 0x7f0dd80c5910 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 --2- 172.21.15.121:0/862442783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd80c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 -- 172.21.15.121:0/862442783 >> 172.21.15.121:0/862442783 conn(0x7f0dd80c6b10 msgr2=0x7f0dd80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 -- 172.21.15.121:0/862442783 shutdown_connections 2023-08-18T20:45:03.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.826+0000 7f0dde01d700 1 -- 172.21.15.121:0/862442783 wait complete. 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.827+0000 7f0dde01d700 1 Processor -- start 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 -- start start 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd8072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 0x7f0dd8154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80a9ec0 con 0x7f0dd80c0c50 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80ab3c0 con 0x7f0dd80c1b10 2023-08-18T20:45:03.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dde01d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8152e80 con 0x7f0dd80a6290 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dd6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dd6ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42712/0 (socket says 172.21.15.121:42712) 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dd6ffd700 1 -- 172.21.15.121:0/740928282 learned_addr learned my addr 172.21.15.121:0/740928282 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dd7fff700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 0x7f0dd8154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.828+0000 7f0dd77fe700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd8072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 -- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 msgr2=0x7f0dd8072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd8072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 -- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 msgr2=0x7f0dd8154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 0x7f0dd8154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 -- 172.21.15.121:0/740928282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009b30 con 0x7f0dd80c0c50 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd7fff700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 0x7f0dd8154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dd6ffd700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800e810 tx=0x7f0dc800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800c020 con 0x7f0dd80c0c50 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8004250 con 0x7f0dd80c0c50 2023-08-18T20:45:03.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd80ab660 con 0x7f0dd80c0c50 2023-08-18T20:45:03.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80036a0 con 0x7f0dd80c0c50 2023-08-18T20:45:03.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.829+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd80727a0 con 0x7f0dd80c0c50 2023-08-18T20:45:03.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.830+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd8074730 con 0x7f0dd80c0c50 2023-08-18T20:45:03.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.830+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0dc8003800 con 0x7f0dd80c0c50 2023-08-18T20:45:03.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.831+0000 7f0dcffff700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 0x7f0db806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:03.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.831+0000 7f0dd77fe700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 0x7f0db806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:03.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.831+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f0dc80885d0 con 0x7f0dd80c0c50 2023-08-18T20:45:03.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.831+0000 7f0dd77fe700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 0x7f0db806c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0007fd0 tx=0x7f0dc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:03.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:03.835+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0dc8053960 con 0x7f0dd80c0c50 2023-08-18T20:45:04.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.024+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dd80c4a10 con 0x7f0dd80c0c50 2023-08-18T20:45:04.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.024+0000 7f0dcffff700 1 -- 172.21.15.121:0/740928282 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dc8056f80 con 0x7f0dd80c0c50 2023-08-18T20:45:04.025 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 msgr2=0x7f0db806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 0x7f0db806c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0007fd0 tx=0x7f0dc0009040 comp rx=0 tx=0).stop 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 msgr2=0x7f0dd81ecc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800e810 tx=0x7f0dc800eb20 comp rx=0 tx=0).stop 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 shutdown_connections 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd80c1b10 0x7f0dd8154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0dd80a6290 0x7f0dd8072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0db806a0e0 0x7f0db806c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 --2- 172.21.15.121:0/740928282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dd80c0c50 0x7f0dd81ecc70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 >> 172.21.15.121:0/740928282 conn(0x7f0dd80c6b10 msgr2=0x7f0dd80a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 shutdown_connections 2023-08-18T20:45:04.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.026+0000 7f0dde01d700 1 -- 172.21.15.121:0/740928282 wait complete. 2023-08-18T20:45:04.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:45:04.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.165+0000 7f38eaff2700 1 Processor -- start 2023-08-18T20:45:04.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.165+0000 7f38eaff2700 1 -- start start 2023-08-18T20:45:04.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38eaff2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f38e4151b10 0x7f38e40c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38eaff2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 0x7f38e4154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38eaff2700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e40ca4a0 con 0x7f38e40c7ca0 2023-08-18T20:45:04.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38eaff2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e406c0f0 con 0x7f38e4151b10 2023-08-18T20:45:04.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38eaff2700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e4158540 con 0x7f38e40c4c60 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f38e4151b10 0x7f38e40c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e3fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f38e40c7ca0 0x7f38e41543c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49300/0 (socket says 172.21.15.121:49300) 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e3fff700 1 -- 172.21.15.121:0/2411100824 learned_addr learned my addr 172.21.15.121:0/2411100824 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e958f700 1 --2- 172.21.15.121:0/2411100824 >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 0x7f38e4154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 -- 172.21.15.121:0/2411100824 >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 msgr2=0x7f38e4154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 --2- 172.21.15.121:0/2411100824 >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 0x7f38e4154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 -- 172.21.15.121:0/2411100824 >> v1:172.21.15.121:6789/0 conn(0x7f38e40c7ca0 legacy=0x7f38e41543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 -- 172.21.15.121:0/2411100824 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4158820 con 0x7f38e4151b10 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e958f700 1 --2- 172.21.15.121:0/2411100824 >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 0x7f38e4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e8d8e700 1 --2- 172.21.15.121:0/2411100824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e4151b10 0x7f38e40c4720 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c66b0 tx=0x7f38d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df91457bf68fffa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.166+0000 7f38e37fe700 1 -- 172.21.15.121:0/2411100824 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8011830 con 0x7f38e4151b10 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38e37fe700 1 -- 172.21.15.121:0/2411100824 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8011990 con 0x7f38e4151b10 2023-08-18T20:45:04.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38e37fe700 1 -- 172.21.15.121:0/2411100824 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8011d20 con 0x7f38e4151b10 2023-08-18T20:45:04.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 -- 172.21.15.121:0/2411100824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e4151b10 msgr2=0x7f38e40c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 --2- 172.21.15.121:0/2411100824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e4151b10 0x7f38e40c4720 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c66b0 tx=0x7f38d8009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 -- 172.21.15.121:0/2411100824 shutdown_connections 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 --2- 172.21.15.121:0/2411100824 >> v2:172.21.15.122:3300/0 conn(0x7f38e40c4c60 0x7f38e4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 --2- 172.21.15.121:0/2411100824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e4151b10 0x7f38e40c4720 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 -- 172.21.15.121:0/2411100824 >> 172.21.15.121:0/2411100824 conn(0x7f38e4071bb0 msgr2=0x7f38e4071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 -- 172.21.15.121:0/2411100824 shutdown_connections 2023-08-18T20:45:04.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.167+0000 7f38eaff2700 1 -- 172.21.15.121:0/2411100824 wait complete. 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.169+0000 7f38eaff2700 1 Processor -- start 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.169+0000 7f38eaff2700 1 -- start start 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38e40c4c60 0x7f38e414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 0x7f38e4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e41ea530 con 0x7f38e40c7ca0 2023-08-18T20:45:04.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40c3dc0 con 0x7f38e40c4c60 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40c3800 con 0x7f38e4151b10 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42724/0 (socket says 172.21.15.121:42724) 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 -- 172.21.15.121:0/3594872281 learned_addr learned my addr 172.21.15.121:0/3594872281 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e8d8e700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38e40c4c60 0x7f38e414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e958f700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 0x7f38e4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 -- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 msgr2=0x7f38e4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 0x7f38e4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 -- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38e40c4c60 msgr2=0x7f38e414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38e40c4c60 0x7f38e414b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 -- 172.21.15.121:0/3594872281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80094a0 con 0x7f38e40c7ca0 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e958f700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 0x7f38e4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e3fff700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c450 tx=0x7f38d000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0005d70 con 0x7f38e40c7ca0 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d00070d0 con 0x7f38e40c7ca0 2023-08-18T20:45:04.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e40c3ae0 con 0x7f38e40c7ca0 2023-08-18T20:45:04.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0007440 con 0x7f38e40c7ca0 2023-08-18T20:45:04.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.170+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e40c2e90 con 0x7f38e40c7ca0 2023-08-18T20:45:04.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.171+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e40ca910 con 0x7f38e40c7ca0 2023-08-18T20:45:04.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.172+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38d00075a0 con 0x7f38e40c7ca0 2023-08-18T20:45:04.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.172+0000 7f38e17fa700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 0x7f38c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.172+0000 7f38e8d8e700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 0x7f38c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.172+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f38d0087a80 con 0x7f38e40c7ca0 2023-08-18T20:45:04.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.173+0000 7f38e8d8e700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 0x7f38c806c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38d8000c00 tx=0x7f38d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.177+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f38e40ca910 con 0x7f38e40c7ca0 2023-08-18T20:45:04.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.366+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38e40ca910 con 0x7f38e40c7ca0 2023-08-18T20:45:04.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.367+0000 7f38e17fa700 1 -- 172.21.15.121:0/3594872281 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v37) v1 ==== 105+0+11 (secure 0 0 0) 0x7f38e40ca910 con 0x7f38e40c7ca0 2023-08-18T20:45:04.367 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:04.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.368+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 msgr2=0x7f38c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.368+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 0x7f38c806c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38d8000c00 tx=0x7f38d8008030 comp rx=0 tx=0).stop 2023-08-18T20:45:04.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.368+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 msgr2=0x7f38e41e9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.368+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c450 tx=0x7f38d000c760 comp rx=0 tx=0).stop 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 shutdown_connections 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38e4151b10 0x7f38e4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38e40c4c60 0x7f38e414b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f38c806a0e0 0x7f38c806c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 --2- 172.21.15.121:0/3594872281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38e40c7ca0 0x7f38e41e9ff0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 >> 172.21.15.121:0/3594872281 conn(0x7f38e4071bb0 msgr2=0x7f38e40c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 shutdown_connections 2023-08-18T20:45:04.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.369+0000 7f38eaff2700 1 -- 172.21.15.121:0/3594872281 wait complete. 2023-08-18T20:45:04.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:45:04.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.503+0000 7f8615c40700 1 Processor -- start 2023-08-18T20:45:04.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.503+0000 7f8615c40700 1 -- start start 2023-08-18T20:45:04.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f8615c40700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f861006fd30 0x7f86100c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f8615c40700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 0x7f86100c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f8615c40700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86101529a0 con 0x7f8610152450 2023-08-18T20:45:04.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f8615c40700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8610152c80 con 0x7f861006fd30 2023-08-18T20:45:04.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f8615c40700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610152f60 con 0x7f86101559c0 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860effd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8610152450 0x7f861014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49312/0 (socket says 172.21.15.121:49312) 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860effd700 1 -- 172.21.15.121:0/3227214415 learned_addr learned my addr 172.21.15.121:0/3227214415 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860ffff700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 0x7f86100c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860f7fe700 1 --2- 172.21.15.121:0/3227214415 >> v2:172.21.15.122:3300/0 conn(0x7f861006fd30 0x7f86100c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843902543 0 0) 0x7f86101529a0 con 0x7f8610152450 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.504+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f80035b0 con 0x7f8610152450 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860f7fe700 1 -- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 msgr2=0x7f86100c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:04.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860f7fe700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 0x7f86100c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860f7fe700 1 -- 172.21.15.121:0/3227214415 >> v1:172.21.15.121:6789/0 conn(0x7f8610152450 legacy=0x7f861014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922941174 0 0) 0x7f85f80035b0 con 0x7f8610152450 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860f7fe700 1 -- 172.21.15.121:0/3227214415 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610153240 con 0x7f861006fd30 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860ffff700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 0x7f86100c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860f7fe700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861006fd30 0x7f86100c6d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8604009840 tx=0x7f8604009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995486a91359d0ac server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600001670 con 0x7f861006fd30 2023-08-18T20:45:04.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604004030 con 0x7f861006fd30 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f860e7fc700 1 -- 172.21.15.121:0/3227214415 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040043a0 con 0x7f861006fd30 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f8615c40700 1 -- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861006fd30 msgr2=0x7f86100c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.505+0000 7f8615c40700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861006fd30 0x7f86100c6d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8604009840 tx=0x7f8604009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 -- 172.21.15.121:0/3227214415 shutdown_connections 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f86101559c0 0x7f86100c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 --2- 172.21.15.121:0/3227214415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861006fd30 0x7f86100c6d30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 -- 172.21.15.121:0/3227214415 >> 172.21.15.121:0/3227214415 conn(0x7f86100c7bf0 msgr2=0x7f86100c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 -- 172.21.15.121:0/3227214415 shutdown_connections 2023-08-18T20:45:04.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.506+0000 7f8615c40700 1 -- 172.21.15.121:0/3227214415 wait complete. 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.507+0000 7f8615c40700 1 Processor -- start 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.507+0000 7f8615c40700 1 -- start start 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.507+0000 7f8615c40700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8610152450 0x7f86100bd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 0x7f86101e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100bded0 con 0x7f861006fd30 2023-08-18T20:45:04.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610151740 con 0x7f86101559c0 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610151460 con 0x7f8610152450 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42736/0 (socket says 172.21.15.121:42736) 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 -- 172.21.15.121:0/753219870 learned_addr learned my addr 172.21.15.121:0/753219870 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860ffff700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 0x7f86101e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860effd700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8610152450 0x7f86100bd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 -- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8610152450 msgr2=0x7f86100bd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8610152450 0x7f86100bd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 -- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 msgr2=0x7f86101e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 0x7f86101e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 -- 172.21.15.121:0/753219870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608009a70 con 0x7f861006fd30 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860ffff700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 0x7f86101e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f860f7fe700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8604009b90 tx=0x7f8604004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604004590 con 0x7f861006fd30 2023-08-18T20:45:04.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860401f070 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86040094a0 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604011870 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.508+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86100bf870 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.509+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100bf6d0 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.510+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f86040119d0 con 0x7f861006fd30 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.510+0000 7f85f7fff700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 0x7f85fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.510+0000 7f860effd700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 0x7f85fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.510+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8604021070 con 0x7f861006fd30 2023-08-18T20:45:04.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.511+0000 7f860effd700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 0x7f85fc06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86100adaf0 tx=0x7f8600001e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.515+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f86100bf6d0 con 0x7f861006fd30 2023-08-18T20:45:04.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.701+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f86100bf6d0 con 0x7f861006fd30 2023-08-18T20:45:04.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.701+0000 7f85f7fff700 1 -- 172.21.15.121:0/753219870 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v37) v1 ==== 101+0+11 (secure 0 0 0) 0x7f86100bf6d0 con 0x7f861006fd30 2023-08-18T20:45:04.702 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:04.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 msgr2=0x7f85fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 0x7f85fc06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86100adaf0 tx=0x7f8600001e40 comp rx=0 tx=0).stop 2023-08-18T20:45:04.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 msgr2=0x7f861006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8604009b90 tx=0x7f8604004750 comp rx=0 tx=0).stop 2023-08-18T20:45:04.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 shutdown_connections 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86101559c0 0x7f86101e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f85fc06a0e0 0x7f85fc06c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f861006fd30 0x7f861006c8c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 --2- 172.21.15.121:0/753219870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8610152450 0x7f86100bd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 >> 172.21.15.121:0/753219870 conn(0x7f86100c7bf0 msgr2=0x7f86101502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 shutdown_connections 2023-08-18T20:45:04.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.703+0000 7f8615c40700 1 -- 172.21.15.121:0/753219870 wait complete. 2023-08-18T20:45:04.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:45:04.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.836+0000 7fdb0835c700 1 Processor -- start 2023-08-18T20:45:04.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.836+0000 7fdb0835c700 1 -- start start 2023-08-18T20:45:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb0835c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdb0014e790 0x7fdb0006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb0835c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0006b7f0 0x7fdb0015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb0835c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0014eb70 con 0x7fdb00072200 2023-08-18T20:45:04.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb0835c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb00070790 con 0x7fdb0014e790 2023-08-18T20:45:04.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb0835c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00154830 con 0x7fdb0006b7f0 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdb0014e790 0x7fdb0006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb058f7700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdb00072200 0x7fdb001525b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49326/0 (socket says 172.21.15.121:49326) 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb058f7700 1 -- 172.21.15.121:0/1173858332 learned_addr learned my addr 172.21.15.121:0/1173858332 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb068f9700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0006b7f0 0x7fdb0015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 -- 172.21.15.121:0/1173858332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0006b7f0 msgr2=0x7fdb0015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:04.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0006b7f0 0x7fdb0015ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 -- 172.21.15.121:0/1173858332 >> v1:172.21.15.121:6789/0 conn(0x7fdb00072200 legacy=0x7fdb001525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb050f6700 1 -- 172.21.15.121:0/1173858332 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079414700 0 0) 0x7fdb0014eb70 con 0x7fdb00072200 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 -- 172.21.15.121:0/1173858332 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00154b10 con 0x7fdb0014e790 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb060f8700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb0014e790 0x7fdb0006b2b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395309568fc8b49a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb050f6700 1 -- 172.21.15.121:0/1173858332 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011830 con 0x7fdb0014e790 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb050f6700 1 -- 172.21.15.121:0/1173858332 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc011990 con 0x7fdb0014e790 2023-08-18T20:45:04.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.837+0000 7fdb050f6700 1 -- 172.21.15.121:0/1173858332 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011d20 con 0x7fdb0014e790 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 -- 172.21.15.121:0/1173858332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb0014e790 msgr2=0x7fdb0006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb0014e790 0x7fdb0006b2b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 -- 172.21.15.121:0/1173858332 shutdown_connections 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0006b7f0 0x7fdb0015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 --2- 172.21.15.121:0/1173858332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb0014e790 0x7fdb0006b2b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 -- 172.21.15.121:0/1173858332 >> 172.21.15.121:0/1173858332 conn(0x7fdb000c2ca0 msgr2=0x7fdb000c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 -- 172.21.15.121:0/1173858332 shutdown_connections 2023-08-18T20:45:04.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.838+0000 7fdb0835c700 1 -- 172.21.15.121:0/1173858332 wait complete. 2023-08-18T20:45:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.839+0000 7fdb0835c700 1 Processor -- start 2023-08-18T20:45:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.839+0000 7fdb0835c700 1 -- start start 2023-08-18T20:45:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 0x7fdb001e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0014e790 0x7fdb001ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb001e9850 con 0x7fdb00072200 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb001ecc90 con 0x7fdb0006b7f0 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb0835c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00147580 con 0x7fdb0014e790 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42750/0 (socket says 172.21.15.121:42750) 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 -- 172.21.15.121:0/824972332 learned_addr learned my addr 172.21.15.121:0/824972332 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb068f9700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0014e790 0x7fdb001ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb060f8700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 0x7fdb001e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 -- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0014e790 msgr2=0x7fdb001ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0014e790 0x7fdb001ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 -- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 msgr2=0x7fdb001e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 0x7fdb001e9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 -- 172.21.15.121:0/824972332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0094a0 con 0x7fdb00072200 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb060f8700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 0x7fdb001e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:04.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.840+0000 7fdb058f7700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c6d0 tx=0x7fdaf000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00074e0 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf0007660 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb00152e40 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0005a70 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb001472a0 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.841+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb001ece00 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.843+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdaf0005bd0 con 0x7fdb00072200 2023-08-18T20:45:04.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.843+0000 7fdaf6ffd700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 0x7fdae406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:04.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.844+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fdaf0088190 con 0x7fdb00072200 2023-08-18T20:45:04.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.844+0000 7fdb060f8700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 0x7fdae406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:04.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.844+0000 7fdb060f8700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 0x7fdae406c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0090b0 tx=0x7fdafc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:04.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:04.847+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdaf0053690 con 0x7fdb00072200 2023-08-18T20:45:05.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.056+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb00074730 con 0x7fdb00072200 2023-08-18T20:45:05.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.057+0000 7fdaf6ffd700 1 -- 172.21.15.121:0/824972332 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdaf0056cb0 con 0x7fdb00072200 2023-08-18T20:45:05.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 msgr2=0x7fdae406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 0x7fdae406c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0090b0 tx=0x7fdafc01c040 comp rx=0 tx=0).stop 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 msgr2=0x7fdb000bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c6d0 tx=0x7fdaf000ca90 comp rx=0 tx=0).stop 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 shutdown_connections 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb0014e790 0x7fdb001ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0006b7f0 0x7fdb001e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdae406a0e0 0x7fdae406c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 --2- 172.21.15.121:0/824972332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb00072200 0x7fdb000bf800 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 >> 172.21.15.121:0/824972332 conn(0x7fdb000c2ca0 msgr2=0x7fdb0006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:05.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 shutdown_connections 2023-08-18T20:45:05.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.059+0000 7fdb0835c700 1 -- 172.21.15.121:0/824972332 wait complete. 2023-08-18T20:45:05.061 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:45:05.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-18T20:45:05.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:05.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:05.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2023-08-18T20:45:05.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:05.116 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-18T20:45:05.133 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:05.133 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:05.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13297 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-18T20:45:05.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:45:05.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.349+0000 7f5306cee700 1 Processor -- start 2023-08-18T20:45:05.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.349+0000 7f5306cee700 1 -- start start 2023-08-18T20:45:05.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f5306cee700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f5306cee700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5300152450 0x7f530014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f5306cee700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53001529a0 con 0x7f530006fd30 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f5306cee700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5300152c80 con 0x7f5300152450 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f5306cee700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5300152f60 con 0x7f53000c7440 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f530528b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5300152450 0x7f530014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f52fffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f530528b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5300152450 0x7f530014f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52592/0 (socket says 172.21.15.121:52592) 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f530528b700 1 -- 172.21.15.121:0/422860074 learned_addr learned my addr 172.21.15.121:0/422860074 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.350+0000 7f52fffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39164/0 (socket says 172.21.15.121:39164) 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f530528b700 1 -- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 msgr2=0x7f530014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f530528b700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f530528b700 1 -- 172.21.15.121:0/422860074 >> v1:172.21.15.122:6789/0 conn(0x7f530006fd30 legacy=0x7f53000c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f530528b700 1 -- 172.21.15.121:0/422860074 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300153240 con 0x7f5300152450 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f52fffff700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f530528b700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5300152450 0x7f530014f8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009e50 tx=0x7f52f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc13e27c4aa89fb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f52ff7fe700 1 -- 172.21.15.121:0/422860074 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800e070 con 0x7f5300152450 2023-08-18T20:45:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f52ff7fe700 1 -- 172.21.15.121:0/422860074 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800b910 con 0x7f5300152450 2023-08-18T20:45:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f52ff7fe700 1 -- 172.21.15.121:0/422860074 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800bcc0 con 0x7f5300152450 2023-08-18T20:45:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f5306cee700 1 -- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5300152450 msgr2=0x7f530014f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.351+0000 7f5306cee700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5300152450 0x7f530014f8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009e50 tx=0x7f52f800b330 comp rx=0 tx=0).stop 2023-08-18T20:45:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 -- 172.21.15.121:0/422860074 shutdown_connections 2023-08-18T20:45:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5300152450 0x7f530014f8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 --2- 172.21.15.121:0/422860074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f530014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 -- 172.21.15.121:0/422860074 >> 172.21.15.121:0/422860074 conn(0x7f53000c7bf0 msgr2=0x7f53000c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 -- 172.21.15.121:0/422860074 shutdown_connections 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.352+0000 7f5306cee700 1 -- 172.21.15.121:0/422860074 wait complete. 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 Processor -- start 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 -- start start 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 0x7f53000a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f53000aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000ac3a0 con 0x7f5300152450 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000aaf20 con 0x7f530006fd30 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.353+0000 7f5306cee700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53001e8370 con 0x7f53000c7440 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42762/0 (socket says 172.21.15.121:42762) 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 -- 172.21.15.121:0/1660110645 learned_addr learned my addr 172.21.15.121:0/1660110645 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f5304a8a700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 0x7f53000a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 -- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 msgr2=0x7f53000aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f52fffff700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f53000aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f53000aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 -- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 msgr2=0x7f53000a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 0x7f53000a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 -- 172.21.15.121:0/1660110645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0094a0 con 0x7f5300152450 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f5304a8a700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 0x7f53000a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:05.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f52fffff700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f53000aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f530528b700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52f800b680 tx=0x7f52f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80099b0 con 0x7f5300152450 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f80092e0 con 0x7f5300152450 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8009b30 con 0x7f5300152450 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f801c640 con 0x7f5300152450 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.354+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53001e88a0 con 0x7f5300152450 2023-08-18T20:45:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.355+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53001512d0 con 0x7f5300152450 2023-08-18T20:45:05.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.356+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f52f801c7a0 con 0x7f5300152450 2023-08-18T20:45:05.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.356+0000 7f52fd7fa700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 0x7f52e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:05.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.356+0000 7f5304a8a700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 0x7f52e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:05.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.357+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f52f808a570 con 0x7f5300152450 2023-08-18T20:45:05.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.357+0000 7f5304a8a700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 0x7f52e406c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000f60 tx=0x7f52f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:05.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.361+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f52f8055910 con 0x7f5300152450 2023-08-18T20:45:05.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.593+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f530014fde0 con 0x7f5300152450 2023-08-18T20:45:05.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.594+0000 7f52fd7fa700 1 -- 172.21.15.121:0/1660110645 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7f52f8058f30 con 0x7f5300152450 2023-08-18T20:45:05.594 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:45:05.595 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-08-18T20:45:05.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 msgr2=0x7f52e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 0x7f52e406c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000f60 tx=0x7f52f4009040 comp rx=0 tx=0).stop 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 msgr2=0x7f53000ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52f800b680 tx=0x7f52f8004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 shutdown_connections 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f52e406a0e0 0x7f52e406c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5300152450 0x7f53000ac7d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f530006fd30 0x7f53000a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 --2- 172.21.15.121:0/1660110645 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53000c7440 0x7f53000aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:05.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 >> 172.21.15.121:0/1660110645 conn(0x7f53000c7bf0 msgr2=0x7f530014f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:05.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 shutdown_connections 2023-08-18T20:45:05.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:05.596+0000 7f5306cee700 1 -- 172.21.15.121:0/1660110645 wait complete. 2023-08-18T20:45:05.608 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-08-18T20:45:05.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:45:05.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-08-18T20:45:05.609 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-08-18T20:45:05.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:05.610 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-08-18T20:45:05.610 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:45:05.610 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.OPRbsNtg17 2023-08-18T20:45:05.611 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2023-08-18T20:45:05.627 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.ncMNvTxZVN 2023-08-18T20:45:05.627 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /tmp/tmp.OPRbsNtg17 /tmp/tmp.ncMNvTxZVN 2023-08-18T20:45:05.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.ncMNvTxZVN 2023-08-18T20:45:05.818 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.ncMNvTxZVN is 185B 2023-08-18T20:45:05.865 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.ncMNvTxZVN 2023-08-18T20:45:05.881 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-08-18T20:45:05.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:45:05.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:05.883 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-08-18T20:45:05.937 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:45:05.937 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:45:05.937 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:45:05.937 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:05.938 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 41739sec preferred_lft 41739sec 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::163e:4bc7:1f2c:54ec/64 scope link noprefixroute 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.939 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::1003:76ff:feee:6c32/64 scope link 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-18T20:45:05.940 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::a40b:53ff:feca:cd68/64 scope link 2023-08-18T20:45:05.941 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:05.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:05.941 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:45:06.002 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-08-18T20:45:06.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:06.004 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-08-18T20:45:06.062 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-08-18T20:45:06.062 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:45:06.063 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:45:06.063 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:45:06.063 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:45:06.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:06.063 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:45:06.064 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:45:06.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:45:06.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:45:06.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:45:06.065 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:45:06.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:06.168 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-08-18T20:45:06.184 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-18T20:45:06.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:45:06.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:06.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-08-18T20:45:06.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:06.251 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:06.306 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:45:06.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:06.307 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:06.363 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:06.363 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/tmp/tmp.OPRbsNtg17 of=/dev/stdout 2023-08-18T20:45:06.419 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-08-18T20:45:06.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:06.420 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:06.504 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,secret=AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:06.504 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:06.504 INFO:teuthology.orchestra.run.smithi121.stdout:keyring.get_secret failed 2023-08-18T20:45:06.532 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,secret=AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:06.532 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:06.532 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: testuser@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:06.533 INFO:teuthology.orchestra.run.smithi121.stdout:keyring.get_secret failed 2023-08-18T20:45:06.591 INFO:teuthology.orchestra.run.smithi121.stderr:mount error 2 = No such file or directory 2023-08-18T20:45:06.592 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,secret=AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:06.592 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:06.592 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: testuser@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:45:06.593 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:45:06.594 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,key=testuser,mds_namespace=cephfs2,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:45:06.594 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-18T20:45:06.595 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-08-18T20:45:06.595 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-18T20:45:06.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:45:06.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:45:06.696 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-18T20:45:06.697 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:06.697 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:06.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13297 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-18T20:45:06.715 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:06.715 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:06.736 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:06.736 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:06.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:06.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.915+0000 7f8583566700 1 Processor -- start 2023-08-18T20:45:06.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.915+0000 7f8583566700 1 -- start start 2023-08-18T20:45:06.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8583566700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f857c0c78b0 0x7f857c0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8583566700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0c6470 con 0x7f857c06f1e0 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8583566700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c157aa0 con 0x7f857c158540 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8583566700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0c5240 con 0x7f857c0c78b0 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8581302700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f857c06f1e0 0x7f857c0c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49350/0 (socket says 172.21.15.121:49350) 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8581302700 1 -- 172.21.15.121:0/2238236733 learned_addr learned my addr 172.21.15.121:0/2238236733 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8580b01700 1 --2- 172.21.15.121:0/2238236733 >> v2:172.21.15.122:3300/0 conn(0x7f857c0c78b0 0x7f857c0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871207621 0 0) 0x7f857c0c6470 con 0x7f857c06f1e0 2023-08-18T20:45:06.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85680035b0 con 0x7f857c06f1e0 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103763972 0 0) 0x7f85680035b0 con 0x7f857c06f1e0 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 >> v2:172.21.15.122:3300/0 conn(0x7f857c0c78b0 msgr2=0x7f857c0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 --2- 172.21.15.121:0/2238236733 >> v2:172.21.15.122:3300/0 conn(0x7f857c0c78b0 0x7f857c0c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 >> v1:172.21.15.122:6789/0 conn(0x7f857c158540 legacy=0x7f857c06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c155090 con 0x7f857c06f1e0 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f8578001670 con 0x7f857c06f1e0 2023-08-18T20:45:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 >> v1:172.21.15.121:6789/0 conn(0x7f857c06f1e0 legacy=0x7f857c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8568003a70 0x7f8568003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f8568004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8568005280 0x7f856800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c5240 con 0x7f8568004850 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856800c1e0 con 0x7f8568003a70 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.916+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856800c3a0 con 0x7f8568005280 2023-08-18T20:45:06.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f8568004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8581302700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8568003a70 0x7f8568003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8581b03700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8568005280 0x7f856800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 -- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8568005280 msgr2=0x7f856800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8568005280 0x7f856800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 -- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8568003a70 msgr2=0x7f8568003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8568003a70 0x7f8568003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 -- 172.21.15.121:0/2238236733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680035b0 con 0x7f8568004850 2023-08-18T20:45:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8581b03700 1 -- 172.21.15.121:0/2238236733 reap_dead start 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8580b01700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f8568004cd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f856c009b30 tx=0x7f8568005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1971eb62a7c84f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00e6c0 con 0x7f8568004850 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c00e820 con 0x7f8568004850 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.917+0000 7f8573fff700 1 -- 172.21.15.121:0/2238236733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00eb90 con 0x7f8568004850 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 -- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 msgr2=0x7f8568004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f8568004cd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f856c009b30 tx=0x7f8568005880 comp rx=0 tx=0).stop 2023-08-18T20:45:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 -- 172.21.15.121:0/2238236733 shutdown_connections 2023-08-18T20:45:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 --2- 172.21.15.121:0/2238236733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f8568004cd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 -- 172.21.15.121:0/2238236733 >> 172.21.15.121:0/2238236733 conn(0x7f857c0a9a90 msgr2=0x7f857c0a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 -- 172.21.15.121:0/2238236733 shutdown_connections 2023-08-18T20:45:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.918+0000 7f8583566700 1 -- 172.21.15.121:0/2238236733 wait complete. 2023-08-18T20:45:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 Processor -- start 2023-08-18T20:45:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 -- start start 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 0x7f857c1ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f857c1ed6f0 0x7f857c0bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1ea4a0 con 0x7f8568004850 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1ec9f0 con 0x7f857c0a8df0 2023-08-18T20:45:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.919+0000 7f8583566700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0be5f0 con 0x7f857c1ed6f0 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42780/0 (socket says 172.21.15.121:42780) 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 -- 172.21.15.121:0/2643918170 learned_addr learned my addr 172.21.15.121:0/2643918170 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581b03700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f857c1ed6f0 0x7f857c0bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8580b01700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 0x7f857c1ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 -- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f857c1ed6f0 msgr2=0x7f857c0bd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f857c1ed6f0 0x7f857c0bd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 -- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 msgr2=0x7f857c1ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 0x7f857c1ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 -- 172.21.15.121:0/2643918170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0be8d0 con 0x7f8568004850 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8580b01700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 0x7f857c1ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8581302700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8578007290 tx=0x7f8578007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800f6c0 con 0x7f8568004850 2023-08-18T20:45:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800f820 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0bebb0 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800fbd0 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.920+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0a9270 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.921+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c0a9400 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.922+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f857800fd30 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.922+0000 7f8571ffb700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 0x7f856006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.922+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f85780887f0 con 0x7f8568004850 2023-08-18T20:45:06.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.922+0000 7f8580b01700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 0x7f856006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:06.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.922+0000 7f8580b01700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 0x7f856006c5d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f856c0090b0 tx=0x7f856c01e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:06.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:06.926+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8578053c10 con 0x7f8568004850 2023-08-18T20:45:07.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.117+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f857c1eced0 con 0x7f8568004850 2023-08-18T20:45:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.119+0000 7f8571ffb700 1 -- 172.21.15.121:0/2643918170 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7f857c1eced0 con 0x7f8568004850 2023-08-18T20:45:07.119 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:07.120 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:07.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 msgr2=0x7f856006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 0x7f856006c5d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f856c0090b0 tx=0x7f856c01e040 comp rx=0 tx=0).stop 2023-08-18T20:45:07.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 msgr2=0x7f857c1e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8578007290 tx=0x7f8578007650 comp rx=0 tx=0).stop 2023-08-18T20:45:07.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 shutdown_connections 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f857c1ed6f0 0x7f857c0bd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f856006a110 0x7f856006c5d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8568004850 0x7f857c1e9480 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 --2- 172.21.15.121:0/2643918170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f857c0a8df0 0x7f857c1ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 >> 172.21.15.121:0/2643918170 conn(0x7f857c0a9a90 msgr2=0x7f857c0c4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 shutdown_connections 2023-08-18T20:45:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.121+0000 7f8583566700 1 -- 172.21.15.121:0/2643918170 wait complete. 2023-08-18T20:45:07.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:44:31.655910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:44:32.362264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:44:45.110030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:44:46.431796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:07.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:07.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.258+0000 7fb716d02700 1 Processor -- start 2023-08-18T20:45:07.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.258+0000 7fb716d02700 1 -- start start 2023-08-18T20:45:07.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb716d02700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb71014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb716d02700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7101529a0 con 0x7fb7100c7440 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb716d02700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710152c80 con 0x7fb71006fd30 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb716d02700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710152f60 con 0x7fb710152450 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70ffff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb7100c7440 0x7fb71014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49372/0 (socket says 172.21.15.121:49372) 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70ffff700 1 -- 172.21.15.121:0/592293051 learned_addr learned my addr 172.21.15.121:0/592293051 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb71529f700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb71014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642220699 0 0) 0x7fb7101529a0 con 0x7fb7100c7440 2023-08-18T20:45:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7000035b0 con 0x7fb7100c7440 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101255650 0 0) 0x7fb7000035b0 con 0x7fb7100c7440 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 msgr2=0x7fb71014fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb71014fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 >> v1:172.21.15.122:6789/0 conn(0x7fb71006fd30 legacy=0x7fb7100c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710153240 con 0x7fb7100c7440 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.259+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fb6fc001670 con 0x7fb7100c7440 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 >> v1:172.21.15.121:6789/0 conn(0x7fb7100c7440 legacy=0x7fb71014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb700003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb700003f70 0x7fb700004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700004d90 0x7fb700005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710152f60 con 0x7fb700003f70 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70000ba70 con 0x7fb700004d90 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70000bc30 con 0x7fb710152450 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb700003f70 0x7fb700004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb714a9e700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb700003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb71529f700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700004d90 0x7fb700005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 -- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 msgr2=0x7fb700003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb710152450 0x7fb700003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 -- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700004d90 msgr2=0x7fb700005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700004d90 0x7fb700005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 -- 172.21.15.121:0/592293051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000035b0 con 0x7fb700003f70 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70ffff700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb700003f70 0x7fb700004850 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c2f0 tx=0x7fb700005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9691df142b7b5a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00cd70 con 0x7fb700003f70 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc005960 con 0x7fb700003f70 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.260+0000 7fb70f7fe700 1 -- 172.21.15.121:0/592293051 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc005d10 con 0x7fb700003f70 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 -- 172.21.15.121:0/592293051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb700003f70 msgr2=0x7fb700004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 --2- 172.21.15.121:0/592293051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb700003f70 0x7fb700004850 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c2f0 tx=0x7fb700005880 comp rx=0 tx=0).stop 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb71529f700 1 -- 172.21.15.121:0/592293051 reap_dead start 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 -- 172.21.15.121:0/592293051 shutdown_connections 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 -- 172.21.15.121:0/592293051 >> 172.21.15.121:0/592293051 conn(0x7fb7100c7bf0 msgr2=0x7fb7100c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 -- 172.21.15.121:0/592293051 shutdown_connections 2023-08-18T20:45:07.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.261+0000 7fb716d02700 1 -- 172.21.15.121:0/592293051 wait complete. 2023-08-18T20:45:07.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.262+0000 7fb716d02700 1 Processor -- start 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.262+0000 7fb716d02700 1 -- start start 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700003f70 0x7fb7101e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7100ad110 0x7fb7101e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100a8200 con 0x7fb7100a76c0 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100adb70 con 0x7fb700003f70 2023-08-18T20:45:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710155480 con 0x7fb7100ad110 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42802/0 (socket says 172.21.15.121:42802) 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 -- 172.21.15.121:0/3939099942 learned_addr learned my addr 172.21.15.121:0/3939099942 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb714a9e700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700003f70 0x7fb7101e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb71529f700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7100ad110 0x7fb7101e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 -- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7100ad110 msgr2=0x7fb7101e7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7100ad110 0x7fb7101e7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 -- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700003f70 msgr2=0x7fb7101e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700003f70 0x7fb7101e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 -- 172.21.15.121:0/3939099942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710155720 con 0x7fb7100a76c0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70ffff700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000c00 tx=0x7fb6fc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc005ce0 con 0x7fb7100a76c0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc005e80 con 0x7fb7100a76c0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc004ab0 con 0x7fb7100a76c0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7101e75b0 con 0x7fb7100a76c0 2023-08-18T20:45:07.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.263+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7101e7260 con 0x7fb7100a76c0 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.264+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb710074730 con 0x7fb7100a76c0 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.265+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb6fc004c10 con 0x7fb7100a76c0 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.265+0000 7fb70d7fa700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 0x7fb6f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.266+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb6fc08a120 con 0x7fb7100a76c0 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.266+0000 7fb714a9e700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 0x7fb6f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.266+0000 7fb714a9e700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 0x7fb6f406c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb7100aa350 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.269+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb6fc055800 con 0x7fb7100a76c0 2023-08-18T20:45:07.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.457+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7100c5580 con 0x7fb7100a76c0 2023-08-18T20:45:07.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.457+0000 7fb70d7fa700 1 -- 172.21.15.121:0/3939099942 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6fc007da0 con 0x7fb7100a76c0 2023-08-18T20:45:07.458 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:07.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 msgr2=0x7fb6f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 0x7fb6f406c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb7100aa350 tx=0x7fb704009040 comp rx=0 tx=0).stop 2023-08-18T20:45:07.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 msgr2=0x7fb7100aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000c00 tx=0x7fb6fc001a00 comp rx=0 tx=0).stop 2023-08-18T20:45:07.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 shutdown_connections 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7100ad110 0x7fb7101e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb700003f70 0x7fb7101e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb6f406a0e0 0x7fb6f406c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 --2- 172.21.15.121:0/3939099942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7100a76c0 0x7fb7100aaa80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 >> 172.21.15.121:0/3939099942 conn(0x7fb7100c7bf0 msgr2=0x7fb710150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.459+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 shutdown_connections 2023-08-18T20:45:07.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.460+0000 7fb716d02700 1 -- 172.21.15.121:0/3939099942 wait complete. 2023-08-18T20:45:07.472 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.597+0000 7f3abe952700 1 Processor -- start 2023-08-18T20:45:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.597+0000 7f3abe952700 1 -- start start 2023-08-18T20:45:07.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3abe952700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ab80c7380 0x7f3ab81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3abe952700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8158ae0 con 0x7f3ab80a6ed0 2023-08-18T20:45:07.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3abe952700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8155370 con 0x7f3ab80c3740 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3abe952700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80c7760 con 0x7f3ab80c7380 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3ab77fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3ab80a6ed0 0x7f3ab806f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49390/0 (socket says 172.21.15.121:49390) 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3ab77fe700 1 -- 172.21.15.121:0/2391593815 learned_addr learned my addr 172.21.15.121:0/2391593815 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3ab7fff700 1 --2- 172.21.15.121:0/2391593815 >> v2:172.21.15.122:3300/0 conn(0x7f3ab80c7380 0x7f3ab81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221591916 0 0) 0x7f3aa8001110 con 0x7f3ab80a6ed0 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.598+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa00035b0 con 0x7f3ab80a6ed0 2023-08-18T20:45:07.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab7fff700 1 -- 172.21.15.121:0/2391593815 >> v1:172.21.15.122:6789/0 conn(0x7f3ab80c3740 legacy=0x7f3ab80c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab7fff700 1 -- 172.21.15.121:0/2391593815 >> v1:172.21.15.121:6789/0 conn(0x7f3ab80a6ed0 legacy=0x7f3ab806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1902313738 0 0) 0x7f3aa00035b0 con 0x7f3ab80a6ed0 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab7fff700 1 -- 172.21.15.121:0/2391593815 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8154760 con 0x7f3ab80c7380 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab7fff700 1 --2- 172.21.15.121:0/2391593815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c7380 0x7f3ab81585a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009840 tx=0x7f3aac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1688a80271a3bc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8001800 con 0x7f3ab80c7380 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac004030 con 0x7f3ab80c7380 2023-08-18T20:45:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.599+0000 7f3ab6ffd700 1 -- 172.21.15.121:0/2391593815 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0043c0 con 0x7f3ab80c7380 2023-08-18T20:45:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 -- 172.21.15.121:0/2391593815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c7380 msgr2=0x7f3ab81585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 --2- 172.21.15.121:0/2391593815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c7380 0x7f3ab81585a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009840 tx=0x7f3aac009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 -- 172.21.15.121:0/2391593815 shutdown_connections 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 --2- 172.21.15.121:0/2391593815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c7380 0x7f3ab81585a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 -- 172.21.15.121:0/2391593815 >> 172.21.15.121:0/2391593815 conn(0x7f3ab80c7bf0 msgr2=0x7f3ab80c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 -- 172.21.15.121:0/2391593815 shutdown_connections 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.600+0000 7f3abe952700 1 -- 172.21.15.121:0/2391593815 wait complete. 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.601+0000 7f3abe952700 1 Processor -- start 2023-08-18T20:45:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.601+0000 7f3abe952700 1 -- start start 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.601+0000 7f3abe952700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab80a6ed0 0x7f3ab8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.601+0000 7f3abe952700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c3740 0x7f3ab81ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81e7790 con 0x7f3ab80c7380 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c1c00 con 0x7f3ab80c3740 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8150880 con 0x7f3ab80a6ed0 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42818/0 (socket says 172.21.15.121:42818) 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 -- 172.21.15.121:0/3932182460 learned_addr learned my addr 172.21.15.121:0/3932182460 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3ab77fe700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c3740 0x7f3ab81ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3ab7fff700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab80a6ed0 0x7f3ab8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 -- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab80a6ed0 msgr2=0x7f3ab8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab80a6ed0 0x7f3ab8156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 -- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c3740 msgr2=0x7f3ab81ec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c3740 0x7f3ab81ec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 -- 172.21.15.121:0/3932182460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0094a0 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abceef700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000cc50 tx=0x7f3ab000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000ad80 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab000ce50 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0003c40 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab8150b40 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.602+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8151100 con 0x7f3ab80c7380 2023-08-18T20:45:07.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.603+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8074730 con 0x7f3ab80c7380 2023-08-18T20:45:07.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.604+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ab00050d0 con 0x7f3ab80c7380 2023-08-18T20:45:07.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.604+0000 7f3ab4ff9700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 0x7f3aa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.604+0000 7f3ab7fff700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 0x7f3aa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.604+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3ab0088960 con 0x7f3ab80c7380 2023-08-18T20:45:07.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.605+0000 7f3ab7fff700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 0x7f3aa406c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0090b0 tx=0x7f3aac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.609+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3ab0053d80 con 0x7f3ab80c7380 2023-08-18T20:45:07.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.797+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ab8154fd0 con 0x7f3ab80c7380 2023-08-18T20:45:07.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.797+0000 7f3ab4ff9700 1 -- 172.21.15.121:0/3932182460 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ab00573a0 con 0x7f3ab80c7380 2023-08-18T20:45:07.798 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 msgr2=0x7f3aa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 0x7f3aa406c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0090b0 tx=0x7f3aac008030 comp rx=0 tx=0).stop 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 msgr2=0x7f3ab81ec9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000cc50 tx=0x7f3ab000a340 comp rx=0 tx=0).stop 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 shutdown_connections 2023-08-18T20:45:07.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3aa406a0e0 0x7f3aa406c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab80c7380 0x7f3ab81ec9e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab80a6ed0 0x7f3ab8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 --2- 172.21.15.121:0/3932182460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab80c3740 0x7f3ab81ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 >> 172.21.15.121:0/3932182460 conn(0x7f3ab80c7bf0 msgr2=0x7f3ab80c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 shutdown_connections 2023-08-18T20:45:07.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.799+0000 7f3abe952700 1 -- 172.21.15.121:0/3932182460 wait complete. 2023-08-18T20:45:07.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:45:07.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.934+0000 7fc844f7e700 1 Processor -- start 2023-08-18T20:45:07.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.934+0000 7fc844f7e700 1 -- start start 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc844f7e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8401518e0 0x7fc840066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc844f7e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc8400bf550 0x7fc8400bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc844f7e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84006cc30 con 0x7fc8400c1030 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc844f7e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400c0b80 con 0x7fc8400bf550 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc844f7e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc840155260 con 0x7fc8401518e0 2023-08-18T20:45:07.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83dd9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc8400c1030 0x7fc84006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49404/0 (socket says 172.21.15.121:49404) 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83dd9b700 1 -- 172.21.15.121:0/3603279368 learned_addr learned my addr 172.21.15.121:0/3603279368 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/3603279368 >> v2:172.21.15.121:3300/0 conn(0x7fc8400bf550 0x7fc8400bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83e59c700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8401518e0 0x7fc840066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83d59a700 1 -- 172.21.15.121:0/3603279368 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963447822 0 0) 0x7fc84006cc30 con 0x7fc8400c1030 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83d59a700 1 -- 172.21.15.121:0/3603279368 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8280035b0 con 0x7fc8400c1030 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 -- 172.21.15.121:0/3603279368 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8401518e0 msgr2=0x7fc840066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8401518e0 0x7fc840066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 -- 172.21.15.121:0/3603279368 >> v1:172.21.15.121:6789/0 conn(0x7fc8400c1030 legacy=0x7fc84006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 -- 172.21.15.121:0/3603279368 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84006ce80 con 0x7fc8400bf550 2023-08-18T20:45:07.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8400bf550 0x7fc8400bf9c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc83800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc41e4a0a3498c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83d59a700 1 -- 172.21.15.121:0/3603279368 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800e070 con 0x7fc8400bf550 2023-08-18T20:45:07.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83d59a700 1 -- 172.21.15.121:0/3603279368 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800bb20 con 0x7fc8400bf550 2023-08-18T20:45:07.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.935+0000 7fc83d59a700 1 -- 172.21.15.121:0/3603279368 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838012430 con 0x7fc8400bf550 2023-08-18T20:45:07.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 -- 172.21.15.121:0/3603279368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8400bf550 msgr2=0x7fc8400bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8400bf550 0x7fc8400bf9c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc83800b330 comp rx=0 tx=0).stop 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 -- 172.21.15.121:0/3603279368 shutdown_connections 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8400bf550 0x7fc8400bf9c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 --2- 172.21.15.121:0/3603279368 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8401518e0 0x7fc840066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 -- 172.21.15.121:0/3603279368 >> 172.21.15.121:0/3603279368 conn(0x7fc8400c2ca0 msgr2=0x7fc8400c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 -- 172.21.15.121:0/3603279368 shutdown_connections 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.936+0000 7fc844f7e700 1 -- 172.21.15.121:0/3603279368 wait complete. 2023-08-18T20:45:07.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.937+0000 7fc844f7e700 1 Processor -- start 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.937+0000 7fc844f7e700 1 -- start start 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8400bf550 0x7fc840158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8400c1030 0x7fc84014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401548a0 con 0x7fc8401518e0 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840154600 con 0x7fc8400bf550 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc844f7e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400a91b0 con 0x7fc8400c1030 2023-08-18T20:45:07.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42832/0 (socket says 172.21.15.121:42832) 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 -- 172.21.15.121:0/1180127605 learned_addr learned my addr 172.21.15.121:0/1180127605 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83dd9b700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8400c1030 0x7fc84014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 -- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8400c1030 msgr2=0x7fc84014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8400c1030 0x7fc84014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 -- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8400bf550 msgr2=0x7fc840158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83e59c700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8400bf550 0x7fc840158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8400bf550 0x7fc840158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.938+0000 7fc83ed9d700 1 -- 172.21.15.121:0/1180127605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009a70 con 0x7fc8401518e0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc83ed9d700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc83800b370 tx=0x7fc838004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838012430 con 0x7fc8401518e0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838020070 con 0x7fc8401518e0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838012ea0 con 0x7fc8401518e0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400a9600 con 0x7fc8401518e0 2023-08-18T20:45:07.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.939+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84014c3e0 con 0x7fc8401518e0 2023-08-18T20:45:07.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.940+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84006e460 con 0x7fc8401518e0 2023-08-18T20:45:07.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.940+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc838004280 con 0x7fc8401518e0 2023-08-18T20:45:07.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.941+0000 7fc82effd700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:07.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.941+0000 7fc83e59c700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:07.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.941+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc838022070 con 0x7fc8401518e0 2023-08-18T20:45:07.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.941+0000 7fc83e59c700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 0x7fc82006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc830009a10 tx=0x7fc830008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:07.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:07.945+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc838059380 con 0x7fc8401518e0 2023-08-18T20:45:08.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.135+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8400a9460 con 0x7fc8401518e0 2023-08-18T20:45:08.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.136+0000 7fc82effd700 1 -- 172.21.15.121:0/1180127605 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8400a9460 con 0x7fc8401518e0 2023-08-18T20:45:08.137 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:08.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 msgr2=0x7fc82006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 0x7fc82006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc830009a10 tx=0x7fc830008040 comp rx=0 tx=0).stop 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 msgr2=0x7fc8401eca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc83800b370 tx=0x7fc838004b20 comp rx=0 tx=0).stop 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 shutdown_connections 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8401518e0 0x7fc8401eca40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8400bf550 0x7fc840158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 --2- 172.21.15.121:0/1180127605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc8400c1030 0x7fc84014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 >> 172.21.15.121:0/1180127605 conn(0x7fc8400c2ca0 msgr2=0x7fc8400c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 shutdown_connections 2023-08-18T20:45:08.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.138+0000 7fc844f7e700 1 -- 172.21.15.121:0/1180127605 wait complete. 2023-08-18T20:45:08.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:45:08.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.272+0000 7f60afbf8700 1 Processor -- start 2023-08-18T20:45:08.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.272+0000 7f60afbf8700 1 -- start start 2023-08-18T20:45:08.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60afbf8700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60a8156510 0x7f60a80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60afbf8700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a8155970 con 0x7f60a8152250 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60afbf8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a806e830 con 0x7f60a814fb90 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60afbf8700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a814ff70 con 0x7f60a8156510 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60ad193700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f60a8152250 0x7f60a8155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49420/0 (socket says 172.21.15.121:49420) 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60ad193700 1 -- 172.21.15.121:0/88494108 learned_addr learned my addr 172.21.15.121:0/88494108 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60ae195700 1 --2- 172.21.15.121:0/88494108 >> v2:172.21.15.122:3300/0 conn(0x7f60a8156510 0x7f60a80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619327699 0 0) 0x7f60a8155970 con 0x7f60a8152250 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.273+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60940035b0 con 0x7f60a8152250 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654486581 0 0) 0x7f60940035b0 con 0x7f60a8152250 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 >> v2:172.21.15.122:3300/0 conn(0x7f60a8156510 msgr2=0x7f60a80c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 --2- 172.21.15.121:0/88494108 >> v2:172.21.15.122:3300/0 conn(0x7f60a8156510 0x7f60a80c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 >> v1:172.21.15.122:6789/0 conn(0x7f60a814fb90 legacy=0x7f60a806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a806df90 con 0x7f60a8152250 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f60a4001670 con 0x7f60a8152250 2023-08-18T20:45:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 >> v1:172.21.15.121:6789/0 conn(0x7f60a8152250 legacy=0x7f60a8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 0x7f6094003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094004850 0x7f6094004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6094005210 0x7f609400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609400c080 con 0x7f6094003a00 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609400c1f0 con 0x7f6094004850 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609400c3b0 con 0x7f6094005210 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 0x7f6094003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad193700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094004850 0x7f6094004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ae195700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6094005210 0x7f609400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 -- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6094005210 msgr2=0x7f609400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6094005210 0x7f609400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 -- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094004850 msgr2=0x7f6094004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094004850 0x7f6094004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 -- 172.21.15.121:0/88494108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940035b0 con 0x7f6094003a00 2023-08-18T20:45:08.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ae195700 1 -- 172.21.15.121:0/88494108 reap_dead start 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ad994700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 0x7f6094003e20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f60980017c0 tx=0x7f6094005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b45ffebf48512 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980052d0 con 0x7f6094003a00 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098005430 con 0x7f6094003a00 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.274+0000 7f60ac992700 1 -- 172.21.15.121:0/88494108 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980038c0 con 0x7f6094003a00 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 -- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 msgr2=0x7f6094003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 0x7f6094003e20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f60980017c0 tx=0x7f6094005880 comp rx=0 tx=0).stop 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 -- 172.21.15.121:0/88494108 shutdown_connections 2023-08-18T20:45:08.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 --2- 172.21.15.121:0/88494108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6094003a00 0x7f6094003e20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 -- 172.21.15.121:0/88494108 >> 172.21.15.121:0/88494108 conn(0x7f60a80c6b10 msgr2=0x7f60a80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 -- 172.21.15.121:0/88494108 shutdown_connections 2023-08-18T20:45:08.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.275+0000 7f60afbf8700 1 -- 172.21.15.121:0/88494108 wait complete. 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.276+0000 7f60afbf8700 1 Processor -- start 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.276+0000 7f60afbf8700 1 -- start start 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094003a00 0x7f60a80a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a81ead30 0x7f60a81eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80aa790 con 0x7f60a814daf0 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80ac780 con 0x7f6094003a00 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60afbf8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81ea8e0 con 0x7f60a81ead30 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42850/0 (socket says 172.21.15.121:42850) 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 -- 172.21.15.121:0/353975917 learned_addr learned my addr 172.21.15.121:0/353975917 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ae195700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a81ead30 0x7f60a81eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad994700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094003a00 0x7f60a80a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 -- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a81ead30 msgr2=0x7f60a81eb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a81ead30 0x7f60a81eb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 -- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094003a00 msgr2=0x7f60a80a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094003a00 0x7f60a80a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 -- 172.21.15.121:0/353975917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80aa260 con 0x7f60a814daf0 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.277+0000 7f60ad193700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f60a40072c0 tx=0x7f60a4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.278+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40077a0 con 0x7f60a814daf0 2023-08-18T20:45:08.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.278+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400f8d0 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.278+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a81eb6f0 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.278+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400fc80 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.278+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a81e7e40 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.279+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a81e7ca0 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.279+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60a401d460 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.279+0000 7f609e7fc700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 0x7f608c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.279+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f60a4088800 con 0x7f60a814daf0 2023-08-18T20:45:08.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.279+0000 7f60ad994700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 0x7f608c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.280+0000 7f60ad994700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 0x7f608c06c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6098015040 tx=0x7f6098009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.284+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f60a81e7ca0 con 0x7f60a814daf0 2023-08-18T20:45:08.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.473+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60a81e7ca0 con 0x7f60a814daf0 2023-08-18T20:45:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.474+0000 7f609e7fc700 1 -- 172.21.15.121:0/353975917 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60a81e7ca0 con 0x7f60a814daf0 2023-08-18T20:45:08.474 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:08.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 msgr2=0x7f608c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 0x7f608c06c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6098015040 tx=0x7f6098009030 comp rx=0 tx=0).stop 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 msgr2=0x7f60a8154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f60a40072c0 tx=0x7f60a4007680 comp rx=0 tx=0).stop 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 shutdown_connections 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a81ead30 0x7f60a81eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6094003a00 0x7f60a80a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f608c06a0e0 0x7f608c06c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 --2- 172.21.15.121:0/353975917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a814daf0 0x7f60a8154ac0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 >> 172.21.15.121:0/353975917 conn(0x7f60a80c6b10 msgr2=0x7f60a80c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 shutdown_connections 2023-08-18T20:45:08.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.476+0000 7f60afbf8700 1 -- 172.21.15.121:0/353975917 wait complete. 2023-08-18T20:45:08.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:45:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.610+0000 7f20a8557700 1 Processor -- start 2023-08-18T20:45:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.610+0000 7f20a8557700 1 -- start start 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a8557700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20a00c4980 0x7f20a00a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a8557700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a8557700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a00700e0 con 0x7f20a00719a0 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a8557700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a0157be0 con 0x7f20a00c4980 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a8557700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0157e80 con 0x7f20a00c34f0 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a62f3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20a00c4980 0x7f20a00a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a5af2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a5af2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39266/0 (socket says 172.21.15.121:39266) 2023-08-18T20:45:08.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a62f3700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20a00c4980 0x7f20a00a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52694/0 (socket says 172.21.15.121:52694) 2023-08-18T20:45:08.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.611+0000 7f20a5af2700 1 -- 172.21.15.121:0/4128084462 learned_addr learned my addr 172.21.15.121:0/4128084462 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:08.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a62f3700 1 -- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 msgr2=0x7f20a00c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:08.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a62f3700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a62f3700 1 -- 172.21.15.121:0/4128084462 >> v1:172.21.15.122:6789/0 conn(0x7f20a00719a0 legacy=0x7f20a0071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a62f3700 1 -- 172.21.15.121:0/4128084462 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0158160 con 0x7f20a00c4980 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a5af2700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a62f3700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a00a6d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2090009840 tx=0x7f2090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f337d0d35e026341 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a52f1700 1 -- 172.21.15.121:0/4128084462 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090011830 con 0x7f20a00c4980 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a52f1700 1 -- 172.21.15.121:0/4128084462 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2090011990 con 0x7f20a00c4980 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.612+0000 7f20a52f1700 1 -- 172.21.15.121:0/4128084462 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090011d20 con 0x7f20a00c4980 2023-08-18T20:45:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 -- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 msgr2=0x7f20a00a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a00a6d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2090009840 tx=0x7f2090009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 -- 172.21.15.121:0/4128084462 shutdown_connections 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a00a6d40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 --2- 172.21.15.121:0/4128084462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00c34f0 0x7f20a00c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 -- 172.21.15.121:0/4128084462 >> 172.21.15.121:0/4128084462 conn(0x7f20a00c7bf0 msgr2=0x7f20a00c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 -- 172.21.15.121:0/4128084462 shutdown_connections 2023-08-18T20:45:08.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.613+0000 7f20a8557700 1 -- 172.21.15.121:0/4128084462 wait complete. 2023-08-18T20:45:08.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.614+0000 7f20a8557700 1 Processor -- start 2023-08-18T20:45:08.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.614+0000 7f20a8557700 1 -- start start 2023-08-18T20:45:08.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00719a0 0x7f20a006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a01ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00a6f10 con 0x7f20a00c34f0 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00bd740 con 0x7f20a00c4980 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00bd180 con 0x7f20a00719a0 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42862/0 (socket says 172.21.15.121:42862) 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 -- 172.21.15.121:0/1960604956 learned_addr learned my addr 172.21.15.121:0/1960604956 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a62f3700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00719a0 0x7f20a006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a6af4700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a01ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 -- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00719a0 msgr2=0x7f20a006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00719a0 0x7f20a006cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 -- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 msgr2=0x7f20a01ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a01ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 -- 172.21.15.121:0/1960604956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009550 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a5af2700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f209c00ec10 tx=0x7f209c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c00c850 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c00c9b0 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900094a0 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c00cd40 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.615+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a00be300 con 0x7f20a00c34f0 2023-08-18T20:45:08.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.616+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a01eabb0 con 0x7f20a00c34f0 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.617+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f209c013470 con 0x7f20a00c34f0 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.617+0000 7f2096ffd700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 0x7f208406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.617+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f209c0889b0 con 0x7f20a00c34f0 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.617+0000 7f20a62f3700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 0x7f208406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.618+0000 7f20a62f3700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 0x7f208406c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.622+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f20a01eabb0 con 0x7f20a00c34f0 2023-08-18T20:45:08.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.810+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20a01eabb0 con 0x7f20a00c34f0 2023-08-18T20:45:08.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.811+0000 7f2096ffd700 1 -- 172.21.15.121:0/1960604956 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v37) v1 ==== 105+0+11 (secure 0 0 0) 0x7f20a01eabb0 con 0x7f20a00c34f0 2023-08-18T20:45:08.811 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:08.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 msgr2=0x7f208406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 0x7f208406c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090008030 comp rx=0 tx=0).stop 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 msgr2=0x7f20a01ebe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f209c00ec10 tx=0x7f209c00ef20 comp rx=0 tx=0).stop 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 shutdown_connections 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a00c4980 0x7f20a01ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a00719a0 0x7f20a006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f208406a0e0 0x7f208406c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 --2- 172.21.15.121:0/1960604956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20a00c34f0 0x7f20a01ebe40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 >> 172.21.15.121:0/1960604956 conn(0x7f20a00c7bf0 msgr2=0x7f20a0071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 shutdown_connections 2023-08-18T20:45:08.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.813+0000 7f20a8557700 1 -- 172.21.15.121:0/1960604956 wait complete. 2023-08-18T20:45:08.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:45:08.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.947+0000 7f6f6dee4700 1 Processor -- start 2023-08-18T20:45:08.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.947+0000 7f6f6dee4700 1 -- start start 2023-08-18T20:45:08.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f6dee4700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f6806fd30 0x7f6f680c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f6dee4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6f68152450 0x7f6f680c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f6dee4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f681529a0 con 0x7f6f681559c0 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f6dee4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f68152c80 con 0x7f6f68152450 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f6dee4700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68152f60 con 0x7f6f6806fd30 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f66ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6f68152450 0x7f6f680c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f67fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6f681559c0 0x7f6f6814f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49450/0 (socket says 172.21.15.121:49450) 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f67fff700 1 -- 172.21.15.121:0/1779574576 learned_addr learned my addr 172.21.15.121:0/1779574576 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f677fe700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f6806fd30 0x7f6f680c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f66ffd700 1 -- 172.21.15.121:0/1779574576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f6806fd30 msgr2=0x7f6f680c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f66ffd700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f6806fd30 0x7f6f680c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.948+0000 7f6f66ffd700 1 -- 172.21.15.121:0/1779574576 >> v1:172.21.15.121:6789/0 conn(0x7f6f681559c0 legacy=0x7f6f6814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f66ffd700 1 -- 172.21.15.121:0/1779574576 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68153240 con 0x7f6f68152450 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f667fc700 1 -- 172.21.15.121:0/1779574576 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167246316 0 0) 0x7f6f681529a0 con 0x7f6f681559c0 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f66ffd700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f68152450 0x7f6f680c7270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009840 tx=0x7f6f58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5491f2b9a1667377 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f667fc700 1 -- 172.21.15.121:0/1779574576 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58011830 con 0x7f6f68152450 2023-08-18T20:45:08.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f667fc700 1 -- 172.21.15.121:0/1779574576 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58011990 con 0x7f6f68152450 2023-08-18T20:45:08.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f667fc700 1 -- 172.21.15.121:0/1779574576 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58011d20 con 0x7f6f68152450 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 -- 172.21.15.121:0/1779574576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f68152450 msgr2=0x7f6f680c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f68152450 0x7f6f680c7270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009840 tx=0x7f6f58009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 -- 172.21.15.121:0/1779574576 shutdown_connections 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f6806fd30 0x7f6f680c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/1779574576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f68152450 0x7f6f680c7270 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 -- 172.21.15.121:0/1779574576 >> 172.21.15.121:0/1779574576 conn(0x7f6f680c7bf0 msgr2=0x7f6f680c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 -- 172.21.15.121:0/1779574576 shutdown_connections 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.949+0000 7f6f6dee4700 1 -- 172.21.15.121:0/1779574576 wait complete. 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.951+0000 7f6f6dee4700 1 Processor -- start 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.951+0000 7f6f6dee4700 1 -- start start 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f68152450 0x7f6f6814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 0x7f6f6814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c0dc0 con 0x7f6f6806fd30 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681eb750 con 0x7f6f681559c0 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f6dee4700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681eb9f0 con 0x7f6f68152450 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42876/0 (socket says 172.21.15.121:42876) 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 -- 172.21.15.121:0/3506720153 learned_addr learned my addr 172.21.15.121:0/3506720153 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f66ffd700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f68152450 0x7f6f6814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f67fff700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 0x7f6f6814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 -- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f68152450 msgr2=0x7f6f6814d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f68152450 0x7f6f6814d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 -- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 msgr2=0x7f6f6814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 0x7f6f6814dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f677fe700 1 -- 172.21.15.121:0/3506720153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f580094a0 con 0x7f6f6806fd30 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.952+0000 7f6f67fff700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 0x7f6f6814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f677fe700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e810 tx=0x7f6f5c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c013610 con 0x7f6f6806fd30 2023-08-18T20:45:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c013770 con 0x7f6f6806fd30 2023-08-18T20:45:08.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680c1010 con 0x7f6f6806fd30 2023-08-18T20:45:08.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c013b20 con 0x7f6f6806fd30 2023-08-18T20:45:08.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.953+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6814e160 con 0x7f6f6806fd30 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.954+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680c3560 con 0x7f6f6806fd30 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.954+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f5c013c80 con 0x7f6f6806fd30 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.954+0000 7f6f4ffff700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.955+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6f5c088520 con 0x7f6f6806fd30 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.955+0000 7f6f66ffd700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:08.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.955+0000 7f6f66ffd700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009840 tx=0x7f6f58008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:08.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:08.959+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6f680c3560 con 0x7f6f6806fd30 2023-08-18T20:45:09.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.147+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6f680c3560 con 0x7f6f6806fd30 2023-08-18T20:45:09.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.147+0000 7f6f4ffff700 1 -- 172.21.15.121:0/3506720153 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v37) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6f680c3560 con 0x7f6f6806fd30 2023-08-18T20:45:09.148 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:09.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 msgr2=0x7f6f5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009840 tx=0x7f6f58008030 comp rx=0 tx=0).stop 2023-08-18T20:45:09.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 msgr2=0x7f6f681eaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e810 tx=0x7f6f5c00eb20 comp rx=0 tx=0).stop 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 shutdown_connections 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f681559c0 0x7f6f6814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6806fd30 0x7f6f681eaf10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 --2- 172.21.15.121:0/3506720153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f68152450 0x7f6f6814d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 >> 172.21.15.121:0/3506720153 conn(0x7f6f680c7bf0 msgr2=0x7f6f681539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:09.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 shutdown_connections 2023-08-18T20:45:09.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.150+0000 7f6f6dee4700 1 -- 172.21.15.121:0/3506720153 wait complete. 2023-08-18T20:45:09.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:45:09.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 Processor -- start 2023-08-18T20:45:09.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 -- start start 2023-08-18T20:45:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7e3006f1e0 0x7f7e300c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c78b0 0x7f7e30158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e300c5d60 0x7f7e3006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e300c5240 con 0x7f7e3006f1e0 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e30157aa0 con 0x7f7e300c5d60 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.283+0000 7f7e37cb5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30155090 con 0x7f7e300c78b0 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7e3006f1e0 0x7f7e300c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7e3006f1e0 0x7f7e300c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42882/0 (socket says 172.21.15.121:42882) 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 -- 172.21.15.121:0/3222511840 learned_addr learned my addr 172.21.15.121:0/3222511840 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e36252700 1 --2- 172.21.15.121:0/3222511840 >> v2:172.21.15.122:3300/0 conn(0x7f7e300c5d60 0x7f7e3006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35250700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c78b0 0x7f7e30158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 -- 172.21.15.121:0/3222511840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c78b0 msgr2=0x7f7e30158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c78b0 0x7f7e30158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 -- 172.21.15.121:0/3222511840 >> v2:172.21.15.122:3300/0 conn(0x7f7e300c5d60 msgr2=0x7f7e3006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 --2- 172.21.15.121:0/3222511840 >> v2:172.21.15.122:3300/0 conn(0x7f7e300c5d60 0x7f7e3006f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 -- 172.21.15.121:0/3222511840 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30157d40 con 0x7f7e3006f1e0 2023-08-18T20:45:09.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e35a51700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e300c7280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e30152080 tx=0x7f7e24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f957618bca46748 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e34a4f700 1 -- 172.21.15.121:0/3222511840 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400b870 con 0x7f7e3006f1e0 2023-08-18T20:45:09.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e34a4f700 1 -- 172.21.15.121:0/3222511840 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400b9d0 con 0x7f7e3006f1e0 2023-08-18T20:45:09.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.284+0000 7f7e34a4f700 1 -- 172.21.15.121:0/3222511840 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400bd60 con 0x7f7e3006f1e0 2023-08-18T20:45:09.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 -- 172.21.15.121:0/3222511840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 msgr2=0x7f7e300c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e300c7280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e30152080 tx=0x7f7e24009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 -- 172.21.15.121:0/3222511840 shutdown_connections 2023-08-18T20:45:09.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/3222511840 >> v2:172.21.15.122:3300/0 conn(0x7f7e300c5d60 0x7f7e3006f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e300c7280 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/3222511840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c78b0 0x7f7e30158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 -- 172.21.15.121:0/3222511840 >> 172.21.15.121:0/3222511840 conn(0x7f7e300a9a90 msgr2=0x7f7e300a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 -- 172.21.15.121:0/3222511840 shutdown_connections 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.285+0000 7f7e37cb5700 1 -- 172.21.15.121:0/3222511840 wait complete. 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.286+0000 7f7e37cb5700 1 Processor -- start 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.286+0000 7f7e37cb5700 1 -- start start 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c5d60 0x7f7e3014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e300c78b0 0x7f7e3014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3014e700 con 0x7f7e3006f1e0 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e301ede80 con 0x7f7e300c78b0 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e301ed270 con 0x7f7e300c5d60 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42888/0 (socket says 172.21.15.121:42888) 2023-08-18T20:45:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 -- 172.21.15.121:0/1206960659 learned_addr learned my addr 172.21.15.121:0/1206960659 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e36252700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e300c78b0 0x7f7e3014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35250700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c5d60 0x7f7e3014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 -- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c5d60 msgr2=0x7f7e3014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c5d60 0x7f7e3014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 -- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e300c78b0 msgr2=0x7f7e3014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e300c78b0 0x7f7e3014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 -- 172.21.15.121:0/1206960659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24009550 con 0x7f7e3006f1e0 2023-08-18T20:45:09.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e35a51700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24004480 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e240045e0 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e301ed550 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e240038e0 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.287+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e301edb10 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.288+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e30067bf0 con 0x7f7e3006f1e0 2023-08-18T20:45:09.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.289+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e24021070 con 0x7f7e3006f1e0 2023-08-18T20:45:09.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.289+0000 7f7e227fc700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 0x7f7e1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.289+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7e24089e40 con 0x7f7e3006f1e0 2023-08-18T20:45:09.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.289+0000 7f7e35250700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 0x7f7e1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.290+0000 7f7e35250700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 0x7f7e1406c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e301519c0 tx=0x7f7e2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.293+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7e24055260 con 0x7f7e3006f1e0 2023-08-18T20:45:09.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.502+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e3006b950 con 0x7f7e3006f1e0 2023-08-18T20:45:09.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.502+0000 7f7e227fc700 1 -- 172.21.15.121:0/1206960659 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e24015080 con 0x7f7e3006f1e0 2023-08-18T20:45:09.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 msgr2=0x7f7e1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 0x7f7e1406c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e301519c0 tx=0x7f7e2c008040 comp rx=0 tx=0).stop 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 msgr2=0x7f7e301535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e24004750 comp rx=0 tx=0).stop 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 shutdown_connections 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e300c78b0 0x7f7e3014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7e1406a0e0 0x7f7e1406c5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e3006f1e0 0x7f7e301535a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 --2- 172.21.15.121:0/1206960659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e300c5d60 0x7f7e3014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 >> 172.21.15.121:0/1206960659 conn(0x7f7e300a9a90 msgr2=0x7f7e300a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 shutdown_connections 2023-08-18T20:45:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.504+0000 7f7e37cb5700 1 -- 172.21.15.121:0/1206960659 wait complete. 2023-08-18T20:45:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:45:09.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-18T20:45:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:09.517 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:09.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:45:09.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:09.564 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-18T20:45:09.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:09.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.703+0000 7fa854824700 1 Processor -- start 2023-08-18T20:45:09.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.703+0000 7fa854824700 1 -- start start 2023-08-18T20:45:09.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa854824700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa85006f1e0 0x7fa8500c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa854824700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa850158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa854824700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa850157aa0 con 0x7fa8500c5d60 2023-08-18T20:45:09.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa854824700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8500c5240 con 0x7fa85006f1e0 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa854824700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa850155090 con 0x7fa8500c78b0 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa84e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa85006f1e0 0x7fa8500c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa84ed9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa8500c5d60 0x7fa85006f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49482/0 (socket says 172.21.15.121:49482) 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.704+0000 7fa84ed9d700 1 -- 172.21.15.121:0/3115541641 learned_addr learned my addr 172.21.15.121:0/3115541641 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84d59a700 1 -- 172.21.15.121:0/3115541641 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056498777 0 0) 0x7fa850157aa0 con 0x7fa8500c5d60 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84dd9b700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa850158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84d59a700 1 -- 172.21.15.121:0/3115541641 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8380035b0 con 0x7fa8500c5d60 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84e59c700 1 -- 172.21.15.121:0/3115541641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 msgr2=0x7fa850158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84e59c700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa850158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84e59c700 1 -- 172.21.15.121:0/3115541641 >> v1:172.21.15.121:6789/0 conn(0x7fa8500c5d60 legacy=0x7fa85006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84e59c700 1 -- 172.21.15.121:0/3115541641 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850157d40 con 0x7fa85006f1e0 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84dd9b700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa850158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84e59c700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa8500c7280 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa844009840 tx=0x7fa844009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619bc89eeeb2c5ae server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84d59a700 1 -- 172.21.15.121:0/3115541641 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844011830 con 0x7fa85006f1e0 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84d59a700 1 -- 172.21.15.121:0/3115541641 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844011990 con 0x7fa85006f1e0 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.705+0000 7fa84d59a700 1 -- 172.21.15.121:0/3115541641 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844011d20 con 0x7fa85006f1e0 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 -- 172.21.15.121:0/3115541641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 msgr2=0x7fa8500c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa8500c7280 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa844009840 tx=0x7fa844009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 -- 172.21.15.121:0/3115541641 shutdown_connections 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa8500c7280 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 --2- 172.21.15.121:0/3115541641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa850158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 -- 172.21.15.121:0/3115541641 >> 172.21.15.121:0/3115541641 conn(0x7fa8500a9a90 msgr2=0x7fa8500a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:09.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 -- 172.21.15.121:0/3115541641 shutdown_connections 2023-08-18T20:45:09.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.706+0000 7fa854824700 1 -- 172.21.15.121:0/3115541641 wait complete. 2023-08-18T20:45:09.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.707+0000 7fa854824700 1 Processor -- start 2023-08-18T20:45:09.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.707+0000 7fa854824700 1 -- start start 2023-08-18T20:45:09.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8500c5d60 0x7fa85014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa85014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500aad90 con 0x7fa85006f1e0 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501ed400 con 0x7fa8500c5d60 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501ed930 con 0x7fa8500c78b0 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42902/0 (socket says 172.21.15.121:42902) 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 -- 172.21.15.121:0/2513866452 learned_addr learned my addr 172.21.15.121:0/2513866452 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84ed9d700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa85014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84dd9b700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8500c5d60 0x7fa85014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 -- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 msgr2=0x7fa85014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa85014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 -- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8500c5d60 msgr2=0x7fa85014e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8500c5d60 0x7fa85014e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 -- 172.21.15.121:0/2513866452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440094a0 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa84e59c700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa8440090b0 tx=0x7fa844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440036a0 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84401e070 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa850150bd0 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844003a60 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.708+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8501e9620 con 0x7fa85006f1e0 2023-08-18T20:45:09.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.709+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8501e9480 con 0x7fa85006f1e0 2023-08-18T20:45:09.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.710+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa844003bc0 con 0x7fa85006f1e0 2023-08-18T20:45:09.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.710+0000 7fa83effd700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 0x7fa83006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:09.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.710+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa8440897c0 con 0x7fa85006f1e0 2023-08-18T20:45:09.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.710+0000 7fa84dd9b700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 0x7fa83006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:09.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.711+0000 7fa84dd9b700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 0x7fa83006c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8500beec0 tx=0x7fa840008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:09.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.715+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa8501e9480 con 0x7fa85006f1e0 2023-08-18T20:45:09.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.945+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8501e9480 con 0x7fa85006f1e0 2023-08-18T20:45:09.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.946+0000 7fa83effd700 1 -- 172.21.15.121:0/2513866452 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6063 (secure 0 0 0) 0x7fa8501e9480 con 0x7fa85006f1e0 2023-08-18T20:45:09.947 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:09.947 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:09.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 msgr2=0x7fa83006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 0x7fa83006c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8500beec0 tx=0x7fa840008040 comp rx=0 tx=0).stop 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 msgr2=0x7fa850153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa8440090b0 tx=0x7fa844004750 comp rx=0 tx=0).stop 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 shutdown_connections 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8500c78b0 0x7fa85014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa83006a0e0 0x7fa83006c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa85006f1e0 0x7fa850153ac0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 --2- 172.21.15.121:0/2513866452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8500c5d60 0x7fa85014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:09.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 >> 172.21.15.121:0/2513866452 conn(0x7fa8500a9a90 msgr2=0x7fa85006f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:09.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 shutdown_connections 2023-08-18T20:45:09.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:09.948+0000 7fa854824700 1 -- 172.21.15.121:0/2513866452 wait complete. 2023-08-18T20:45:09.950 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2023-08-18T20:45:09.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:10.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.080+0000 7f6976a65700 1 Processor -- start 2023-08-18T20:45:10.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 -- start start 2023-08-18T20:45:10.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69700c60c0 0x7f69700bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c64a0 0x7f697006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69700c6920 con 0x7f69701544a0 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6970155040 con 0x7f69700c60c0 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.081+0000 7f6976a65700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69701588f0 con 0x7f69700c64a0 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69700c60c0 0x7f69700bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6975002700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f69701544a0 0x7f6970154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49492/0 (socket says 172.21.15.121:49492) 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6975002700 1 -- 172.21.15.121:0/1678365720 learned_addr learned my addr 172.21.15.121:0/1678365720 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f696ffff700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c64a0 0x7f697006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 -- 172.21.15.121:0/1678365720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c64a0 msgr2=0x7f697006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c64a0 0x7f697006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 -- 172.21.15.121:0/1678365720 >> v1:172.21.15.121:6789/0 conn(0x7f69701544a0 legacy=0x7f6970154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f696f7fe700 1 -- 172.21.15.121:0/1678365720 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634720643 0 0) 0x7f69700c6920 con 0x7f69701544a0 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 -- 172.21.15.121:0/1678365720 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970157b30 con 0x7f69700c60c0 2023-08-18T20:45:10.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f6974801700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c60c0 0x7f69700bd5a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6964009840 tx=0x7f6964009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f36bbe6085261 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f696f7fe700 1 -- 172.21.15.121:0/1678365720 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964011830 con 0x7f69700c60c0 2023-08-18T20:45:10.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f696f7fe700 1 -- 172.21.15.121:0/1678365720 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964011990 con 0x7f69700c60c0 2023-08-18T20:45:10.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.082+0000 7f696f7fe700 1 -- 172.21.15.121:0/1678365720 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964011d20 con 0x7f69700c60c0 2023-08-18T20:45:10.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 -- 172.21.15.121:0/1678365720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c60c0 msgr2=0x7f69700bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c60c0 0x7f69700bd5a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6964009840 tx=0x7f6964009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 -- 172.21.15.121:0/1678365720 shutdown_connections 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c60c0 0x7f69700bd5a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 --2- 172.21.15.121:0/1678365720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c64a0 0x7f697006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 -- 172.21.15.121:0/1678365720 >> 172.21.15.121:0/1678365720 conn(0x7f69700c35a0 msgr2=0x7f69700c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 -- 172.21.15.121:0/1678365720 shutdown_connections 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.083+0000 7f6976a65700 1 -- 172.21.15.121:0/1678365720 wait complete. 2023-08-18T20:45:10.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.084+0000 7f6976a65700 1 Processor -- start 2023-08-18T20:45:10.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.084+0000 7f6976a65700 1 -- start start 2023-08-18T20:45:10.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c60c0 0x7f697014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69701544a0 0x7f69700c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6970070bd0 con 0x7f69700c64a0 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69700becf0 con 0x7f69701544a0 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69700708a0 con 0x7f69700c60c0 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42918/0 (socket says 172.21.15.121:42918) 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 -- 172.21.15.121:0/140973083 learned_addr learned my addr 172.21.15.121:0/140973083 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:10.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6974801700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c60c0 0x7f697014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 -- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c60c0 msgr2=0x7f697014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c60c0 0x7f697014f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 -- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69701544a0 msgr2=0x7f69700c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6975002700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69701544a0 0x7f69700c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69701544a0 0x7f69700c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 -- 172.21.15.121:0/140973083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640094a0 con 0x7f69700c64a0 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696ffff700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f695c00e9e0 tx=0x7f695c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c009710 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00c850 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00cbc0 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.085+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69701ea100 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.086+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697014f740 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.087+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6970070d80 con 0x7f69700c64a0 2023-08-18T20:45:10.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.087+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f695c00cd20 con 0x7f69700c64a0 2023-08-18T20:45:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.087+0000 7f696d7fa700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 0x7f695406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.087+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f695c088da0 con 0x7f69700c64a0 2023-08-18T20:45:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.087+0000 7f6974801700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 0x7f695406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.088+0000 7f6974801700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 0x7f695406c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69640090b0 tx=0x7f6964008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.092+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6970070d80 con 0x7f69700c64a0 2023-08-18T20:45:10.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.285+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6970070d80 con 0x7f69700c64a0 2023-08-18T20:45:10.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.286+0000 7f696d7fa700 1 -- 172.21.15.121:0/140973083 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7f6970070d80 con 0x7f69700c64a0 2023-08-18T20:45:10.287 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:10.287 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 msgr2=0x7f695406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 0x7f695406c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69640090b0 tx=0x7f6964008030 comp rx=0 tx=0).stop 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 msgr2=0x7f69700c03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f695c00e9e0 tx=0x7f695c00eda0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 shutdown_connections 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69701544a0 0x7f69700c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69700c60c0 0x7f697014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f695406a0e0 0x7f695406c5a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 --2- 172.21.15.121:0/140973083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69700c64a0 0x7f69700c03c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 >> 172.21.15.121:0/140973083 conn(0x7f69700c35a0 msgr2=0x7f6970152930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 shutdown_connections 2023-08-18T20:45:10.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.288+0000 7f6976a65700 1 -- 172.21.15.121:0/140973083 wait complete. 2023-08-18T20:45:10.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:44:31.655910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:44:32.362264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:44:45.110030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:44:46.431796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:10.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.424+0000 7f1ce401c700 1 Processor -- start 2023-08-18T20:45:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.424+0000 7f1ce401c700 1 -- start start 2023-08-18T20:45:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce401c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce401c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 0x7f1cdc0c3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce401c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cdc0c5c70 con 0x7f1cdc0c6650 2023-08-18T20:45:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce401c700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc0c29f0 con 0x7f1cdc0c5790 2023-08-18T20:45:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce401c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc0c4a80 con 0x7f1cdc06a510 2023-08-18T20:45:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce1db8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce25b9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 0x7f1cdc0c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce1db8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39334/0 (socket says 172.21.15.121:39334) 2023-08-18T20:45:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce1db8700 1 -- 172.21.15.121:0/3465121405 learned_addr learned my addr 172.21.15.121:0/3465121405 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.425+0000 7f1ce25b9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 0x7f1cdc0c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52764/0 (socket says 172.21.15.121:52764) 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce1db8700 1 -- 172.21.15.121:0/3465121405 >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 msgr2=0x7f1cdc0c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce1db8700 1 --2- 172.21.15.121:0/3465121405 >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 0x7f1cdc0c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce1db8700 1 -- 172.21.15.121:0/3465121405 >> v1:172.21.15.122:6789/0 conn(0x7f1cdc0c6650 legacy=0x7f1cdc152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce1db8700 1 -- 172.21.15.121:0/3465121405 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc0c4d60 con 0x7f1cdc06a510 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce1db8700 1 --2- 172.21.15.121:0/3465121405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80098f0 tx=0x7f1cd8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fc22c848b27a04 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce0db6700 1 -- 172.21.15.121:0/3465121405 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011830 con 0x7f1cdc06a510 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce0db6700 1 -- 172.21.15.121:0/3465121405 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8011990 con 0x7f1cdc06a510 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce0db6700 1 -- 172.21.15.121:0/3465121405 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011d20 con 0x7f1cdc06a510 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce401c700 1 -- 172.21.15.121:0/3465121405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 msgr2=0x7f1cdc06df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.426+0000 7f1ce401c700 1 --2- 172.21.15.121:0/3465121405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80098f0 tx=0x7f1cd8009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 -- 172.21.15.121:0/3465121405 shutdown_connections 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 --2- 172.21.15.121:0/3465121405 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc06a510 0x7f1cdc06df60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 --2- 172.21.15.121:0/3465121405 >> v2:172.21.15.122:3300/0 conn(0x7f1cdc0c5790 0x7f1cdc0c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 -- 172.21.15.121:0/3465121405 >> 172.21.15.121:0/3465121405 conn(0x7f1cdc06b9e0 msgr2=0x7f1cdc0a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 -- 172.21.15.121:0/3465121405 shutdown_connections 2023-08-18T20:45:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.427+0000 7f1ce401c700 1 -- 172.21.15.121:0/3465121405 wait complete. 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 Processor -- start 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 -- start start 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cdc0c5790 0x7f1cdc1e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc0c6650 0x7f1cdc1e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc1552e0 con 0x7f1cdc06a510 2023-08-18T20:45:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc1ed440 con 0x7f1cdc0c5790 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.428+0000 7f1ce401c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc152b60 con 0x7f1cdc0c6650 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42928/0 (socket says 172.21.15.121:42928) 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 -- 172.21.15.121:0/769384726 learned_addr learned my addr 172.21.15.121:0/769384726 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce25b9700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc0c6650 0x7f1cdc1e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce15b7700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cdc0c5790 0x7f1cdc1e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 -- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc0c6650 msgr2=0x7f1cdc1e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc0c6650 0x7f1cdc1e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 -- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cdc0c5790 msgr2=0x7f1cdc1e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cdc0c5790 0x7f1cdc1e96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 -- 172.21.15.121:0/769384726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009550 con 0x7f1cdc06a510 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce1db8700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009c40 tx=0x7f1cd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8004530 con 0x7f1cdc06a510 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd801f070 con 0x7f1cdc06a510 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80038c0 con 0x7f1cdc06a510 2023-08-18T20:45:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc156590 con 0x7f1cdc06a510 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.429+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc1ed0d0 con 0x7f1cdc06a510 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.430+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc1ed290 con 0x7f1cdc06a510 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.430+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1cd8021030 con 0x7f1cdc06a510 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.431+0000 7f1cd27fc700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 0x7f1cc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.431+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1cd8089d80 con 0x7f1cdc06a510 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.431+0000 7f1ce15b7700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 0x7f1cc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.431+0000 7f1ce15b7700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 0x7f1cc006c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0c3e30 tx=0x7f1ccc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.435+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1cd8055120 con 0x7f1cdc06a510 2023-08-18T20:45:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.623+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1cdc1ecc50 con 0x7f1cdc06a510 2023-08-18T20:45:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.624+0000 7f1cd27fc700 1 -- 172.21.15.121:0/769384726 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1cdc1ecc50 con 0x7f1cdc06a510 2023-08-18T20:45:10.625 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 msgr2=0x7f1cc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 0x7f1cc006c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0c3e30 tx=0x7f1ccc009040 comp rx=0 tx=0).stop 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 msgr2=0x7f1cdc0bfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009c40 tx=0x7f1cd8004750 comp rx=0 tx=0).stop 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 shutdown_connections 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1cdc0c6650 0x7f1cdc1e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cc006a0e0 0x7f1cc006c5a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cdc06a510 0x7f1cdc0bfff0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 --2- 172.21.15.121:0/769384726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cdc0c5790 0x7f1cdc1e96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 >> 172.21.15.121:0/769384726 conn(0x7f1cdc06b9e0 msgr2=0x7f1cdc150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 shutdown_connections 2023-08-18T20:45:10.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.626+0000 7f1ce401c700 1 -- 172.21.15.121:0/769384726 wait complete. 2023-08-18T20:45:10.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:10.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.760+0000 7f569a634700 1 Processor -- start 2023-08-18T20:45:10.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.760+0000 7f569a634700 1 -- start start 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f569a634700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f569a634700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5694157c10 0x7f56941580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f569a634700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940c21f0 con 0x7f56940c1cf0 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f569a634700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56940c2ba0 con 0x7f5694157c10 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f569a634700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940c6300 con 0x7f569406a510 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.761+0000 7f5693fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5698bd1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5694157c10 0x7f56941580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39346/0 (socket says 172.21.15.121:39346) 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 -- 172.21.15.121:0/3857221760 learned_addr learned my addr 172.21.15.121:0/3857221760 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 -- 172.21.15.121:0/3857221760 >> v2:172.21.15.122:3300/0 conn(0x7f5694157c10 msgr2=0x7f56941580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 --2- 172.21.15.121:0/3857221760 >> v2:172.21.15.122:3300/0 conn(0x7f5694157c10 0x7f56941580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 -- 172.21.15.121:0/3857221760 >> v1:172.21.15.122:6789/0 conn(0x7f56940c1cf0 legacy=0x7f5694151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 -- 172.21.15.121:0/3857221760 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940c5b20 con 0x7f569406a510 2023-08-18T20:45:10.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5693fff700 1 --2- 172.21.15.121:0/3857221760 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56880098f0 tx=0x7f5688009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f316c6d8ec665eb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5692ffd700 1 -- 172.21.15.121:0/3857221760 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011830 con 0x7f569406a510 2023-08-18T20:45:10.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5692ffd700 1 -- 172.21.15.121:0/3857221760 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688011990 con 0x7f569406a510 2023-08-18T20:45:10.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.762+0000 7f5692ffd700 1 -- 172.21.15.121:0/3857221760 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011d20 con 0x7f569406a510 2023-08-18T20:45:10.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 -- 172.21.15.121:0/3857221760 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 msgr2=0x7f56940c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 --2- 172.21.15.121:0/3857221760 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56880098f0 tx=0x7f5688009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 -- 172.21.15.121:0/3857221760 shutdown_connections 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 --2- 172.21.15.121:0/3857221760 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f569406a510 0x7f56940c5490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 --2- 172.21.15.121:0/3857221760 >> v2:172.21.15.122:3300/0 conn(0x7f5694157c10 0x7f56941580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 -- 172.21.15.121:0/3857221760 >> 172.21.15.121:0/3857221760 conn(0x7f56940c6b10 msgr2=0x7f56940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 -- 172.21.15.121:0/3857221760 shutdown_connections 2023-08-18T20:45:10.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.763+0000 7f569a634700 1 -- 172.21.15.121:0/3857221760 wait complete. 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.764+0000 7f569a634700 1 Processor -- start 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.764+0000 7f569a634700 1 -- start start 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f56940c1cf0 0x7f569406d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 0x7f56941ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694153fc0 con 0x7f569406a510 2023-08-18T20:45:10.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406e170 con 0x7f5694157c10 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f569a634700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56941ed260 con 0x7f56940c1cf0 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42940/0 (socket says 172.21.15.121:42940) 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 -- 172.21.15.121:0/3168992575 learned_addr learned my addr 172.21.15.121:0/3168992575 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f56937fe700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f56940c1cf0 0x7f569406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5698bd1700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 0x7f56941ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 -- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f56940c1cf0 msgr2=0x7f569406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f56940c1cf0 0x7f569406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 -- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 msgr2=0x7f56941ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 0x7f56941ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 -- 172.21.15.121:0/3168992575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688009550 con 0x7f569406a510 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5698bd1700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 0x7f56941ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.765+0000 7f5693fff700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5688014040 tx=0x7f5688004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.766+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688004590 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.766+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568801e070 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.766+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56941eac00 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.766+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880038e0 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.766+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5694155320 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.767+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56940672d0 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.767+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5688003a40 con 0x7f569406a510 2023-08-18T20:45:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.767+0000 7f5690ff9700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 0x7f568006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.767+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f5688089750 con 0x7f569406a510 2023-08-18T20:45:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.767+0000 7f56937fe700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 0x7f568006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.768+0000 7f56937fe700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 0x7f568006c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56940a6190 tx=0x7f5684009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.772+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5688054b70 con 0x7f569406a510 2023-08-18T20:45:10.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.961+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5694074730 con 0x7f569406a510 2023-08-18T20:45:10.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.962+0000 7f5690ff9700 1 -- 172.21.15.121:0/3168992575 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5688058190 con 0x7f569406a510 2023-08-18T20:45:10.962 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:10.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 msgr2=0x7f568006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 0x7f568006c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56940a6190 tx=0x7f5684009040 comp rx=0 tx=0).stop 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 msgr2=0x7f56941ea6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5688014040 tx=0x7f5688004750 comp rx=0 tx=0).stop 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 shutdown_connections 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5694157c10 0x7f56941ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f568006a0e0 0x7f568006c5a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f569406a510 0x7f56941ea6c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 --2- 172.21.15.121:0/3168992575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f56940c1cf0 0x7f569406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:10.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 >> 172.21.15.121:0/3168992575 conn(0x7f56940c6b10 msgr2=0x7f56941563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:10.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 shutdown_connections 2023-08-18T20:45:10.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:10.964+0000 7f569a634700 1 -- 172.21.15.121:0/3168992575 wait complete. 2023-08-18T20:45:10.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:45:11.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.101+0000 7f61666be700 1 Processor -- start 2023-08-18T20:45:11.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.101+0000 7f61666be700 1 -- start start 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f61666be700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f61600a6290 0x7f61600c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f61666be700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 0x7f61600c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f61666be700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600c4f40 con 0x7f61600c0c50 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f61666be700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600c5e50 con 0x7f61600a6290 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f61666be700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600c6120 con 0x7f61600c1b10 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f61600a6290 0x7f61600c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f61600a6290 0x7f61600c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42950/0 (socket says 172.21.15.121:42950) 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 -- 172.21.15.121:0/1153600758 learned_addr learned my addr 172.21.15.121:0/1153600758 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f6164c5b700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 0x7f61600c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 -- 172.21.15.121:0/1153600758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 msgr2=0x7f61600c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 0x7f61600c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 -- 172.21.15.121:0/1153600758 >> v1:172.21.15.122:6789/0 conn(0x7f61600c0c50 legacy=0x7f616006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 -- 172.21.15.121:0/1153600758 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61601551f0 con 0x7f61600a6290 2023-08-18T20:45:11.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f6164c5b700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 0x7f61600c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:11.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615f7fe700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600a6290 0x7f61600c53d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f61500098f0 tx=0x7f6150009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15775a1bc79cb7c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615effd700 1 -- 172.21.15.121:0/1153600758 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000b8a0 con 0x7f61600a6290 2023-08-18T20:45:11.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615effd700 1 -- 172.21.15.121:0/1153600758 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000ba00 con 0x7f61600a6290 2023-08-18T20:45:11.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.102+0000 7f615effd700 1 -- 172.21.15.121:0/1153600758 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bd90 con 0x7f61600a6290 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 -- 172.21.15.121:0/1153600758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600a6290 msgr2=0x7f61600c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600a6290 0x7f61600c53d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f61500098f0 tx=0x7f6150009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 -- 172.21.15.121:0/1153600758 shutdown_connections 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c1b10 0x7f61600c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 --2- 172.21.15.121:0/1153600758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600a6290 0x7f61600c53d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 -- 172.21.15.121:0/1153600758 >> 172.21.15.121:0/1153600758 conn(0x7f61600c6b10 msgr2=0x7f61600c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 -- 172.21.15.121:0/1153600758 shutdown_connections 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.103+0000 7f61666be700 1 -- 172.21.15.121:0/1153600758 wait complete. 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.104+0000 7f61666be700 1 Processor -- start 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.104+0000 7f61666be700 1 -- start start 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61600a6290 0x7f61600a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c0c50 0x7f6160072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600ac650 con 0x7f61600c1b10 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600aca70 con 0x7f61600a6290 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f61666be700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600abda0 con 0x7f61600c0c50 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42958/0 (socket says 172.21.15.121:42958) 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 -- 172.21.15.121:0/1835132247 learned_addr learned my addr 172.21.15.121:0/1835132247 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f615f7fe700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c0c50 0x7f6160072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f615ffff700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61600a6290 0x7f61600a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 -- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c0c50 msgr2=0x7f6160072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c0c50 0x7f6160072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 -- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61600a6290 msgr2=0x7f61600a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61600a6290 0x7f61600a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 -- 172.21.15.121:0/1835132247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009550 con 0x7f61600c1b10 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.105+0000 7f6164c5b700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6158007ef0 tx=0x7f615800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800dd80 con 0x7f61600c1b10 2023-08-18T20:45:11.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800f040 con 0x7f61600c1b10 2023-08-18T20:45:11.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61600aaf30 con 0x7f61600c1b10 2023-08-18T20:45:11.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158003c60 con 0x7f61600c1b10 2023-08-18T20:45:11.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61600abf90 con 0x7f61600c1b10 2023-08-18T20:45:11.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.106+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6160074730 con 0x7f61600c1b10 2023-08-18T20:45:11.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.107+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6158004030 con 0x7f61600c1b10 2023-08-18T20:45:11.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.107+0000 7f615cff9700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 0x7f614c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.107+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6158088870 con 0x7f61600c1b10 2023-08-18T20:45:11.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.107+0000 7f615ffff700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 0x7f614c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.108+0000 7f615ffff700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 0x7f614c06c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6160072930 tx=0x7f6154009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.112+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6158053c90 con 0x7f61600c1b10 2023-08-18T20:45:11.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.304+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61600c4a10 con 0x7f61600c1b10 2023-08-18T20:45:11.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.304+0000 7f615cff9700 1 -- 172.21.15.121:0/1835132247 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61580572b0 con 0x7f61600c1b10 2023-08-18T20:45:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 msgr2=0x7f614c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 0x7f614c06c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6160072930 tx=0x7f6154009040 comp rx=0 tx=0).stop 2023-08-18T20:45:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 msgr2=0x7f6160152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6158007ef0 tx=0x7f615800d3b0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 shutdown_connections 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f614c06a0e0 0x7f614c06c5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61600c1b10 0x7f6160152300 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61600a6290 0x7f61600a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 --2- 172.21.15.121:0/1835132247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61600c0c50 0x7f6160072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 >> 172.21.15.121:0/1835132247 conn(0x7f61600c6b10 msgr2=0x7f616006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 shutdown_connections 2023-08-18T20:45:11.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.307+0000 7f61666be700 1 -- 172.21.15.121:0/1835132247 wait complete. 2023-08-18T20:45:11.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:45:11.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.443+0000 7f4d3b376700 1 Processor -- start 2023-08-18T20:45:11.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 -- start start 2023-08-18T20:45:11.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 0x7f4d3414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340c15b0 con 0x7f4d34150410 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3406d8c0 con 0x7f4d340ab4b0 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.444+0000 7f4d3b376700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34150860 con 0x7f4d3406c4f0 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d38911700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 0x7f4d3414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d38911700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 0x7f4d3414fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:52800/0 (socket says 172.21.15.121:52800) 2023-08-18T20:45:11.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39372/0 (socket says 172.21.15.121:39372) 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d38911700 1 -- 172.21.15.121:0/2094672763 learned_addr learned my addr 172.21.15.121:0/2094672763 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 -- 172.21.15.121:0/2094672763 >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 msgr2=0x7f4d3414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 --2- 172.21.15.121:0/2094672763 >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 0x7f4d3414fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 -- 172.21.15.121:0/2094672763 >> v1:172.21.15.122:6789/0 conn(0x7f4d34150410 legacy=0x7f4d34150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 -- 172.21.15.121:0/2094672763 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340c0c80 con 0x7f4d3406c4f0 2023-08-18T20:45:11.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d39112700 1 --2- 172.21.15.121:0/2094672763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009840 tx=0x7f4d24009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e507c631aeae5bdf server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d2bfff700 1 -- 172.21.15.121:0/2094672763 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24011830 con 0x7f4d3406c4f0 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d2bfff700 1 -- 172.21.15.121:0/2094672763 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24011990 con 0x7f4d3406c4f0 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.445+0000 7f4d2bfff700 1 -- 172.21.15.121:0/2094672763 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24011d20 con 0x7f4d3406c4f0 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 -- 172.21.15.121:0/2094672763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 msgr2=0x7f4d340c0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 --2- 172.21.15.121:0/2094672763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009840 tx=0x7f4d24009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 -- 172.21.15.121:0/2094672763 shutdown_connections 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 --2- 172.21.15.121:0/2094672763 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c0300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 --2- 172.21.15.121:0/2094672763 >> v2:172.21.15.122:3300/0 conn(0x7f4d340ab4b0 0x7f4d3414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 -- 172.21.15.121:0/2094672763 >> 172.21.15.121:0/2094672763 conn(0x7f4d340a7610 msgr2=0x7f4d340a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 -- 172.21.15.121:0/2094672763 shutdown_connections 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.446+0000 7f4d3b376700 1 -- 172.21.15.121:0/2094672763 wait complete. 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.447+0000 7f4d3b376700 1 Processor -- start 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.447+0000 7f4d3b376700 1 -- start start 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d340ab4b0 0x7f4d3406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340aab90 con 0x7f4d34150410 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34070f80 con 0x7f4d340ab4b0 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d3b376700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340a9220 con 0x7f4d3406c4f0 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42972/0 (socket says 172.21.15.121:42972) 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 -- 172.21.15.121:0/1006235322 learned_addr learned my addr 172.21.15.121:0/1006235322 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39112700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d38911700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d340ab4b0 0x7f4d3406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 -- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 msgr2=0x7f4d340c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 -- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d340ab4b0 msgr2=0x7f4d3406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d340ab4b0 0x7f4d3406f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.448+0000 7f4d39913700 1 -- 172.21.15.121:0/1006235322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240094a0 con 0x7f4d34150410 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d39913700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cb50 tx=0x7f4d2c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c003c00 con 0x7f4d34150410 2023-08-18T20:45:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c003d60 con 0x7f4d34150410 2023-08-18T20:45:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d340a9500 con 0x7f4d34150410 2023-08-18T20:45:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00aa20 con 0x7f4d34150410 2023-08-18T20:45:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.449+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340ab050 con 0x7f4d34150410 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.450+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d340a9690 con 0x7f4d34150410 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.450+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d2c00ab80 con 0x7f4d34150410 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.451+0000 7f4d29ffb700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.451+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4d2c088840 con 0x7f4d34150410 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.451+0000 7f4d39112700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.451+0000 7f4d39112700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.455+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4d2c053c60 con 0x7f4d34150410 2023-08-18T20:45:11.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.643+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d34074730 con 0x7f4d34150410 2023-08-18T20:45:11.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.644+0000 7f4d29ffb700 1 -- 172.21.15.121:0/1006235322 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d2c057280 con 0x7f4d34150410 2023-08-18T20:45:11.645 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:11.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 msgr2=0x7f4d1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24008030 comp rx=0 tx=0).stop 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 msgr2=0x7f4d340a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cb50 tx=0x7f4d2c00ce60 comp rx=0 tx=0).stop 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 shutdown_connections 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d34150410 0x7f4d340a9990 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3406c4f0 0x7f4d340c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 --2- 172.21.15.121:0/1006235322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d340ab4b0 0x7f4d3406f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 >> 172.21.15.121:0/1006235322 conn(0x7f4d340a7610 msgr2=0x7f4d3414be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 shutdown_connections 2023-08-18T20:45:11.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.646+0000 7f4d3b376700 1 -- 172.21.15.121:0/1006235322 wait complete. 2023-08-18T20:45:11.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:45:11.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.782+0000 7f4ab9968700 1 Processor -- start 2023-08-18T20:45:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.782+0000 7f4ab9968700 1 -- start start 2023-08-18T20:45:11.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab9968700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4ab40ab4b0 0x7f4ab40c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab9968700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab40c15b0 con 0x7f4ab41505e0 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab9968700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab406d8c0 con 0x7f4ab406c4f0 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab9968700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40c0c80 con 0x7f4ab40ab4b0 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab27fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4ab41505e0 0x7f4ab4150b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49560/0 (socket says 172.21.15.121:49560) 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab27fc700 1 -- 172.21.15.121:0/2809637729 learned_addr learned my addr 172.21.15.121:0/2809637729 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab37fe700 1 --2- 172.21.15.121:0/2809637729 >> v2:172.21.15.122:3300/0 conn(0x7f4ab40ab4b0 0x7f4ab40c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794651468 0 0) 0x7f4ab40c15b0 con 0x7f4ab41505e0 2023-08-18T20:45:11.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a9c0035b0 con 0x7f4ab41505e0 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2461937056 0 0) 0x7f4a9c0035b0 con 0x7f4ab41505e0 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 >> v2:172.21.15.122:3300/0 conn(0x7f4ab40ab4b0 msgr2=0x7f4ab40c0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 --2- 172.21.15.121:0/2809637729 >> v2:172.21.15.122:3300/0 conn(0x7f4ab40ab4b0 0x7f4ab40c0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 >> v1:172.21.15.122:6789/0 conn(0x7f4ab406c4f0 legacy=0x7f4ab414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40c0f60 con 0x7f4ab41505e0 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f4aa4001670 con 0x7f4ab41505e0 2023-08-18T20:45:11.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 >> v1:172.21.15.121:6789/0 conn(0x7f4ab41505e0 legacy=0x7f4ab4150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 0x7f4a9c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c004850 0x7f4a9c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a9c005210 0x7f4a9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c0c80 con 0x7f4a9c003a00 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c00bf50 con 0x7f4a9c005210 2023-08-18T20:45:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.783+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c00c110 con 0x7f4a9c004850 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 0x7f4a9c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab37fe700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a9c005210 0x7f4a9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab27fc700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c004850 0x7f4a9c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 -- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c004850 msgr2=0x7f4a9c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c004850 0x7f4a9c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 -- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a9c005210 msgr2=0x7f4a9c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:11.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a9c005210 0x7f4a9c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 -- 172.21.15.121:0/2809637729 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0035b0 con 0x7f4a9c003a00 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab37fe700 1 -- 172.21.15.121:0/2809637729 reap_dead start 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 0x7f4a9c003e20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80017c0 tx=0x7f4a9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8673df2a29a191 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80052d0 con 0x7f4a9c003a00 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa8005450 con 0x7f4a9c003a00 2023-08-18T20:45:11.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.784+0000 7f4ab1ffb700 1 -- 172.21.15.121:0/2809637729 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80038c0 con 0x7f4a9c003a00 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 -- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 msgr2=0x7f4a9c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 0x7f4a9c003e20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80017c0 tx=0x7f4a9c005880 comp rx=0 tx=0).stop 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 -- 172.21.15.121:0/2809637729 shutdown_connections 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 --2- 172.21.15.121:0/2809637729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a9c003a00 0x7f4a9c003e20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 -- 172.21.15.121:0/2809637729 >> 172.21.15.121:0/2809637729 conn(0x7f4ab40a7610 msgr2=0x7f4ab40a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 -- 172.21.15.121:0/2809637729 shutdown_connections 2023-08-18T20:45:11.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.785+0000 7f4ab9968700 1 -- 172.21.15.121:0/2809637729 wait complete. 2023-08-18T20:45:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.786+0000 7f4ab9968700 1 Processor -- start 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.786+0000 7f4ab9968700 1 -- start start 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c003a00 0x7f4ab40c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 0x7f4ab414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41e5010 con 0x7f4ab40aa350 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41e52d0 con 0x7f4ab4147f40 2023-08-18T20:45:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab9968700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41e55b0 con 0x7f4a9c003a00 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42990/0 (socket says 172.21.15.121:42990) 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 -- 172.21.15.121:0/4163400678 learned_addr learned my addr 172.21.15.121:0/4163400678 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c003a00 0x7f4ab40c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab37fe700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 0x7f4ab414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 -- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c003a00 msgr2=0x7f4ab40c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c003a00 0x7f4ab40c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 -- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 msgr2=0x7f4ab414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 0x7f4ab414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 -- 172.21.15.121:0/4163400678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab41e5890 con 0x7f4ab40aa350 2023-08-18T20:45:11.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab37fe700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 0x7f4ab414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:11.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4ab27fc700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007340 tx=0x7f4aa4007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.787+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400f6c0 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.788+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400f840 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.788+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab41e5b70 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.788+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400fbf0 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.788+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab41483c0 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.788+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab414c370 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.789+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4aa400fd50 con 0x7f4ab40aa350 2023-08-18T20:45:11.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.789+0000 7f4a9bfff700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 0x7f4aa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:11.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.789+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4aa4088790 con 0x7f4ab40aa350 2023-08-18T20:45:11.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.789+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 0x7f4aa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:11.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.790+0000 7f4ab2ffd700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 0x7f4aa006c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:11.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.794+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4aa4053c70 con 0x7f4ab40aa350 2023-08-18T20:45:11.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.983+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab4074730 con 0x7f4ab40aa350 2023-08-18T20:45:11.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.983+0000 7f4a9bfff700 1 -- 172.21.15.121:0/4163400678 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v37) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4aa4057290 con 0x7f4ab40aa350 2023-08-18T20:45:11.984 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:11.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.985+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 msgr2=0x7f4aa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.985+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 0x7f4aa006c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8009030 comp rx=0 tx=0).stop 2023-08-18T20:45:11.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.985+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 msgr2=0x7f4ab4147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:11.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.985+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007340 tx=0x7f4aa4007650 comp rx=0 tx=0).stop 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 shutdown_connections 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab4147f40 0x7f4ab414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a9c003a00 0x7f4ab40c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4aa006a0e0 0x7f4aa006c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 --2- 172.21.15.121:0/4163400678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab40aa350 0x7f4ab4147a00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 >> 172.21.15.121:0/4163400678 conn(0x7f4ab40a7610 msgr2=0x7f4ab414d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:11.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 shutdown_connections 2023-08-18T20:45:11.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:11.986+0000 7f4ab9968700 1 -- 172.21.15.121:0/4163400678 wait complete. 2023-08-18T20:45:11.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:45:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.124+0000 7f717fc68700 1 Processor -- start 2023-08-18T20:45:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.124+0000 7f717fc68700 1 -- start start 2023-08-18T20:45:12.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717fc68700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71780c37c0 0x7f717815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717fc68700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717814eb70 con 0x7f717814e790 2023-08-18T20:45:12.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717fc68700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7178070790 con 0x7f7178072200 2023-08-18T20:45:12.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717fc68700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7178154830 con 0x7f71780c37c0 2023-08-18T20:45:12.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717da04700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f717814e790 0x7f717806b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49578/0 (socket says 172.21.15.121:49578) 2023-08-18T20:45:12.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717da04700 1 -- 172.21.15.121:0/3546004143 learned_addr learned my addr 172.21.15.121:0/3546004143 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:12.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717e205700 1 --2- 172.21.15.121:0/3546004143 >> v2:172.21.15.122:3300/0 conn(0x7f71780c37c0 0x7f717815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717ca02700 1 -- 172.21.15.121:0/3546004143 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263188085 0 0) 0x7f717814eb70 con 0x7f717814e790 2023-08-18T20:45:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717ca02700 1 -- 172.21.15.121:0/3546004143 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71640035b0 con 0x7f717814e790 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717e205700 1 -- 172.21.15.121:0/3546004143 >> v1:172.21.15.122:6789/0 conn(0x7f7178072200 legacy=0x7f71781525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717e205700 1 -- 172.21.15.121:0/3546004143 >> v1:172.21.15.121:6789/0 conn(0x7f717814e790 legacy=0x7f717806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.125+0000 7f717e205700 1 -- 172.21.15.121:0/3546004143 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178154b10 con 0x7f71780c37c0 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717e205700 1 --2- 172.21.15.121:0/3546004143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71780c37c0 0x7f717815ca50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7170009d90 tx=0x7f717000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c957c06b1ad7bef2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717ca02700 1 -- 172.21.15.121:0/3546004143 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000e070 con 0x7f71780c37c0 2023-08-18T20:45:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717ca02700 1 -- 172.21.15.121:0/3546004143 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000bb20 con 0x7f71780c37c0 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717ca02700 1 -- 172.21.15.121:0/3546004143 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170012430 con 0x7f71780c37c0 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717fc68700 1 -- 172.21.15.121:0/3546004143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71780c37c0 msgr2=0x7f717815ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717fc68700 1 --2- 172.21.15.121:0/3546004143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71780c37c0 0x7f717815ca50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7170009d90 tx=0x7f717000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717fc68700 1 -- 172.21.15.121:0/3546004143 shutdown_connections 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717fc68700 1 --2- 172.21.15.121:0/3546004143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71780c37c0 0x7f717815ca50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.126+0000 7f717fc68700 1 -- 172.21.15.121:0/3546004143 >> 172.21.15.121:0/3546004143 conn(0x7f71780c2ca0 msgr2=0x7f71780c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:12.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.127+0000 7f717fc68700 1 -- 172.21.15.121:0/3546004143 shutdown_connections 2023-08-18T20:45:12.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.127+0000 7f717fc68700 1 -- 172.21.15.121:0/3546004143 wait complete. 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 Processor -- start 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 -- start start 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71780c37c0 0x7f71781dc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717814e790 0x7f71780aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781dcec0 con 0x7f7178072200 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781dc410 con 0x7f717814e790 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717fc68700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71781dad00 con 0x7f71780c37c0 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717da04700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717da04700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43002/0 (socket says 172.21.15.121:43002) 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.128+0000 7f717da04700 1 -- 172.21.15.121:0/1379452973 learned_addr learned my addr 172.21.15.121:0/1379452973 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 -- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71780c37c0 msgr2=0x7f71781dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717d203700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71780c37c0 0x7f71781dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717e205700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717814e790 0x7f71780aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71780c37c0 0x7f71781dc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 -- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717814e790 msgr2=0x7f71780aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717814e790 0x7f71780aadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 -- 172.21.15.121:0/1379452973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170009a70 con 0x7f7178072200 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717da04700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7174001eb0 tx=0x7f717400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174005d70 con 0x7f7178072200 2023-08-18T20:45:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71740070d0 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71781dafe0 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174007460 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.129+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71781e9ca0 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.130+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178074730 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.130+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71740075c0 con 0x7f7178072200 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.131+0000 7f716e7fc700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 0x7f715c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.131+0000 7f717d203700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 0x7f715c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.131+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7174087e20 con 0x7f7178072200 2023-08-18T20:45:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.131+0000 7f717d203700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 0x7f715c06c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7178148e90 tx=0x7f7168009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.135+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f71740531b0 con 0x7f7178072200 2023-08-18T20:45:12.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.327+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f71780c1c90 con 0x7f7178072200 2023-08-18T20:45:12.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.328+0000 7f716e7fc700 1 -- 172.21.15.121:0/1379452973 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v37) v1 ==== 101+0+11 (secure 0 0 0) 0x7f71740567d0 con 0x7f7178072200 2023-08-18T20:45:12.329 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:12.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 msgr2=0x7f715c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 0x7f715c06c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7178148e90 tx=0x7f7168009040 comp rx=0 tx=0).stop 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 msgr2=0x7f71781da720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7174001eb0 tx=0x7f717400c860 comp rx=0 tx=0).stop 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 shutdown_connections 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717814e790 0x7f71780aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f715c06a0e0 0x7f715c06c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7178072200 0x7f71781da720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 --2- 172.21.15.121:0/1379452973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71780c37c0 0x7f71781dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 >> 172.21.15.121:0/1379452973 conn(0x7f71780c2ca0 msgr2=0x7f717806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:12.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 shutdown_connections 2023-08-18T20:45:12.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.330+0000 7f717fc68700 1 -- 172.21.15.121:0/1379452973 wait complete. 2023-08-18T20:45:12.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.462+0000 7f9c4d314700 1 Processor -- start 2023-08-18T20:45:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c4d314700 1 -- start start 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c4d314700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c480c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c4d314700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c481554d0 con 0x7f9c4814e6c0 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c4d314700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4806f920 con 0x7f9c480c8060 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c4d314700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4806e980 con 0x7f9c48155070 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c46ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9c4814e6c0 0x7f9c480a6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49592/0 (socket says 172.21.15.121:49592) 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.463+0000 7f9c46ffd700 1 -- 172.21.15.121:0/2005235717 learned_addr learned my addr 172.21.15.121:0/2005235717 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c480c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023675569 0 0) 0x7f9c481554d0 con 0x7f9c4814e6c0 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c300035b0 con 0x7f9c4814e6c0 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1052393444 0 0) 0x7f9c300035b0 con 0x7f9c4814e6c0 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 msgr2=0x7f9c480c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c480c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 >> v1:172.21.15.122:6789/0 conn(0x7f9c480c8060 legacy=0x7f9c480c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4806eb60 con 0x7f9c4814e6c0 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f9c3c001670 con 0x7f9c4814e6c0 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 >> v1:172.21.15.121:6789/0 conn(0x7f9c4814e6c0 legacy=0x7f9c480a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c30003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c30004020 0x7f9c30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004d90 0x7f9c30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4806e980 con 0x7f9c30004020 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000bc00 con 0x7f9c30004d90 2023-08-18T20:45:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000bdc0 con 0x7f9c48155070 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c30004020 0x7f9c30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c46ffd700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c30003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 -- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 msgr2=0x7f9c30003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c48155070 0x7f9c30003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 -- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004d90 msgr2=0x7f9c30005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004d90 0x7f9c30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 -- 172.21.15.121:0/2005235717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300035b0 con 0x7f9c30004020 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.464+0000 7f9c467fc700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c30004020 0x7f9c30004850 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009b60 tx=0x7f9c30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b264df27330f84 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800e6c0 con 0x7f9c30004020 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800e820 con 0x7f9c30004020 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c45ffb700 1 -- 172.21.15.121:0/2005235717 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800eb90 con 0x7f9c30004020 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 -- 172.21.15.121:0/2005235717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c30004020 msgr2=0x7f9c30004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 --2- 172.21.15.121:0/2005235717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c30004020 0x7f9c30004850 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009b60 tx=0x7f9c30005880 comp rx=0 tx=0).stop 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c477fe700 1 -- 172.21.15.121:0/2005235717 reap_dead start 2023-08-18T20:45:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 -- 172.21.15.121:0/2005235717 shutdown_connections 2023-08-18T20:45:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 -- 172.21.15.121:0/2005235717 >> 172.21.15.121:0/2005235717 conn(0x7f9c480a96a0 msgr2=0x7f9c480a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 -- 172.21.15.121:0/2005235717 shutdown_connections 2023-08-18T20:45:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.465+0000 7f9c4d314700 1 -- 172.21.15.121:0/2005235717 wait complete. 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.466+0000 7f9c4d314700 1 Processor -- start 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.466+0000 7f9c4d314700 1 -- start start 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004020 0x7f9c480a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c4814a630 0x7f9c4806be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48150ab0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480a6690 con 0x7f9c30004020 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c4d314700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c481ea940 con 0x7f9c4814a630 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43024/0 (socket says 172.21.15.121:43024) 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 -- 172.21.15.121:0/1474663357 learned_addr learned my addr 172.21.15.121:0/1474663357 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c477fe700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c4814a630 0x7f9c4806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c46ffd700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004020 0x7f9c480a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 -- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c4814a630 msgr2=0x7f9c4806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c4814a630 0x7f9c4806be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 -- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004020 msgr2=0x7f9c480a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004020 0x7f9c480a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.467+0000 7f9c467fc700 1 -- 172.21.15.121:0/1474663357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c481ea070 con 0x7f9c4806cbe0 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c467fc700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c380042f0 tx=0x7f9c380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800e6c0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380038a0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480a68c0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38003c50 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.468+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c481ea2f0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.469+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c48074730 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.469+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c38013470 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.470+0000 7f9c2f7fe700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 0x7f9c3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.470+0000 7f9c46ffd700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 0x7f9c3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.470+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9c3808a0a0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.470+0000 7f9c46ffd700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 0x7f9c3406c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9c481eb1a0 tx=0x7f9c3c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.474+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9c380555e0 con 0x7f9c4806cbe0 2023-08-18T20:45:12.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.705+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c481eaa80 con 0x7f9c4806cbe0 2023-08-18T20:45:12.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.706+0000 7f9c2f7fe700 1 -- 172.21.15.121:0/1474663357 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6063 (secure 0 0 0) 0x7f9c38058c00 con 0x7f9c4806cbe0 2023-08-18T20:45:12.707 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:12.707 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 msgr2=0x7f9c3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 0x7f9c3406c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9c481eb1a0 tx=0x7f9c3c007980 comp rx=0 tx=0).stop 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 msgr2=0x7f9c4814a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c380042f0 tx=0x7f9c380047c0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 shutdown_connections 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c4814a630 0x7f9c4806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c30004020 0x7f9c480a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9c3406a0e0 0x7f9c3406c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 --2- 172.21.15.121:0/1474663357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c4806cbe0 0x7f9c4814a0f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 >> 172.21.15.121:0/1474663357 conn(0x7f9c480a96a0 msgr2=0x7f9c48071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 shutdown_connections 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.708+0000 7f9c4d314700 1 -- 172.21.15.121:0/1474663357 wait complete. 2023-08-18T20:45:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2023-08-18T20:45:12.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:12.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.840+0000 7fbabddbb700 1 Processor -- start 2023-08-18T20:45:12.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.840+0000 7fbabddbb700 1 -- start start 2023-08-18T20:45:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab806b520 0x7fbab8072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbab8152d30 0x7fbab814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 0x7fbab8155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab8066380 con 0x7fbab8152d30 2023-08-18T20:45:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab81531b0 con 0x7fbab814fa00 2023-08-18T20:45:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbabddbb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8066080 con 0x7fbab806b520 2023-08-18T20:45:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbab8152d30 0x7fbab814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbab8152d30 0x7fbab814f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43032/0 (socket says 172.21.15.121:43032) 2023-08-18T20:45:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 -- 172.21.15.121:0/231530306 learned_addr learned my addr 172.21.15.121:0/231530306 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab77fe700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab806b520 0x7fbab8072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab7fff700 1 --2- 172.21.15.121:0/231530306 >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 0x7fbab8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 -- 172.21.15.121:0/231530306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab806b520 msgr2=0x7fbab8072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab806b520 0x7fbab8072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 -- 172.21.15.121:0/231530306 >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 msgr2=0x7fbab8155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 --2- 172.21.15.121:0/231530306 >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 0x7fbab8155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 -- 172.21.15.121:0/231530306 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab806d0f0 con 0x7fbab8152d30 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab7fff700 1 --2- 172.21.15.121:0/231530306 >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 0x7fbab8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab6ffd700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab814f4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbab80c2c70 tx=0x7fbaac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce1d2f6c83c7436 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab67fc700 1 -- 172.21.15.121:0/231530306 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac005e30 con 0x7fbab8152d30 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab67fc700 1 -- 172.21.15.121:0/231530306 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac004030 con 0x7fbab8152d30 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.841+0000 7fbab67fc700 1 -- 172.21.15.121:0/231530306 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0043e0 con 0x7fbab8152d30 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 -- 172.21.15.121:0/231530306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 msgr2=0x7fbab814f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab814f4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbab80c2c70 tx=0x7fbaac009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 -- 172.21.15.121:0/231530306 shutdown_connections 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 --2- 172.21.15.121:0/231530306 >> v2:172.21.15.122:3300/0 conn(0x7fbab814fa00 0x7fbab8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab806b520 0x7fbab8072360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 --2- 172.21.15.121:0/231530306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab814f4c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 -- 172.21.15.121:0/231530306 >> 172.21.15.121:0/231530306 conn(0x7fbab80c2ca0 msgr2=0x7fbab80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 -- 172.21.15.121:0/231530306 shutdown_connections 2023-08-18T20:45:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.842+0000 7fbabddbb700 1 -- 172.21.15.121:0/231530306 wait complete. 2023-08-18T20:45:12.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.843+0000 7fbabddbb700 1 Processor -- start 2023-08-18T20:45:12.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.843+0000 7fbabddbb700 1 -- start start 2023-08-18T20:45:12.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbab806b520 0x7fbab8155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 0x7fbab8153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab814a510 con 0x7fbab8152d30 2023-08-18T20:45:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab814a7f0 con 0x7fbab806b520 2023-08-18T20:45:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab814aad0 con 0x7fbab814fa00 2023-08-18T20:45:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43040/0 (socket says 172.21.15.121:43040) 2023-08-18T20:45:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 -- 172.21.15.121:0/3570399308 learned_addr learned my addr 172.21.15.121:0/3570399308 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab6ffd700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 0x7fbab8153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab77fe700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbab806b520 0x7fbab8155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 -- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 msgr2=0x7fbab8153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 0x7fbab8153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 -- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbab806b520 msgr2=0x7fbab8155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbab806b520 0x7fbab8155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 -- 172.21.15.121:0/3570399308 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009500 con 0x7fbab8152d30 2023-08-18T20:45:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab6ffd700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 0x7fbab8153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbab7fff700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009fa0 tx=0x7fbab000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0003a70 con 0x7fbab8152d30 2023-08-18T20:45:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab000f040 con 0x7fbab8152d30 2023-08-18T20:45:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.844+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab814adb0 con 0x7fbab8152d30 2023-08-18T20:45:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.845+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0003e30 con 0x7fbab8152d30 2023-08-18T20:45:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.845+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab81564e0 con 0x7fbab8152d30 2023-08-18T20:45:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.845+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab804e620 con 0x7fbab8152d30 2023-08-18T20:45:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.846+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbab0004030 con 0x7fbab8152d30 2023-08-18T20:45:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.846+0000 7fba9ffff700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 0x7fbaa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.846+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fbab0088980 con 0x7fbab8152d30 2023-08-18T20:45:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.846+0000 7fbab77fe700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 0x7fbaa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.847+0000 7fbab77fe700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 0x7fbaa406c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009ad0 tx=0x7fbaa8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:12.851+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbab0053da0 con 0x7fbab8152d30 2023-08-18T20:45:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.046+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbab8074730 con 0x7fbab8152d30 2023-08-18T20:45:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.048+0000 7fba9ffff700 1 -- 172.21.15.121:0/3570399308 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7fbab00573c0 con 0x7fbab8152d30 2023-08-18T20:45:13.048 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:13.049 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 msgr2=0x7fbaa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 0x7fbaa406c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009ad0 tx=0x7fbaa8008040 comp rx=0 tx=0).stop 2023-08-18T20:45:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 msgr2=0x7fbab8146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009fa0 tx=0x7fbab000d460 comp rx=0 tx=0).stop 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 shutdown_connections 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa406a0e0 0x7fbaa406c5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8152d30 0x7fbab8146b10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbab806b520 0x7fbab8155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 --2- 172.21.15.121:0/3570399308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbab814fa00 0x7fbab8153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 >> 172.21.15.121:0/3570399308 conn(0x7fbab80c2ca0 msgr2=0x7fbab81491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 shutdown_connections 2023-08-18T20:45:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.050+0000 7fbabddbb700 1 -- 172.21.15.121:0/3570399308 wait complete. 2023-08-18T20:45:13.063 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-18T20:45:13.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:13.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.182+0000 7f9b9b418700 1 Processor -- start 2023-08-18T20:45:13.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.182+0000 7f9b9b418700 1 -- start start 2023-08-18T20:45:13.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9b940c6120 0x7f9b940bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b940bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9b940c2c80 0x7f9b940c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9414ed20 con 0x7f9b940c2c80 2023-08-18T20:45:13.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b94151be0 con 0x7f9b940c6120 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b9b418700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940c20d0 con 0x7f9b940c6560 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9b940c2c80 0x7f9b940c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9b940c2c80 0x7f9b940c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43046/0 (socket says 172.21.15.121:43046) 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 -- 172.21.15.121:0/3120594136 learned_addr learned my addr 172.21.15.121:0/3120594136 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b989b3700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b940bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b991b4700 1 --2- 172.21.15.121:0/3120594136 >> v2:172.21.15.122:3300/0 conn(0x7f9b940c6120 0x7f9b940bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 -- 172.21.15.121:0/3120594136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 msgr2=0x7f9b940bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:13.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b940bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 -- 172.21.15.121:0/3120594136 >> v2:172.21.15.122:3300/0 conn(0x7f9b940c6120 msgr2=0x7f9b940bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 --2- 172.21.15.121:0/3120594136 >> v2:172.21.15.122:3300/0 conn(0x7f9b940c6120 0x7f9b940bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.183+0000 7f9b999b5700 1 -- 172.21.15.121:0/3120594136 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940c23b0 con 0x7f9b940c2c80 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b999b5700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c2c80 0x7f9b940c4a20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9b94066ea0 tx=0x7f9b8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0f0488f7aa2974 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b8bfff700 1 -- 172.21.15.121:0/3120594136 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00e070 con 0x7f9b940c2c80 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b8bfff700 1 -- 172.21.15.121:0/3120594136 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00b9c0 con 0x7f9b940c2c80 2023-08-18T20:45:13.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b8bfff700 1 -- 172.21.15.121:0/3120594136 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00bd70 con 0x7f9b940c2c80 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 -- 172.21.15.121:0/3120594136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c2c80 msgr2=0x7f9b940c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c2c80 0x7f9b940c4a20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9b94066ea0 tx=0x7f9b8c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 -- 172.21.15.121:0/3120594136 shutdown_connections 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 --2- 172.21.15.121:0/3120594136 >> v2:172.21.15.122:3300/0 conn(0x7f9b940c6120 0x7f9b940bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c2c80 0x7f9b940c4a20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 --2- 172.21.15.121:0/3120594136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b940bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.184+0000 7f9b9b418700 1 -- 172.21.15.121:0/3120594136 >> 172.21.15.121:0/3120594136 conn(0x7f9b940c35a0 msgr2=0x7f9b940c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.185+0000 7f9b9b418700 1 -- 172.21.15.121:0/3120594136 shutdown_connections 2023-08-18T20:45:13.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.185+0000 7f9b9b418700 1 -- 172.21.15.121:0/3120594136 wait complete. 2023-08-18T20:45:13.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 Processor -- start 2023-08-18T20:45:13.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 -- start start 2023-08-18T20:45:13.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b940c2c80 0x7f9b940ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b94149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940be120 con 0x7f9b940c6120 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940bf650 con 0x7f9b940c2c80 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.186+0000 7f9b9b418700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940bdb60 con 0x7f9b940c6560 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43050/0 (socket says 172.21.15.121:43050) 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 -- 172.21.15.121:0/2841192546 learned_addr learned my addr 172.21.15.121:0/2841192546 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:13.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b991b4700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b940c2c80 0x7f9b940ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b999b5700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b94149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 -- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 msgr2=0x7f9b94149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b94149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 -- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b940c2c80 msgr2=0x7f9b940ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b940c2c80 0x7f9b940ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 -- 172.21.15.121:0/2841192546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009b30 con 0x7f9b940c6120 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b999b5700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b94149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:13.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b989b3700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000e7e0 tx=0x7f9b9000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90013610 con 0x7f9b940c6120 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90013770 con 0x7f9b940c6120 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b940bde40 con 0x7f9b940c6120 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90013ae0 con 0x7f9b940c6120 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.187+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b940bfb60 con 0x7f9b940c6120 2023-08-18T20:45:13.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.188+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9404e620 con 0x7f9b940c6120 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.189+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b90013c40 con 0x7f9b940c6120 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.189+0000 7f9b89ffb700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 0x7f9b7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.190+0000 7f9b991b4700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 0x7f9b7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.190+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9b900580c0 con 0x7f9b940c6120 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.190+0000 7f9b991b4700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 0x7f9b7806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b941e7cc0 tx=0x7f9b84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.195+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9b90057800 con 0x7f9b940c6120 2023-08-18T20:45:13.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.427+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b94074730 con 0x7f9b940c6120 2023-08-18T20:45:13.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.428+0000 7f9b89ffb700 1 -- 172.21.15.121:0/2841192546 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6063 (secure 0 0 0) 0x7f9b90021090 con 0x7f9b940c6120 2023-08-18T20:45:13.429 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:13.429 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 msgr2=0x7f9b7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 0x7f9b7806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b941e7cc0 tx=0x7f9b84008040 comp rx=0 tx=0).stop 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 msgr2=0x7f9b941e9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000e7e0 tx=0x7f9b9000eaf0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 shutdown_connections 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9b940c6560 0x7f9b94149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b940c2c80 0x7f9b940ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9b7806a0e0 0x7f9b7806c5a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 --2- 172.21.15.121:0/2841192546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b940c6120 0x7f9b941e9e10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 >> 172.21.15.121:0/2841192546 conn(0x7f9b940c35a0 msgr2=0x7f9b940723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 shutdown_connections 2023-08-18T20:45:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.430+0000 7f9b9b418700 1 -- 172.21.15.121:0/2841192546 wait complete. 2023-08-18T20:45:13.433 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2023-08-18T20:45:13.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:13.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 Processor -- start 2023-08-18T20:45:13.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 -- start start 2023-08-18T20:45:13.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89d00c6e60 0x7f89d00c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d00c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f89d00c6600 0x7f89d0157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d006eac0 con 0x7f89d00c6e60 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d00c5d40 con 0x7f89d00c6600 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89d61b0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00a5dc0 con 0x7f89d006da20 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.563+0000 7f89cf7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89d00c6e60 0x7f89d00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89d00c6e60 0x7f89d00c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43056/0 (socket says 172.21.15.121:43056) 2023-08-18T20:45:13.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 -- 172.21.15.121:0/1994475575 learned_addr learned my addr 172.21.15.121:0/1994475575 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cffff700 1 --2- 172.21.15.121:0/1994475575 >> v2:172.21.15.122:3300/0 conn(0x7f89d00c6600 0x7f89d0157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89ceffd700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d00c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 -- 172.21.15.121:0/1994475575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 msgr2=0x7f89d00c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d00c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 -- 172.21.15.121:0/1994475575 >> v2:172.21.15.122:3300/0 conn(0x7f89d00c6600 msgr2=0x7f89d0157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/1994475575 >> v2:172.21.15.122:3300/0 conn(0x7f89d00c6600 0x7f89d0157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 -- 172.21.15.121:0/1994475575 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d006e7e0 con 0x7f89d00c6e60 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d00c4d80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f89d00a8800 tx=0x7f89c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c70fe410ac72dcd server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89ce7fc700 1 -- 172.21.15.121:0/1994475575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000b870 con 0x7f89d00c6e60 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89ce7fc700 1 -- 172.21.15.121:0/1994475575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000b9d0 con 0x7f89d00c6e60 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.564+0000 7f89ce7fc700 1 -- 172.21.15.121:0/1994475575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000bd60 con 0x7f89d00c6e60 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 -- 172.21.15.121:0/1994475575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 msgr2=0x7f89d00c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d00c4d80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f89d00a8800 tx=0x7f89c0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 -- 172.21.15.121:0/1994475575 shutdown_connections 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 --2- 172.21.15.121:0/1994475575 >> v2:172.21.15.122:3300/0 conn(0x7f89d00c6600 0x7f89d0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d00c4d80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 --2- 172.21.15.121:0/1994475575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d00c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 -- 172.21.15.121:0/1994475575 >> 172.21.15.121:0/1994475575 conn(0x7f89d006b590 msgr2=0x7f89d006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 -- 172.21.15.121:0/1994475575 shutdown_connections 2023-08-18T20:45:13.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.565+0000 7f89d61b0700 1 -- 172.21.15.121:0/1994475575 wait complete. 2023-08-18T20:45:13.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.566+0000 7f89d61b0700 1 Processor -- start 2023-08-18T20:45:13.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.566+0000 7f89d61b0700 1 -- start start 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d01525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 0x7f89d00a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00a86c0 con 0x7f89d00c6e60 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01e9720 con 0x7f89d00c6600 2023-08-18T20:45:13.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0152ec0 con 0x7f89d006da20 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43066/0 (socket says 172.21.15.121:43066) 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 -- 172.21.15.121:0/2461747724 learned_addr learned my addr 172.21.15.121:0/2461747724 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d01525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89ceffd700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 0x7f89d00a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 -- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 msgr2=0x7f89d01525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d01525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 -- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 msgr2=0x7f89d00a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 0x7f89d00a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 -- 172.21.15.121:0/2461747724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0009550 con 0x7f89d00c6e60 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89ceffd700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 0x7f89d00a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89cffff700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f89c8007e40 tx=0x7f89c800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800ede0 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8014420 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d01e99e0 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.567+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80147d0 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.568+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d00a6d10 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.568+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0074730 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.569+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89c8014930 con 0x7f89d00c6e60 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.569+0000 7f89b7fff700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.569+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f89c8088fa0 con 0x7f89d00c6e60 2023-08-18T20:45:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.569+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.570+0000 7f89cf7fe700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89c0014040 tx=0x7f89c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.573+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f89c80bb940 con 0x7f89d00c6e60 2023-08-18T20:45:13.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.804+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89d014ec90 con 0x7f89d00c6e60 2023-08-18T20:45:13.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.804+0000 7f89b7fff700 1 -- 172.21.15.121:0/2461747724 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6063 (secure 0 0 0) 0x7f89c8057e50 con 0x7f89d00c6e60 2023-08-18T20:45:13.805 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:13.805 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:33.412388+0000","modified":"2023-08-18T20:44:37.025083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/1099144439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1099144439},{"type":"v1","addr":"172.21.15.121:6837","nonce":1099144439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 msgr2=0x7f89bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89c0014040 tx=0x7f89c0008030 comp rx=0 tx=0).stop 2023-08-18T20:45:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 msgr2=0x7f89d0148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f89c8007e40 tx=0x7f89c800e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 shutdown_connections 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f89bc06a0e0 0x7f89bc06c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d00c6e60 0x7f89d0148180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d006da20 0x7f89d01525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 --2- 172.21.15.121:0/2461747724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c6600 0x7f89d00a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 >> 172.21.15.121:0/2461747724 conn(0x7f89d006b590 msgr2=0x7f89d006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 shutdown_connections 2023-08-18T20:45:13.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.806+0000 7f89d61b0700 1 -- 172.21.15.121:0/2461747724 wait complete. 2023-08-18T20:45:13.809 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2023-08-18T20:45:13.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.938+0000 7f9699df9700 1 Processor -- start 2023-08-18T20:45:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.938+0000 7f9699df9700 1 -- start start 2023-08-18T20:45:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9699df9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f96940c0c50 0x7f969406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9699df9700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f96940c5ae0 0x7f9694071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9699df9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96940c4f40 con 0x7f969406a7e0 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9699df9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96940c6120 con 0x7f96940c0c50 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9699df9700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96941551f0 con 0x7f96940c5ae0 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f96937fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f96940c0c50 0x7f969406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9692ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f969406a7e0 0x7f96940c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49652/0 (socket says 172.21.15.121:49652) 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.939+0000 7f9692ffd700 1 -- 172.21.15.121:0/1850094417 learned_addr learned my addr 172.21.15.121:0/1850094417 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9693fff700 1 --2- 172.21.15.121:0/1850094417 >> v2:172.21.15.122:3300/0 conn(0x7f96940c5ae0 0x7f9694071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96937fe700 1 -- 172.21.15.121:0/1850094417 >> v2:172.21.15.122:3300/0 conn(0x7f96940c5ae0 msgr2=0x7f9694071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96937fe700 1 --2- 172.21.15.121:0/1850094417 >> v2:172.21.15.122:3300/0 conn(0x7f96940c5ae0 0x7f9694071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96937fe700 1 -- 172.21.15.121:0/1850094417 >> v1:172.21.15.121:6789/0 conn(0x7f969406a7e0 legacy=0x7f96940c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96927fc700 1 -- 172.21.15.121:0/1850094417 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144108945 0 0) 0x7f96940c4f40 con 0x7f969406a7e0 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96937fe700 1 -- 172.21.15.121:0/1850094417 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940c63a0 con 0x7f96940c0c50 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96937fe700 1 --2- 172.21.15.121:0/1850094417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f969406a2a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f969406ec20 tx=0x7f967c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cab504af3d5256 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96927fc700 1 -- 172.21.15.121:0/1850094417 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c011830 con 0x7f96940c0c50 2023-08-18T20:45:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96927fc700 1 -- 172.21.15.121:0/1850094417 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c011990 con 0x7f96940c0c50 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f96927fc700 1 -- 172.21.15.121:0/1850094417 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c011d20 con 0x7f96940c0c50 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 -- 172.21.15.121:0/1850094417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 msgr2=0x7f969406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 --2- 172.21.15.121:0/1850094417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f969406a2a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f969406ec20 tx=0x7f967c009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 -- 172.21.15.121:0/1850094417 shutdown_connections 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 --2- 172.21.15.121:0/1850094417 >> v2:172.21.15.122:3300/0 conn(0x7f96940c5ae0 0x7f9694071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 --2- 172.21.15.121:0/1850094417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f969406a2a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.940+0000 7f9699df9700 1 -- 172.21.15.121:0/1850094417 >> 172.21.15.121:0/1850094417 conn(0x7f96940c6b10 msgr2=0x7f96940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:13.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.941+0000 7f9699df9700 1 -- 172.21.15.121:0/1850094417 shutdown_connections 2023-08-18T20:45:13.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.941+0000 7f9699df9700 1 -- 172.21.15.121:0/1850094417 wait complete. 2023-08-18T20:45:13.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 Processor -- start 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 -- start start 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 0x7f969414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96940c5ae0 0x7f9694153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940acac0 con 0x7f96940c0c50 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969414b840 con 0x7f96940c5ae0 2023-08-18T20:45:13.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.942+0000 7f9699df9700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9694156010 con 0x7f969406a7e0 2023-08-18T20:45:13.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43078/0 (socket says 172.21.15.121:43078) 2023-08-18T20:45:13.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 -- 172.21.15.121:0/3156892551 learned_addr learned my addr 172.21.15.121:0/3156892551 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:13.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9693fff700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96940c5ae0 0x7f9694153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f96937fe700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 0x7f969414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 -- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 msgr2=0x7f969414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 0x7f969414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 -- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96940c5ae0 msgr2=0x7f9694153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96940c5ae0 0x7f9694153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 -- 172.21.15.121:0/3156892551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0094a0 con 0x7f96940c0c50 2023-08-18T20:45:13.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f96937fe700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 0x7f969414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:13.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9692ffd700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f968400c550 tx=0x7f968400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684004c80 con 0x7f96940c0c50 2023-08-18T20:45:13.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941562f0 con 0x7f96940c0c50 2023-08-18T20:45:13.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96940ac2c0 con 0x7f96940c0c50 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684004de0 con 0x7f96940c0c50 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.943+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840072d0 con 0x7f96940c0c50 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.944+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694074730 con 0x7f96940c0c50 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.945+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9684007430 con 0x7f96940c0c50 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.945+0000 7f968bfff700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 0x7f967406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:13.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.945+0000 7f96937fe700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 0x7f967406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:13.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.945+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f96840883d0 con 0x7f96940c0c50 2023-08-18T20:45:13.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.945+0000 7f96937fe700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 0x7f967406c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9694155970 tx=0x7f967c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:13.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:13.949+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9684053770 con 0x7f96940c0c50 2023-08-18T20:45:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.145+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96940abf00 con 0x7f96940c0c50 2023-08-18T20:45:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.146+0000 7f968bfff700 1 -- 172.21.15.121:0/3156892551 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+22057 (secure 0 0 0) 0x7f9684056d90 con 0x7f96940c0c50 2023-08-18T20:45:14.148 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:14.148 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:44:49.067723+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:44:31.655910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-18T20:44:32.362264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:14.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.148+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 msgr2=0x7f967406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.148+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 0x7f967406c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9694155970 tx=0x7f967c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.148+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 msgr2=0x7f9694153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.148+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f968400c550 tx=0x7f968400c910 comp rx=0 tx=0).stop 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 shutdown_connections 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96940c5ae0 0x7f9694153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f969406a7e0 0x7f969414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f967406a0e0 0x7f967406c5a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 --2- 172.21.15.121:0/3156892551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96940c0c50 0x7f9694153350 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 >> 172.21.15.121:0/3156892551 conn(0x7f96940c6b10 msgr2=0x7f96940c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:14.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 shutdown_connections 2023-08-18T20:45:14.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.149+0000 7f9699df9700 1 -- 172.21.15.121:0/3156892551 wait complete. 2023-08-18T20:45:14.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-18T20:45:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.282+0000 7f1038388700 1 Processor -- start 2023-08-18T20:45:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.282+0000 7f1038388700 1 -- start start 2023-08-18T20:45:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1038388700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 0x7f10300c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1038388700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 0x7f10300c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1038388700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10301529a0 con 0x7f10301559c0 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1038388700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030152c80 con 0x7f103006fd30 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1038388700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1030152f60 con 0x7f1030152450 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1036925700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f10301559c0 0x7f103014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49670/0 (socket says 172.21.15.121:49670) 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.283+0000 7f1036925700 1 -- 172.21.15.121:0/2233169434 learned_addr learned my addr 172.21.15.121:0/2233169434 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 --2- 172.21.15.121:0/2233169434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 0x7f10300c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1036124700 1 --2- 172.21.15.121:0/2233169434 >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 0x7f10300c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035122700 1 -- 172.21.15.121:0/2233169434 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828933903 0 0) 0x7f10301529a0 con 0x7f10301559c0 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035122700 1 -- 172.21.15.121:0/2233169434 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f101c0035b0 con 0x7f10301559c0 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 -- 172.21.15.121:0/2233169434 >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 msgr2=0x7f10300c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 --2- 172.21.15.121:0/2233169434 >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 0x7f10300c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 -- 172.21.15.121:0/2233169434 >> v1:172.21.15.121:6789/0 conn(0x7f10301559c0 legacy=0x7f103014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 -- 172.21.15.121:0/2233169434 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030153240 con 0x7f1030152450 2023-08-18T20:45:14.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1036124700 1 --2- 172.21.15.121:0/2233169434 >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 0x7f10300c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035923700 1 --2- 172.21.15.121:0/2233169434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 0x7f10300c7270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f102c009840 tx=0x7f102c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9deaad23bc71e5ef server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035122700 1 -- 172.21.15.121:0/2233169434 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c011830 con 0x7f1030152450 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035122700 1 -- 172.21.15.121:0/2233169434 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c011990 con 0x7f1030152450 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.284+0000 7f1035122700 1 -- 172.21.15.121:0/2233169434 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c011d00 con 0x7f1030152450 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 -- 172.21.15.121:0/2233169434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 msgr2=0x7f10300c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 --2- 172.21.15.121:0/2233169434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 0x7f10300c7270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f102c009840 tx=0x7f102c009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:14.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 -- 172.21.15.121:0/2233169434 shutdown_connections 2023-08-18T20:45:14.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 --2- 172.21.15.121:0/2233169434 >> v2:172.21.15.122:3300/0 conn(0x7f103006fd30 0x7f10300c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 --2- 172.21.15.121:0/2233169434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1030152450 0x7f10300c7270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 -- 172.21.15.121:0/2233169434 >> 172.21.15.121:0/2233169434 conn(0x7f10300c7bf0 msgr2=0x7f10300c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:14.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 -- 172.21.15.121:0/2233169434 shutdown_connections 2023-08-18T20:45:14.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.285+0000 7f1038388700 1 -- 172.21.15.121:0/2233169434 wait complete. 2023-08-18T20:45:14.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.286+0000 7f1038388700 1 Processor -- start 2023-08-18T20:45:14.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.286+0000 7f1038388700 1 -- start start 2023-08-18T20:45:14.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 0x7f10300c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10301559c0 0x7f10300c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10300bfde0 con 0x7f103006fd30 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10300c0680 con 0x7f1030152450 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1038388700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300ab990 con 0x7f10301559c0 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43090/0 (socket says 172.21.15.121:43090) 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 -- 172.21.15.121:0/3492680568 learned_addr learned my addr 172.21.15.121:0/3492680568 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1035923700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 0x7f10300c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036925700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10301559c0 0x7f10300c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 -- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10301559c0 msgr2=0x7f10300c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10301559c0 0x7f10300c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 -- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 msgr2=0x7f10300c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 0x7f10300c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 -- 172.21.15.121:0/3492680568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240094a0 con 0x7f103006fd30 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1035923700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 0x7f10300c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1036124700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f102400ec10 tx=0x7f1024009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.287+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400c940 con 0x7f103006fd30 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.288+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400caa0 con 0x7f103006fd30 2023-08-18T20:45:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.288+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c0094a0 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.288+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400ce10 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.288+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10300c0310 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.288+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1030074730 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.289+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1024013470 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.289+0000 7f1022ffd700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 0x7f101406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.289+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1024088ae0 con 0x7f103006fd30 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.289+0000 7f1035923700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 0x7f101406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.290+0000 7f1035923700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 0x7f101406c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f102c000c00 tx=0x7f102c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.294+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1024053df0 con 0x7f103006fd30 2023-08-18T20:45:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.527+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10300c0960 con 0x7f103006fd30 2023-08-18T20:45:14.528 INFO:tasks.ceph.mon.a.smithi121.stderr:2023-08-18T20:45:14.528+0000 7f5248ffa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-18T20:45:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.532+0000 7f1022ffd700 1 -- 172.21.15.121:0/3492680568 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1024057410 con 0x7f103006fd30 2023-08-18T20:45:14.535 INFO:tasks.ceph.mds.c.smithi121.stderr: -4178> 2023-08-18T20:44:37.987+0000 7f43faa31700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:45:14.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 msgr2=0x7f101406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 0x7f101406c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f102c000c00 tx=0x7f102c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 msgr2=0x7f1030150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f102400ec10 tx=0x7f1024009ec0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 shutdown_connections 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10301559c0 0x7f10300c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f101406a0e0 0x7f101406c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103006fd30 0x7f1030150e00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 --2- 172.21.15.121:0/3492680568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1030152450 0x7f10300c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 >> 172.21.15.121:0/3492680568 conn(0x7f10300c7bf0 msgr2=0x7f103014fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 shutdown_connections 2023-08-18T20:45:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.537+0000 7f1038388700 1 -- 172.21.15.121:0/3492680568 wait complete. 2023-08-18T20:45:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-18T20:45:14.550 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-18T20:45:14.564 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2023-08-18T20:45:14.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.672+0000 7ff200160700 1 Processor -- start 2023-08-18T20:45:14.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.672+0000 7ff200160700 1 -- start start 2023-08-18T20:45:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff200160700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 0x7ff1f80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff200160700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 0x7ff1f80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff200160700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80c2260 con 0x7ff1f814ed30 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff200160700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f80a6630 con 0x7ff1f8070950 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff200160700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8151d90 con 0x7ff1f814e950 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fd6fb700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff1f814ed30 0x7ff1f80c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49692/0 (socket says 172.21.15.121:49692) 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fd6fb700 1 -- 172.21.15.121:0/3204597716 learned_addr learned my addr 172.21.15.121:0/3204597716 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fe6fd700 1 --2- 172.21.15.121:0/3204597716 >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 0x7ff1f80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3204597716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 0x7ff1f80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fcefa700 1 -- 172.21.15.121:0/3204597716 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859308032 0 0) 0x7ff1f80c2260 con 0x7ff1f814ed30 2023-08-18T20:45:14.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fcefa700 1 -- 172.21.15.121:0/3204597716 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e40035b0 con 0x7ff1f814ed30 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fdefc700 1 -- 172.21.15.121:0/3204597716 >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 msgr2=0x7ff1f80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3204597716 >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 0x7ff1f80c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fdefc700 1 -- 172.21.15.121:0/3204597716 >> v1:172.21.15.121:6789/0 conn(0x7ff1f814ed30 legacy=0x7ff1f80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fdefc700 1 -- 172.21.15.121:0/3204597716 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8152070 con 0x7ff1f814e950 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.673+0000 7ff1fe6fd700 1 --2- 172.21.15.121:0/3204597716 >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 0x7ff1f80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:14.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3204597716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 0x7ff1f80c2ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009840 tx=0x7ff1e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d1757831ab1604 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff1fcefa700 1 -- 172.21.15.121:0/3204597716 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8011830 con 0x7ff1f814e950 2023-08-18T20:45:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff1fcefa700 1 -- 172.21.15.121:0/3204597716 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e8011990 con 0x7ff1f814e950 2023-08-18T20:45:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff1fcefa700 1 -- 172.21.15.121:0/3204597716 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8011d20 con 0x7ff1f814e950 2023-08-18T20:45:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 -- 172.21.15.121:0/3204597716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 msgr2=0x7ff1f80c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 --2- 172.21.15.121:0/3204597716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 0x7ff1f80c2ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009840 tx=0x7ff1e8009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 -- 172.21.15.121:0/3204597716 shutdown_connections 2023-08-18T20:45:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 --2- 172.21.15.121:0/3204597716 >> v2:172.21.15.122:3300/0 conn(0x7ff1f8070950 0x7ff1f80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 --2- 172.21.15.121:0/3204597716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f814e950 0x7ff1f80c2ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 -- 172.21.15.121:0/3204597716 >> 172.21.15.121:0/3204597716 conn(0x7ff1f80c6b10 msgr2=0x7ff1f80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.674+0000 7ff200160700 1 -- 172.21.15.121:0/3204597716 shutdown_connections 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.675+0000 7ff200160700 1 -- 172.21.15.121:0/3204597716 wait complete. 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 Processor -- start 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 -- start start 2023-08-18T20:45:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f8070950 0x7ff1f81e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f814e950 0x7ff1f814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f814f3c0 con 0x7ff1f814ed30 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f806e030 con 0x7ff1f814e950 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff200160700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f806e310 con 0x7ff1f8070950 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff1fe6fd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff1fe6fd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43120/0 (socket says 172.21.15.121:43120) 2023-08-18T20:45:14.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.676+0000 7ff1fe6fd700 1 -- 172.21.15.121:0/3037423059 learned_addr learned my addr 172.21.15.121:0/3037423059 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f8070950 0x7ff1f81e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fd6fb700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f814e950 0x7ff1f814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 -- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f8070950 msgr2=0x7ff1f81e95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f8070950 0x7ff1f81e95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 -- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f814e950 msgr2=0x7ff1f814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f814e950 0x7ff1f814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 -- 172.21.15.121:0/3037423059 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0009a70 con 0x7ff1f814ed30 2023-08-18T20:45:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1fe6fd700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000efc0 tx=0x7ff1f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0009cd0 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f000f040 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80094a0 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cd60 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.677+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f806e8d0 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.678+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8074730 con 0x7ff1f814ed30 2023-08-18T20:45:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.678+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff1f0014480 con 0x7ff1f814ed30 2023-08-18T20:45:14.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.679+0000 7ff1ee7fc700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 0x7ff1dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:14.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.679+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7004+0+0 (secure 0 0 0) 0x7ff1f0088f80 con 0x7ff1f814ed30 2023-08-18T20:45:14.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.679+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 0x7ff1dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:14.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.679+0000 7ff1fdefc700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 0x7ff1dc06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000c00 tx=0x7ff1e8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:14.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.683+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff1f00bb940 con 0x7ff1f814ed30 2023-08-18T20:45:14.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:14.916+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1f80c0ac0 con 0x7ff1f814ed30 2023-08-18T20:45:15.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.532+0000 7ff1ee7fc700 1 -- 172.21.15.121:0/3037423059 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1f0057de0 con 0x7ff1f814ed30 2023-08-18T20:45:15.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 msgr2=0x7ff1dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 0x7ff1dc06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000c00 tx=0x7ff1e8008030 comp rx=0 tx=0).stop 2023-08-18T20:45:15.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 msgr2=0x7ff1f80ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000efc0 tx=0x7ff1f000c3a0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 shutdown_connections 2023-08-18T20:45:15.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff1dc06a0e0 0x7ff1dc06c5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1f814ed30 0x7ff1f80ac450 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f8070950 0x7ff1f81e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 --2- 172.21.15.121:0/3037423059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f814e950 0x7ff1f814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 >> 172.21.15.121:0/3037423059 conn(0x7ff1f80c6b10 msgr2=0x7ff1f80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 shutdown_connections 2023-08-18T20:45:15.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.536+0000 7ff200160700 1 -- 172.21.15.121:0/3037423059 wait complete. 2023-08-18T20:45:15.551 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-18T20:45:15.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.720+0000 7f101aeb0700 1 Processor -- start 2023-08-18T20:45:15.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.720+0000 7f101aeb0700 1 -- start start 2023-08-18T20:45:15.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101aeb0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f10140c0230 0x7f1014154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101aeb0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f101406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101aeb0700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140c6700 con 0x7f101414b0c0 2023-08-18T20:45:15.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101aeb0700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10141554d0 con 0x7f10140c0230 2023-08-18T20:45:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101aeb0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a64b0 con 0x7f101406d540 2023-08-18T20:45:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f1018c4c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f101414b0c0 0x7f101406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49708/0 (socket says 172.21.15.121:49708) 2023-08-18T20:45:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f1018c4c700 1 -- 172.21.15.121:0/1014328391 learned_addr learned my addr 172.21.15.121:0/1014328391 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f1013fff700 1 --2- 172.21.15.121:0/1014328391 >> v2:172.21.15.122:3300/0 conn(0x7f10140c0230 0x7f1014154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f101944d700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f101406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.721+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029285983 0 0) 0x7f10140c6700 con 0x7f101414b0c0 2023-08-18T20:45:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10040035b0 con 0x7f101414b0c0 2023-08-18T20:45:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3211783100 0 0) 0x7f10040035b0 con 0x7f101414b0c0 2023-08-18T20:45:15.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 msgr2=0x7f101406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:15.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f101406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 >> v2:172.21.15.122:3300/0 conn(0x7f10140c0230 msgr2=0x7f1014154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:15.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 --2- 172.21.15.121:0/1014328391 >> v2:172.21.15.122:3300/0 conn(0x7f10140c0230 0x7f1014154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140a5ef0 con 0x7f101414b0c0 2023-08-18T20:45:15.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1008001670 con 0x7f101414b0c0 2023-08-18T20:45:15.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 >> v1:172.21.15.121:6789/0 conn(0x7f101414b0c0 legacy=0x7f101406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f1004003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1004003ff0 0x7f1004004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1004004d90 0x7f1004005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a64b0 con 0x7f1004003ff0 2023-08-18T20:45:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100400ba10 con 0x7f1004004d90 2023-08-18T20:45:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100400bb80 con 0x7f101406d540 2023-08-18T20:45:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1004003ff0 0x7f1004004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1018c4c700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f1004003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f101944d700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1004004d90 0x7f1004005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 -- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 msgr2=0x7f1004003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f1004003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 -- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1004004d90 msgr2=0x7f1004005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1004004d90 0x7f1004005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 -- 172.21.15.121:0/1014328391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040035b0 con 0x7f1004003ff0 2023-08-18T20:45:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1018c4c700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f101406d540 0x7f1004003a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f1013fff700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1004003ff0 0x7f1004004850 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1000009b30 tx=0x7f1004005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4776aba46223d94e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000e6c0 con 0x7f1004003ff0 2023-08-18T20:45:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000e820 con 0x7f1004003ff0 2023-08-18T20:45:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.722+0000 7f10137fe700 1 -- 172.21.15.121:0/1014328391 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000eb90 con 0x7f1004003ff0 2023-08-18T20:45:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 -- 172.21.15.121:0/1014328391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1004003ff0 msgr2=0x7f1004004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 --2- 172.21.15.121:0/1014328391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1004003ff0 0x7f1004004850 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1000009b30 tx=0x7f1004005880 comp rx=0 tx=0).stop 2023-08-18T20:45:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101944d700 1 -- 172.21.15.121:0/1014328391 reap_dead start 2023-08-18T20:45:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 -- 172.21.15.121:0/1014328391 shutdown_connections 2023-08-18T20:45:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 -- 172.21.15.121:0/1014328391 >> 172.21.15.121:0/1014328391 conn(0x7f10140a8770 msgr2=0x7f10140a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 -- 172.21.15.121:0/1014328391 shutdown_connections 2023-08-18T20:45:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.723+0000 7f101aeb0700 1 -- 172.21.15.121:0/1014328391 wait complete. 2023-08-18T20:45:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.724+0000 7f101aeb0700 1 Processor -- start 2023-08-18T20:45:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.724+0000 7f101aeb0700 1 -- start start 2023-08-18T20:45:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 0x7f10141584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 0x7f1014147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c1f90 con 0x7f1014071470 2023-08-18T20:45:15.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a7910 con 0x7f1014148120 2023-08-18T20:45:15.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101aeb0700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c1c60 con 0x7f1004003ff0 2023-08-18T20:45:15.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43140/0 (socket says 172.21.15.121:43140) 2023-08-18T20:45:15.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 -- 172.21.15.121:0/294358637 learned_addr learned my addr 172.21.15.121:0/294358637 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:15.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f1013fff700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 0x7f1014147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f1018c4c700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 0x7f10141584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 -- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 msgr2=0x7f10141584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 0x7f10141584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 -- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 msgr2=0x7f1014147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:15.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 0x7f1014147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:15.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f101944d700 1 -- 172.21.15.121:0/294358637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140a9b40 con 0x7f1014071470 2023-08-18T20:45:15.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f1018c4c700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 0x7f10141584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:15.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.725+0000 7f1013fff700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 0x7f1014147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:15.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f101944d700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f10140acbe0 tx=0x7f100c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:15.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00e040 con 0x7f1014071470 2023-08-18T20:45:15.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00f040 con 0x7f1014071470 2023-08-18T20:45:15.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140c2420 con 0x7f1014071470 2023-08-18T20:45:15.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00fdb0 con 0x7f1014071470 2023-08-18T20:45:15.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.726+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140a9860 con 0x7f1014071470 2023-08-18T20:45:15.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.727+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10140c1ac0 con 0x7f1014071470 2023-08-18T20:45:15.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.727+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f100c022460 con 0x7f1014071470 2023-08-18T20:45:15.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.728+0000 7f10117fa700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 0x7f0ff806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:15.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.728+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f100c088e40 con 0x7f1014071470 2023-08-18T20:45:15.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.728+0000 7f1018c4c700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 0x7f0ff806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:15.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.728+0000 7f1018c4c700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 0x7f0ff806c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1008000fb0 tx=0x7f1008009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:15.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.732+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f10140c1ac0 con 0x7f1014071470 2023-08-18T20:45:15.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:15.921+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10140c1ac0 con 0x7f1014071470 2023-08-18T20:45:16.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.884+0000 7f10117fa700 1 -- 172.21.15.121:0/294358637 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10140c1ac0 con 0x7f1014071470 2023-08-18T20:45:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 msgr2=0x7f0ff806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 0x7f0ff806c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1008000fb0 tx=0x7f1008009040 comp rx=0 tx=0).stop 2023-08-18T20:45:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 msgr2=0x7f10140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f10140acbe0 tx=0x7f100c011f80 comp rx=0 tx=0).stop 2023-08-18T20:45:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 shutdown_connections 2023-08-18T20:45:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f0ff806a0e0 0x7f0ff806c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1014071470 0x7f10140718f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1004003ff0 0x7f10141584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 --2- 172.21.15.121:0/294358637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1014148120 0x7f1014147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.888+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 >> 172.21.15.121:0/294358637 conn(0x7f10140a8770 msgr2=0x7f101414a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.889+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 shutdown_connections 2023-08-18T20:45:16.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:16.889+0000 7f101aeb0700 1 -- 172.21.15.121:0/294358637 wait complete. 2023-08-18T20:45:16.892 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2023-08-18T20:45:16.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-18T20:45:17.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.037+0000 7f1a1aacc700 1 Processor -- start 2023-08-18T20:45:17.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.037+0000 7f1a1aacc700 1 -- start start 2023-08-18T20:45:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a1aacc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a1406a510 0x7f1a1414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a1aacc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c3af0 0x7f1a1414b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a1aacc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140a5d30 con 0x7f1a140c0250 2023-08-18T20:45:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a1aacc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140c4a70 con 0x7f1a1406a510 2023-08-18T20:45:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a1aacc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14155330 con 0x7f1a140c3af0 2023-08-18T20:45:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a18868700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a1406a510 0x7f1a1414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a13fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a140c0250 0x7f1a140c33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49728/0 (socket says 172.21.15.121:49728) 2023-08-18T20:45:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a13fff700 1 -- 172.21.15.121:0/3400815977 learned_addr learned my addr 172.21.15.121:0/3400815977 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a19069700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c3af0 0x7f1a1414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a18868700 1 -- 172.21.15.121:0/3400815977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c3af0 msgr2=0x7f1a1414b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a18868700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c3af0 0x7f1a1414b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a18868700 1 -- 172.21.15.121:0/3400815977 >> v1:172.21.15.121:6789/0 conn(0x7f1a140c0250 legacy=0x7f1a140c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.038+0000 7f1a18868700 1 -- 172.21.15.121:0/3400815977 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140a5fd0 con 0x7f1a1406a510 2023-08-18T20:45:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a18868700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a1414ab00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009840 tx=0x7f1a08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2919fd5aae29391e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a137fe700 1 -- 172.21.15.121:0/3400815977 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08011830 con 0x7f1a1406a510 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a137fe700 1 -- 172.21.15.121:0/3400815977 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08011990 con 0x7f1a1406a510 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a137fe700 1 -- 172.21.15.121:0/3400815977 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08011d20 con 0x7f1a1406a510 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 -- 172.21.15.121:0/3400815977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 msgr2=0x7f1a1414ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a1414ab00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009840 tx=0x7f1a08009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 -- 172.21.15.121:0/3400815977 shutdown_connections 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c3af0 0x7f1a1414b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/3400815977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a1414ab00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 -- 172.21.15.121:0/3400815977 >> 172.21.15.121:0/3400815977 conn(0x7f1a140a8770 msgr2=0x7f1a140a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:17.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 -- 172.21.15.121:0/3400815977 shutdown_connections 2023-08-18T20:45:17.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.039+0000 7f1a1aacc700 1 -- 172.21.15.121:0/3400815977 wait complete. 2023-08-18T20:45:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.040+0000 7f1a1aacc700 1 Processor -- start 2023-08-18T20:45:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.040+0000 7f1a1aacc700 1 -- start start 2023-08-18T20:45:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 0x7f1a141492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 0x7f1a141e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14151cc0 con 0x7f1a1406a510 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a141514d0 con 0x7f1a140c3af0 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a1aacc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a141510b0 con 0x7f1a140c0250 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a18868700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a18868700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43152/0 (socket says 172.21.15.121:43152) 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a18868700 1 -- 172.21.15.121:0/1331977542 learned_addr learned my addr 172.21.15.121:0/1331977542 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a13fff700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 0x7f1a141492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.041+0000 7f1a19069700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 0x7f1a141e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 -- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 msgr2=0x7f1a141492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 0x7f1a141492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 -- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 msgr2=0x7f1a141e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 0x7f1a141e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 -- 172.21.15.121:0/1331977542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080094a0 con 0x7f1a1406a510 2023-08-18T20:45:17.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a19069700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 0x7f1a141e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a13fff700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 0x7f1a141492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a18868700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a1406c780 tx=0x7f1a08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080036a0 con 0x7f1a1406a510 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0801f070 con 0x7f1a1406a510 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08003a40 con 0x7f1a1406a510 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14151700 con 0x7f1a1406a510 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.042+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a140ac250 con 0x7f1a1406a510 2023-08-18T20:45:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.043+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a140ac0b0 con 0x7f1a1406a510 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.043+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a08003ba0 con 0x7f1a1406a510 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.044+0000 7f1a117fa700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 0x7f19f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.044+0000 7f1a13fff700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 0x7f19f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.044+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f1a08021070 con 0x7f1a1406a510 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.044+0000 7f1a13fff700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 0x7f19f806c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005910 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.048+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1a140ac0b0 con 0x7f1a1406a510 2023-08-18T20:45:17.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.240+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a140ac0b0 con 0x7f1a1406a510 2023-08-18T20:45:17.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.888+0000 7f1a117fa700 1 -- 172.21.15.121:0/1331977542 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a140ac0b0 con 0x7f1a1406a510 2023-08-18T20:45:17.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 msgr2=0x7f19f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 0x7f19f806c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005910 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2023-08-18T20:45:17.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 msgr2=0x7f1a14148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:17.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a1406c780 tx=0x7f1a08004750 comp rx=0 tx=0).stop 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 shutdown_connections 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a140c3af0 0x7f1a141e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f19f806a0e0 0x7f19f806c5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a1406a510 0x7f1a14148d70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 --2- 172.21.15.121:0/1331977542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a140c0250 0x7f1a141492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.892+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 >> 172.21.15.121:0/1331977542 conn(0x7f1a140a8770 msgr2=0x7f1a140a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:17.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.893+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 shutdown_connections 2023-08-18T20:45:17.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:17.893+0000 7f1a1aacc700 1 -- 172.21.15.121:0/1331977542 wait complete. 2023-08-18T20:45:17.895 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2023-08-18T20:45:17.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.033+0000 7f5a756f1700 1 Processor -- start 2023-08-18T20:45:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.033+0000 7f5a756f1700 1 -- start start 2023-08-18T20:45:18.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a756f1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a701543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a756f1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700ca4a0 con 0x7f5a70154900 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a756f1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7006c0f0 con 0x7f5a70151b10 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a756f1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70158540 con 0x7f5a700c7ca0 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5a70154900 0x7f5a7015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49746/0 (socket says 172.21.15.121:49746) 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6f7fe700 1 -- 172.21.15.121:0/2429537073 learned_addr learned my addr 172.21.15.121:0/2429537073 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a701543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873047641 0 0) 0x7f5a700ca4a0 con 0x7f5a70154900 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a580035b0 con 0x7f5a70154900 2023-08-18T20:45:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499948720 0 0) 0x7f5a580035b0 con 0x7f5a70154900 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 msgr2=0x7f5a701543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a701543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 >> v1:172.21.15.122:6789/0 conn(0x7f5a70151b10 legacy=0x7f5a700c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70158820 con 0x7f5a70154900 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.034+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f5a680019f0 con 0x7f5a70154900 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 >> v1:172.21.15.121:6789/0 conn(0x7f5a70154900 legacy=0x7f5a7015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a58003aa0 0x7f5a58003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a58005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70158540 con 0x7f5a58004850 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bb20 con 0x7f5a58003aa0 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bce0 con 0x7f5a700c7ca0 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6effd700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a58003aa0 0x7f5a58003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6f7fe700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a58005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 -- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 msgr2=0x7f5a58005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a58005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 -- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a58003aa0 msgr2=0x7f5a58003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a58003aa0 0x7f5a58003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 -- 172.21.15.121:0/2429537073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580035b0 con 0x7f5a58004850 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6f7fe700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a700c7ca0 0x7f5a58005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a58004cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b30 tx=0x7f5a58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ef7ab1e1033abe server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000e6c0 con 0x7f5a58004850 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6000e820 con 0x7f5a58004850 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.035+0000 7f5a6dffb700 1 -- 172.21.15.121:0/2429537073 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000eb90 con 0x7f5a58004850 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 -- 172.21.15.121:0/2429537073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 msgr2=0x7f5a58004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 --2- 172.21.15.121:0/2429537073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a58004cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b30 tx=0x7f5a58005880 comp rx=0 tx=0).stop 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a6f7fe700 1 -- 172.21.15.121:0/2429537073 reap_dead start 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 -- 172.21.15.121:0/2429537073 shutdown_connections 2023-08-18T20:45:18.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 -- 172.21.15.121:0/2429537073 >> 172.21.15.121:0/2429537073 conn(0x7f5a70071bb0 msgr2=0x7f5a70071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 -- 172.21.15.121:0/2429537073 shutdown_connections 2023-08-18T20:45:18.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.036+0000 7f5a756f1700 1 -- 172.21.15.121:0/2429537073 wait complete. 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.037+0000 7f5a756f1700 1 Processor -- start 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.037+0000 7f5a756f1700 1 -- start start 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a70148230 0x7f5a701eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a7014e430 0x7f5a7014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7014ee00 con 0x7f5a58004850 2023-08-18T20:45:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70148700 con 0x7f5a70148230 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a756f1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7014c7c0 con 0x7f5a7014e430 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a6effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a6effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43172/0 (socket says 172.21.15.121:43172) 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.038+0000 7f5a6effd700 1 -- 172.21.15.121:0/634175606 learned_addr learned my addr 172.21.15.121:0/634175606 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a70148230 0x7f5a701eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6f7fe700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a7014e430 0x7f5a7014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 -- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a7014e430 msgr2=0x7f5a7014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a7014e430 0x7f5a7014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 -- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a70148230 msgr2=0x7f5a701eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a70148230 0x7f5a701eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 -- 172.21.15.121:0/634175606 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7014d710 con 0x7f5a58004850 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a6effd700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400f850 tx=0x7f5a6400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640050d0 con 0x7f5a58004850 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64005230 con 0x7f5a58004850 2023-08-18T20:45:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70147f50 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64003680 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.039+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7014ccb0 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.040+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a70074730 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.041+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a640037e0 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.041+0000 7f5a577fe700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 0x7f5a5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.041+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5a640883d0 con 0x7f5a58004850 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.041+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 0x7f5a5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.041+0000 7f5a6e7fc700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 0x7f5a5c06c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a600090b0 tx=0x7f5a60008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.045+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5a64053af0 con 0x7f5a58004850 2023-08-18T20:45:18.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.238+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a7006c2e0 con 0x7f5a58004850 2023-08-18T20:45:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.239+0000 7f5a577fe700 1 -- 172.21.15.121:0/634175606 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f5a64057110 con 0x7f5a58004850 2023-08-18T20:45:18.240 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:18.240 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:17.879607+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6837/1099144439":"2023-08-19T20:45:14.529157+0000","172.21.15.121:6835/1099144439":"2023-08-19T20:45:14.529157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 msgr2=0x7f5a5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 0x7f5a5c06c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a600090b0 tx=0x7f5a60008030 comp rx=0 tx=0).stop 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 msgr2=0x7f5a7014d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400f850 tx=0x7f5a6400fc10 comp rx=0 tx=0).stop 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 shutdown_connections 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a7014e430 0x7f5a7014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5a5c06a0e0 0x7f5a5c06c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a58004850 0x7f5a7014d1d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 --2- 172.21.15.121:0/634175606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a70148230 0x7f5a701eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 >> 172.21.15.121:0/634175606 conn(0x7f5a70071bb0 msgr2=0x7f5a7014fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 shutdown_connections 2023-08-18T20:45:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.241+0000 7f5a756f1700 1 -- 172.21.15.121:0/634175606 wait complete. 2023-08-18T20:45:18.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:44:45.110030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:44:46.431796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:18.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.377+0000 7fefac982700 1 Processor -- start 2023-08-18T20:45:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.377+0000 7fefac982700 1 -- start start 2023-08-18T20:45:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefac982700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefac982700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fefa80c5ae0 0x7fefa8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefac982700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80c4f40 con 0x7fefa806a7e0 2023-08-18T20:45:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefac982700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80c6120 con 0x7fefa80c5ae0 2023-08-18T20:45:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefac982700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81551f0 con 0x7fefa80c0c50 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fefa80c5ae0 0x7fefa8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa5d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fefa806a7e0 0x7fefa80c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49764/0 (socket says 172.21.15.121:49764) 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa5d9b700 1 -- 172.21.15.121:0/2397003035 learned_addr learned my addr 172.21.15.121:0/2397003035 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa659c700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 -- 172.21.15.121:0/2397003035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 msgr2=0x7fefa806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 -- 172.21.15.121:0/2397003035 >> v1:172.21.15.121:6789/0 conn(0x7fefa806a7e0 legacy=0x7fefa80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa559a700 1 -- 172.21.15.121:0/2397003035 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634572146 0 0) 0x7fefa80c4f40 con 0x7fefa806a7e0 2023-08-18T20:45:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 -- 172.21.15.121:0/2397003035 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80c63a0 con 0x7fefa80c5ae0 2023-08-18T20:45:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.378+0000 7fefa6d9d700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa80c5ae0 0x7fefa8071b80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009d90 tx=0x7fefa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f04e122969f7598 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefa559a700 1 -- 172.21.15.121:0/2397003035 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000e070 con 0x7fefa80c5ae0 2023-08-18T20:45:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefa559a700 1 -- 172.21.15.121:0/2397003035 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000bbd0 con 0x7fefa80c5ae0 2023-08-18T20:45:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefa559a700 1 -- 172.21.15.121:0/2397003035 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0012430 con 0x7fefa80c5ae0 2023-08-18T20:45:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 -- 172.21.15.121:0/2397003035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa80c5ae0 msgr2=0x7fefa8071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa80c5ae0 0x7fefa8071b80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009d90 tx=0x7fefa000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 -- 172.21.15.121:0/2397003035 shutdown_connections 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa80c5ae0 0x7fefa8071b80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 --2- 172.21.15.121:0/2397003035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 -- 172.21.15.121:0/2397003035 >> 172.21.15.121:0/2397003035 conn(0x7fefa80c6b10 msgr2=0x7fefa80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 -- 172.21.15.121:0/2397003035 shutdown_connections 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.379+0000 7fefac982700 1 -- 172.21.15.121:0/2397003035 wait complete. 2023-08-18T20:45:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.380+0000 7fefac982700 1 Processor -- start 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 -- start start 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa80c5ae0 0x7fefa81eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80acae0 con 0x7fefa806a7e0 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814f5e0 con 0x7fefa80c5ae0 2023-08-18T20:45:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.381+0000 7fefac982700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814ec10 con 0x7fefa80c0c50 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43186/0 (socket says 172.21.15.121:43186) 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 -- 172.21.15.121:0/2688625827 learned_addr learned my addr 172.21.15.121:0/2688625827 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa5d9b700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa6d9d700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa80c5ae0 0x7fefa81eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 -- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 msgr2=0x7fefa81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 -- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa80c5ae0 msgr2=0x7fefa81eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa80c5ae0 0x7fefa81eca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 -- 172.21.15.121:0/2688625827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0009a70 con 0x7fefa806a7e0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefa659c700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e840 tx=0x7fef9800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98013610 con 0x7fefa806a7e0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98013770 con 0x7fefa806a7e0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa80ab930 con 0x7fefa806a7e0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98013b20 con 0x7fefa806a7e0 2023-08-18T20:45:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.382+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8150700 con 0x7fefa806a7e0 2023-08-18T20:45:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.383+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa814eef0 con 0x7fefa806a7e0 2023-08-18T20:45:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.383+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef98013c80 con 0x7fefa806a7e0 2023-08-18T20:45:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.384+0000 7fef96ffd700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 0x7fef8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.384+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fef980881d0 con 0x7fefa806a7e0 2023-08-18T20:45:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.384+0000 7fefa5d9b700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 0x7fef8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.384+0000 7fefa5d9b700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 0x7fef8806c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fefa80a5e40 tx=0x7fef9c007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.388+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fef980538f0 con 0x7fefa806a7e0 2023-08-18T20:45:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.577+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fefa8154660 con 0x7fefa806a7e0 2023-08-18T20:45:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.577+0000 7fef96ffd700 1 -- 172.21.15.121:0/2688625827 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef98056f10 con 0x7fefa806a7e0 2023-08-18T20:45:18.578 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 msgr2=0x7fef8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 0x7fef8806c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fefa80a5e40 tx=0x7fef9c007c90 comp rx=0 tx=0).stop 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 msgr2=0x7fefa814f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e840 tx=0x7fef9800ec00 comp rx=0 tx=0).stop 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 shutdown_connections 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa80c5ae0 0x7fefa81eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fef8806a0e0 0x7fef8806c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefa806a7e0 0x7fefa814f0a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 --2- 172.21.15.121:0/2688625827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa80c0c50 0x7fefa81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 >> 172.21.15.121:0/2688625827 conn(0x7fefa80c6b10 msgr2=0x7fefa806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 shutdown_connections 2023-08-18T20:45:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.579+0000 7fefac982700 1 -- 172.21.15.121:0/2688625827 wait complete. 2023-08-18T20:45:18.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:18.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 Processor -- start 2023-08-18T20:45:18.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 -- start start 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed9c14e950 0x7fed9c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fed9c070950 0x7fed9c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0c2260 con 0x7fed9c14ed30 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0a6630 con 0x7fed9c14e950 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.715+0000 7feda3ef7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c151d90 con 0x7fed9c070950 2023-08-18T20:45:18.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed9c14e950 0x7fed9c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed9c14e950 0x7fed9c0c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43194/0 (socket says 172.21.15.121:43194) 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 -- 172.21.15.121:0/3451069123 learned_addr learned my addr 172.21.15.121:0/3451069123 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda2494700 1 --2- 172.21.15.121:0/3451069123 >> v2:172.21.15.122:3300/0 conn(0x7fed9c070950 0x7fed9c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 -- 172.21.15.121:0/3451069123 >> v2:172.21.15.122:3300/0 conn(0x7fed9c070950 msgr2=0x7fed9c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 --2- 172.21.15.121:0/3451069123 >> v2:172.21.15.122:3300/0 conn(0x7fed9c070950 0x7fed9c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 -- 172.21.15.121:0/3451069123 >> v1:172.21.15.122:6789/0 conn(0x7fed9c14ed30 legacy=0x7fed9c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 -- 172.21.15.121:0/3451069123 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c152070 con 0x7fed9c14e950 2023-08-18T20:45:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda1c93700 1 --2- 172.21.15.121:0/3451069123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14e950 0x7fed9c0c2ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0c64f0 tx=0x7fed8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683d84a61caafd27 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda0c91700 1 -- 172.21.15.121:0/3451069123 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c004230 con 0x7fed9c14e950 2023-08-18T20:45:18.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda0c91700 1 -- 172.21.15.121:0/3451069123 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c004390 con 0x7fed9c14e950 2023-08-18T20:45:18.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.716+0000 7feda0c91700 1 -- 172.21.15.121:0/3451069123 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0036a0 con 0x7fed9c14e950 2023-08-18T20:45:18.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 -- 172.21.15.121:0/3451069123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14e950 msgr2=0x7fed9c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3451069123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14e950 0x7fed9c0c2ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0c64f0 tx=0x7fed8c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 -- 172.21.15.121:0/3451069123 shutdown_connections 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3451069123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14e950 0x7fed9c0c2ed0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3451069123 >> v2:172.21.15.122:3300/0 conn(0x7fed9c070950 0x7fed9c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 -- 172.21.15.121:0/3451069123 >> 172.21.15.121:0/3451069123 conn(0x7fed9c0c6b10 msgr2=0x7fed9c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 -- 172.21.15.121:0/3451069123 shutdown_connections 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.717+0000 7feda3ef7700 1 -- 172.21.15.121:0/3451069123 wait complete. 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.718+0000 7feda3ef7700 1 Processor -- start 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.718+0000 7feda3ef7700 1 -- start start 2023-08-18T20:45:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 0x7fed9c146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 0x7fed9c0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1495c0 con 0x7fed9c14ed30 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1e8d40 con 0x7fed9c14e950 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1515b0 con 0x7fed9c070950 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43202/0 (socket says 172.21.15.121:43202) 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 -- 172.21.15.121:0/3343424119 learned_addr learned my addr 172.21.15.121:0/3343424119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda1492700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 0x7fed9c0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda1c93700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 0x7fed9c146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 -- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 msgr2=0x7fed9c146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 0x7fed9c146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 -- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 msgr2=0x7fed9c0abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 0x7fed9c0abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 -- 172.21.15.121:0/3343424119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c009550 con 0x7fed9c14ed30 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda1c93700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 0x7fed9c146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda1492700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 0x7fed9c0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda2494700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed94007e60 tx=0x7fed9400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400ede0 con 0x7fed9c14ed30 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94014420 con 0x7fed9c14ed30 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c147f50 con 0x7fed9c14ed30 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed940147d0 con 0x7fed9c14ed30 2023-08-18T20:45:18.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.719+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c148f00 con 0x7fed9c14ed30 2023-08-18T20:45:18.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.720+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c06b0d0 con 0x7fed9c14ed30 2023-08-18T20:45:18.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.721+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed94014930 con 0x7fed9c14ed30 2023-08-18T20:45:18.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.721+0000 7fed927fc700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 0x7fed8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.721+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fed94088c80 con 0x7fed9c14ed30 2023-08-18T20:45:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.721+0000 7feda1c93700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 0x7fed8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.722+0000 7feda1c93700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 0x7fed8006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009130 tx=0x7fed8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.726+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fed940543a0 con 0x7fed9c14ed30 2023-08-18T20:45:18.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.914+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed9c0723a0 con 0x7fed9c14ed30 2023-08-18T20:45:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.914+0000 7fed927fc700 1 -- 172.21.15.121:0/3343424119 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed940579c0 con 0x7fed9c14ed30 2023-08-18T20:45:18.915 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 msgr2=0x7fed8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 0x7fed8006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009130 tx=0x7fed8c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 msgr2=0x7fed9c142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed94007e60 tx=0x7fed9400e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 shutdown_connections 2023-08-18T20:45:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fed8006a0e0 0x7fed8006c5a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed9c14ed30 0x7fed9c142b50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed9c070950 0x7fed9c146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 --2- 172.21.15.121:0/3343424119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed9c14e950 0x7fed9c0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 >> 172.21.15.121:0/3343424119 conn(0x7fed9c0c6b10 msgr2=0x7fed9c0c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 shutdown_connections 2023-08-18T20:45:18.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:18.917+0000 7feda3ef7700 1 -- 172.21.15.121:0/3343424119 wait complete. 2023-08-18T20:45:18.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:45:19.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.051+0000 7f1746f39700 1 Processor -- start 2023-08-18T20:45:19.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.052+0000 7f1746f39700 1 -- start start 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.052+0000 7f1746f39700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f174006fd30 0x7f17400c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1746f39700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 0x7f17400c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1746f39700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17401529a0 con 0x7f17401559c0 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1746f39700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1740152c80 con 0x7f174006fd30 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1746f39700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1740152f60 con 0x7f1740152450 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f174006fd30 0x7f17400c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f174006fd30 0x7f17400c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43206/0 (socket says 172.21.15.121:43206) 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 -- 172.21.15.121:0/331972313 learned_addr learned my addr 172.21.15.121:0/331972313 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f173ffff700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 0x7f17400c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 -- 172.21.15.121:0/331972313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 msgr2=0x7f17400c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 0x7f17400c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 -- 172.21.15.121:0/331972313 >> v1:172.21.15.122:6789/0 conn(0x7f17401559c0 legacy=0x7f174014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 -- 172.21.15.121:0/331972313 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740153240 con 0x7f174006fd30 2023-08-18T20:45:19.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f173ffff700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 0x7f17400c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:19.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f1744cd5700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f174006fd30 0x7f17400c6d30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f17340098f0 tx=0x7f1734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c913b2edb4449fe5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f173f7fe700 1 -- 172.21.15.121:0/331972313 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734004230 con 0x7f174006fd30 2023-08-18T20:45:19.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f173f7fe700 1 -- 172.21.15.121:0/331972313 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734004390 con 0x7f174006fd30 2023-08-18T20:45:19.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.053+0000 7f173f7fe700 1 -- 172.21.15.121:0/331972313 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17340036a0 con 0x7f174006fd30 2023-08-18T20:45:19.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 -- 172.21.15.121:0/331972313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f174006fd30 msgr2=0x7f17400c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f174006fd30 0x7f17400c6d30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f17340098f0 tx=0x7f1734009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 -- 172.21.15.121:0/331972313 shutdown_connections 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f174006fd30 0x7f17400c6d30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 --2- 172.21.15.121:0/331972313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1740152450 0x7f17400c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 -- 172.21.15.121:0/331972313 >> 172.21.15.121:0/331972313 conn(0x7f17400c7bf0 msgr2=0x7f17400c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 -- 172.21.15.121:0/331972313 shutdown_connections 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.054+0000 7f1746f39700 1 -- 172.21.15.121:0/331972313 wait complete. 2023-08-18T20:45:19.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.055+0000 7f1746f39700 1 Processor -- start 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.055+0000 7f1746f39700 1 -- start start 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174006fd30 0x7f17400bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17401559c0 0x7f174014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400be3c0 con 0x7f1740152450 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400be5b0 con 0x7f17401559c0 2023-08-18T20:45:19.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1746f39700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17401ebab0 con 0x7f174006fd30 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43214/0 (socket says 172.21.15.121:43214) 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 -- 172.21.15.121:0/2127218899 learned_addr learned my addr 172.21.15.121:0/2127218899 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f1744cd5700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174006fd30 0x7f17400bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f17454d6700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17401559c0 0x7f174014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 -- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174006fd30 msgr2=0x7f17400bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174006fd30 0x7f17400bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 -- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17401559c0 msgr2=0x7f174014f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17401559c0 0x7f174014f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 -- 172.21.15.121:0/2127218899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734009550 con 0x7f1740152450 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.056+0000 7f173ffff700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c750 tx=0x7f172c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.057+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011800 con 0x7f1740152450 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.057+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c011960 con 0x7f1740152450 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.057+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17401eacf0 con 0x7f1740152450 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.057+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011cd0 con 0x7f1740152450 2023-08-18T20:45:19.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.057+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17401eb2b0 con 0x7f1740152450 2023-08-18T20:45:19.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.058+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1740074730 con 0x7f1740152450 2023-08-18T20:45:19.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.058+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f172c021350 con 0x7f1740152450 2023-08-18T20:45:19.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.058+0000 7f173d7fa700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 0x7f172406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.059+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f172c088490 con 0x7f1740152450 2023-08-18T20:45:19.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.059+0000 7f1744cd5700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 0x7f172406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.059+0000 7f1744cd5700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 0x7f172406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1734009130 tx=0x7f1734008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.063+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f172c057640 con 0x7f1740152450 2023-08-18T20:45:19.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:45:19.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:45:19.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.264+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17400c1cf0 con 0x7f1740152450 2023-08-18T20:45:19.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.265+0000 7f173d7fa700 1 -- 172.21.15.121:0/2127218899 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7f172c0571d0 con 0x7f1740152450 2023-08-18T20:45:19.265 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:19.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.266+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 msgr2=0x7f172406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.266+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 0x7f172406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1734009130 tx=0x7f1734008030 comp rx=0 tx=0).stop 2023-08-18T20:45:19.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.266+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 msgr2=0x7f17400c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.266+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c750 tx=0x7f172c00cb10 comp rx=0 tx=0).stop 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 shutdown_connections 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17401559c0 0x7f174014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174006fd30 0x7f17400bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f172406a0e0 0x7f172406c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 --2- 172.21.15.121:0/2127218899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1740152450 0x7f17400c1070 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 >> 172.21.15.121:0/2127218899 conn(0x7f17400c7bf0 msgr2=0x7f17400c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 shutdown_connections 2023-08-18T20:45:19.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.267+0000 7f1746f39700 1 -- 172.21.15.121:0/2127218899 wait complete. 2023-08-18T20:45:19.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:45:19.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.401+0000 7f212ce19700 1 Processor -- start 2023-08-18T20:45:19.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.401+0000 7f212ce19700 1 -- start start 2023-08-18T20:45:19.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.402+0000 7f212ce19700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 0x7f21280c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.402+0000 7f212ce19700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 0x7f21280c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.402+0000 7f212ce19700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280c2260 con 0x7f212814ed30 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.402+0000 7f212ce19700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280a6630 con 0x7f212814e950 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.402+0000 7f212ce19700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2128151d90 con 0x7f2128070950 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212659c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 0x7f21280c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 0x7f21280c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212659c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 0x7f21280c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53058/0 (socket says 172.21.15.121:53058) 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212659c700 1 -- 172.21.15.121:0/797564940 learned_addr learned my addr 172.21.15.121:0/797564940 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 -- 172.21.15.121:0/797564940 >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 msgr2=0x7f21280c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:19.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 --2- 172.21.15.121:0/797564940 >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 0x7f21280c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 -- 172.21.15.121:0/797564940 >> v1:172.21.15.122:6789/0 conn(0x7f212814ed30 legacy=0x7f21280c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 -- 172.21.15.121:0/797564940 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2128152070 con 0x7f2128070950 2023-08-18T20:45:19.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f2126d9d700 1 --2- 172.21.15.121:0/797564940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 0x7f21280c4b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae842e801605be7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212559a700 1 -- 172.21.15.121:0/797564940 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000e070 con 0x7f2128070950 2023-08-18T20:45:19.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212559a700 1 -- 172.21.15.121:0/797564940 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000bb20 con 0x7f2128070950 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.403+0000 7f212559a700 1 -- 172.21.15.121:0/797564940 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120012430 con 0x7f2128070950 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 -- 172.21.15.121:0/797564940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 msgr2=0x7f21280c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 --2- 172.21.15.121:0/797564940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 0x7f21280c4b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 -- 172.21.15.121:0/797564940 shutdown_connections 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 --2- 172.21.15.121:0/797564940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2128070950 0x7f21280c4b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 --2- 172.21.15.121:0/797564940 >> v2:172.21.15.122:3300/0 conn(0x7f212814e950 0x7f21280c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 -- 172.21.15.121:0/797564940 >> 172.21.15.121:0/797564940 conn(0x7f21280c6b10 msgr2=0x7f21280c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 -- 172.21.15.121:0/797564940 shutdown_connections 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.404+0000 7f212ce19700 1 -- 172.21.15.121:0/797564940 wait complete. 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.405+0000 7f212ce19700 1 Processor -- start 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.405+0000 7f212ce19700 1 -- start start 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 0x7f21281e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f212814ed30 0x7f21281488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212814af50 con 0x7f2128070950 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281ed2b0 con 0x7f212814ed30 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212ce19700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21281ed7e0 con 0x7f212814e950 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43226/0 (socket says 172.21.15.121:43226) 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 -- 172.21.15.121:0/1989708916 learned_addr learned my addr 172.21.15.121:0/1989708916 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f2125d9b700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 0x7f21281e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 -- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 msgr2=0x7f21281e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f2126d9d700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f212814ed30 0x7f21281488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 0x7f21281e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 -- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f212814ed30 msgr2=0x7f21281488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f212814ed30 0x7f21281488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f212659c700 1 -- 172.21.15.121:0/1989708916 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009a70 con 0x7f2128070950 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.406+0000 7f2125d9b700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 0x7f21281e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f212659c700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f211c00e940 tx=0x7f211c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0096a0 con 0x7f2128070950 2023-08-18T20:45:19.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c00c850 con 0x7f2128070950 2023-08-18T20:45:19.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00cc00 con 0x7f2128070950 2023-08-18T20:45:19.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c5380 con 0x7f2128070950 2023-08-18T20:45:19.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.407+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212806cbc0 con 0x7f2128070950 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.408+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128074730 con 0x7f2128070950 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.408+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f211c00cd60 con 0x7f2128070950 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.409+0000 7f2116ffd700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 0x7f210806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.409+0000 7f2125d9b700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 0x7f210806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.409+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f211c088590 con 0x7f2128070950 2023-08-18T20:45:19.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.409+0000 7f2125d9b700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 0x7f210806c5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21280c0ff0 tx=0x7f2118009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.413+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f211c053cb0 con 0x7f2128070950 2023-08-18T20:45:19.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.601+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f21280a7be0 con 0x7f2128070950 2023-08-18T20:45:19.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.601+0000 7f2116ffd700 1 -- 172.21.15.121:0/1989708916 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f211c0572d0 con 0x7f2128070950 2023-08-18T20:45:19.602 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:19.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 msgr2=0x7f210806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 0x7f210806c5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21280c0ff0 tx=0x7f2118009040 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 msgr2=0x7f21280c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f211c00e940 tx=0x7f211c00ed00 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 shutdown_connections 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f212814ed30 0x7f21281488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f210806a110 0x7f210806c5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.603+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2128070950 0x7f21280c4e40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.604+0000 7f212ce19700 1 --2- 172.21.15.121:0/1989708916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f212814e950 0x7f21281e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.604+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 >> 172.21.15.121:0/1989708916 conn(0x7f21280c6b10 msgr2=0x7f21280c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.604+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 shutdown_connections 2023-08-18T20:45:19.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.604+0000 7f212ce19700 1 -- 172.21.15.121:0/1989708916 wait complete. 2023-08-18T20:45:19.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:19.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.735+0000 7f5237b69700 1 Processor -- start 2023-08-18T20:45:19.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.735+0000 7f5237b69700 1 -- start start 2023-08-18T20:45:19.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5237b69700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f52300a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5237b69700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f52300c6500 0x7f523006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5237b69700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300a6270 con 0x7f523006a7e0 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5237b69700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300bbec0 con 0x7f52300c6500 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5237b69700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300a64a0 con 0x7f523014f9c0 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5235104700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f52300c6500 0x7f523006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5235104700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f52300c6500 0x7f523006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43236/0 (socket says 172.21.15.121:43236) 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5235104700 1 -- 172.21.15.121:0/395806724 learned_addr learned my addr 172.21.15.121:0/395806724 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.736+0000 7f5235905700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f52300a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5235104700 1 -- 172.21.15.121:0/395806724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 msgr2=0x7f52300a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5235104700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f52300a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5235104700 1 -- 172.21.15.121:0/395806724 >> v1:172.21.15.122:6789/0 conn(0x7f523006a7e0 legacy=0x7f5230152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5235104700 1 -- 172.21.15.121:0/395806724 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300bcb00 con 0x7f52300c6500 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5235104700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52300c6500 0x7f523006a2a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f522c0098f0 tx=0x7f522c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2555c301adbe994 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5234903700 1 -- 172.21.15.121:0/395806724 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c011830 con 0x7f52300c6500 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5234903700 1 -- 172.21.15.121:0/395806724 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c011990 con 0x7f52300c6500 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5234903700 1 -- 172.21.15.121:0/395806724 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c011d20 con 0x7f52300c6500 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 -- 172.21.15.121:0/395806724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52300c6500 msgr2=0x7f523006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52300c6500 0x7f523006a2a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f522c0098f0 tx=0x7f522c009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 -- 172.21.15.121:0/395806724 shutdown_connections 2023-08-18T20:45:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f52300a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 --2- 172.21.15.121:0/395806724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52300c6500 0x7f523006a2a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.737+0000 7f5237b69700 1 -- 172.21.15.121:0/395806724 >> 172.21.15.121:0/395806724 conn(0x7f52300c35a0 msgr2=0x7f52300c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.738+0000 7f5237b69700 1 -- 172.21.15.121:0/395806724 shutdown_connections 2023-08-18T20:45:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.738+0000 7f5237b69700 1 -- 172.21.15.121:0/395806724 wait complete. 2023-08-18T20:45:19.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 Processor -- start 2023-08-18T20:45:19.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 -- start start 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52300c6500 0x7f52300c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f523006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300a88b0 con 0x7f523006a7e0 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301530f0 con 0x7f52300c6500 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5237b69700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52301ec0a0 con 0x7f523014f9c0 2023-08-18T20:45:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5235905700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5235905700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43240/0 (socket says 172.21.15.121:43240) 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5235905700 1 -- 172.21.15.121:0/2989536482 learned_addr learned my addr 172.21.15.121:0/2989536482 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.739+0000 7f5236106700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f523006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235104700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52300c6500 0x7f52300c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 -- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 msgr2=0x7f523006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f523006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 -- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52300c6500 msgr2=0x7f52300c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52300c6500 0x7f52300c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 -- 172.21.15.121:0/2989536482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009550 con 0x7f523006a7e0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5235905700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f522400e870 tx=0x7f522400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224009590 con 0x7f523006a7e0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224013680 con 0x7f523006a7e0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300a9330 con 0x7f523006a7e0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52240139f0 con 0x7f523006a7e0 2023-08-18T20:45:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.740+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52300a9050 con 0x7f523006a7e0 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.741+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52300c5d80 con 0x7f523006a7e0 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.741+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5224013b50 con 0x7f523006a7e0 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.742+0000 7f52227fc700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 0x7f521406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.742+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f52240884e0 con 0x7f523006a7e0 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.742+0000 7f5235104700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 0x7f521406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:19.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.742+0000 7f5235104700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 0x7f521406c5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f522c009c40 tx=0x7f522c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:19.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.746+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5224057570 con 0x7f523006a7e0 2023-08-18T20:45:19.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.980+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52300bcdb0 con 0x7f523006a7e0 2023-08-18T20:45:19.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.981+0000 7f52227fc700 1 -- 172.21.15.121:0/2989536482 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f5224057100 con 0x7f523006a7e0 2023-08-18T20:45:19.982 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:19.982 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/112571641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":112571641},{"type":"v1","addr":"172.21.15.121:6837","nonce":112571641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:19.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 msgr2=0x7f521406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 0x7f521406c5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f522c009c40 tx=0x7f522c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 msgr2=0x7f52301ebb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f522400e870 tx=0x7f522400eb80 comp rx=0 tx=0).stop 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 shutdown_connections 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f523014f9c0 0x7f523006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f521406a110 0x7f521406c5d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523006a7e0 0x7f52301ebb60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 --2- 172.21.15.121:0/2989536482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52300c6500 0x7f52300c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:19.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 >> 172.21.15.121:0/2989536482 conn(0x7f52300c35a0 msgr2=0x7f523014db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:19.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 shutdown_connections 2023-08-18T20:45:19.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:19.983+0000 7f5237b69700 1 -- 172.21.15.121:0/2989536482 wait complete. 2023-08-18T20:45:19.985 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2023-08-18T20:45:19.996 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:20.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.120+0000 7f7f47dca700 1 Processor -- start 2023-08-18T20:45:20.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.120+0000 7f7f47dca700 1 -- start start 2023-08-18T20:45:20.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f47dca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f4015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f47dca700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4006cc30 con 0x7f7f401518e0 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f47dca700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f400667b0 con 0x7f7f400c1030 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f47dca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400c0b80 con 0x7f7f40066340 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f45b66700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7f401518e0 0x7f7f4006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49830/0 (socket says 172.21.15.121:49830) 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f45b66700 1 -- 172.21.15.121:0/739333620 learned_addr learned my addr 172.21.15.121:0/739333620 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f46367700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f4015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738353453 0 0) 0x7f7f4006cc30 con 0x7f7f401518e0 2023-08-18T20:45:20.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.121+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c0035b0 con 0x7f7f401518e0 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645540681 0 0) 0x7f7f400667b0 con 0x7f7f400c1030 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f4006cc30 con 0x7f7f400c1030 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4082592447 0 0) 0x7f7f2c0035b0 con 0x7f7f401518e0 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 msgr2=0x7f7f4015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f4015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 >> v1:172.21.15.122:6789/0 conn(0x7f7f400c1030 legacy=0x7f7f400bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40155260 con 0x7f7f401518e0 2023-08-18T20:45:20.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f7f30001670 con 0x7f7f401518e0 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 >> v1:172.21.15.121:6789/0 conn(0x7f7f401518e0 legacy=0x7f7f4006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f2c003c30 0x7f7f2c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400c0b80 con 0x7f7f2c003c30 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c00bba0 con 0x7f7f2c004d90 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c00bd60 con 0x7f7f40066340 2023-08-18T20:45:20.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f2c003c30 0x7f7f2c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f46367700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45365700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 -- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 msgr2=0x7f7f2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f40066340 0x7f7f2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 -- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f2c004d90 msgr2=0x7f7f2c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 -- 172.21.15.121:0/739333620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0035b0 con 0x7f7f2c003c30 2023-08-18T20:45:20.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f45b66700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f2c003c30 0x7f7f2c004030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c210 tx=0x7f7f2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e469dfbe354b7f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000cdb0 con 0x7f7f2c003c30 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30001af0 con 0x7f7f2c003c30 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.122+0000 7f7f44b64700 1 -- 172.21.15.121:0/739333620 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30005ba0 con 0x7f7f2c003c30 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 -- 172.21.15.121:0/739333620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f2c003c30 msgr2=0x7f7f2c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 --2- 172.21.15.121:0/739333620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f2c003c30 0x7f7f2c004030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c210 tx=0x7f7f2c005880 comp rx=0 tx=0).stop 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f46367700 1 -- 172.21.15.121:0/739333620 reap_dead start 2023-08-18T20:45:20.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 -- 172.21.15.121:0/739333620 shutdown_connections 2023-08-18T20:45:20.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 -- 172.21.15.121:0/739333620 >> 172.21.15.121:0/739333620 conn(0x7f7f400c2ca0 msgr2=0x7f7f400c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:20.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 -- 172.21.15.121:0/739333620 shutdown_connections 2023-08-18T20:45:20.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.123+0000 7f7f47dca700 1 -- 172.21.15.121:0/739333620 wait complete. 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.124+0000 7f7f47dca700 1 Processor -- start 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.124+0000 7f7f47dca700 1 -- start start 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f2c003c30 0x7f7f400c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f400a9770 0x7f7f401ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401558c0 con 0x7f7f4013fed0 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401eaad0 con 0x7f7f400a9770 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f47dca700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4014b460 con 0x7f7f2c003c30 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43264/0 (socket says 172.21.15.121:43264) 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 -- 172.21.15.121:0/3518672616 learned_addr learned my addr 172.21.15.121:0/3518672616 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f45b66700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f2c003c30 0x7f7f400c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f45365700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f400a9770 0x7f7f401ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 -- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f2c003c30 msgr2=0x7f7f400c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f2c003c30 0x7f7f400c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 -- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f400a9770 msgr2=0x7f7f401ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f400a9770 0x7f7f401ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.125+0000 7f7f46367700 1 -- 172.21.15.121:0/3518672616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400a9bf0 con 0x7f7f4013fed0 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f46367700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7f400c3da0 tx=0x7f7f38011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800e040 con 0x7f7f4013fed0 2023-08-18T20:45:20.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3800f040 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f400c56e0 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800fc40 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.126+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4014ae10 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.127+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4014b610 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.127+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f38015430 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.127+0000 7f7f367fc700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 0x7f7f2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.127+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7f38088cd0 con 0x7f7f4013fed0 2023-08-18T20:45:20.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.127+0000 7f7f45b66700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 0x7f7f2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.128+0000 7f7f45b66700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 0x7f7f2406c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7f40150eb0 tx=0x7f7f3000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.132+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7f4014b610 con 0x7f7f4013fed0 2023-08-18T20:45:20.321 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.321+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f4014b610 con 0x7f7f4013fed0 2023-08-18T20:45:20.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.322+0000 7f7f367fc700 1 -- 172.21.15.121:0/3518672616 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f7f4014b610 con 0x7f7f4013fed0 2023-08-18T20:45:20.323 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:20.323 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:17.879607+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6837/1099144439":"2023-08-19T20:45:14.529157+0000","172.21.15.121:6835/1099144439":"2023-08-19T20:45:14.529157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:20.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 msgr2=0x7f7f2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 0x7f7f2406c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7f40150eb0 tx=0x7f7f3000a000 comp rx=0 tx=0).stop 2023-08-18T20:45:20.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 msgr2=0x7f7f4014b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7f400c3da0 tx=0x7f7f38011ed0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 shutdown_connections 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7f2406a0e0 0x7f7f2406c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f4013fed0 0x7f7f4014b8f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f2c003c30 0x7f7f400c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 --2- 172.21.15.121:0/3518672616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f400a9770 0x7f7f401ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 >> 172.21.15.121:0/3518672616 conn(0x7f7f400c2ca0 msgr2=0x7f7f40154350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 shutdown_connections 2023-08-18T20:45:20.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.324+0000 7f7f47dca700 1 -- 172.21.15.121:0/3518672616 wait complete. 2023-08-18T20:45:20.337 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-08-18T20:45:20.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:20.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.457+0000 7f2356d29700 1 Processor -- start 2023-08-18T20:45:20.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 -- start start 2023-08-18T20:45:20.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f235006a2a0 0x7f23500bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23500c14a0 0x7f235006a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2350152050 con 0x7f23500c6150 2023-08-18T20:45:20.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500bbbf0 con 0x7f23500c14a0 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f2356d29700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2350154400 con 0x7f235006a2a0 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f234ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23500c14a0 0x7f235006a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f234ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23500c14a0 0x7f235006a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43268/0 (socket says 172.21.15.121:43268) 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.458+0000 7f234ffff700 1 -- 172.21.15.121:0/779313847 learned_addr learned my addr 172.21.15.121:0/779313847 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f2354ac5700 1 --2- 172.21.15.121:0/779313847 >> v2:172.21.15.122:3300/0 conn(0x7f235006a2a0 0x7f23500bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234ffff700 1 -- 172.21.15.121:0/779313847 >> v2:172.21.15.122:3300/0 conn(0x7f235006a2a0 msgr2=0x7f23500bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234ffff700 1 --2- 172.21.15.121:0/779313847 >> v2:172.21.15.122:3300/0 conn(0x7f235006a2a0 0x7f23500bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234ffff700 1 -- 172.21.15.121:0/779313847 >> v1:172.21.15.122:6789/0 conn(0x7f23500c6150 legacy=0x7f2350154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234ffff700 1 -- 172.21.15.121:0/779313847 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500bcfd0 con 0x7f23500c14a0 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234ffff700 1 --2- 172.21.15.121:0/779313847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f235006a680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f23500c4290 tx=0x7f233c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8869fb0daa7279 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234f7fe700 1 -- 172.21.15.121:0/779313847 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c004230 con 0x7f23500c14a0 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234f7fe700 1 -- 172.21.15.121:0/779313847 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c004390 con 0x7f23500c14a0 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f234f7fe700 1 -- 172.21.15.121:0/779313847 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0036a0 con 0x7f23500c14a0 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f2356d29700 1 -- 172.21.15.121:0/779313847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 msgr2=0x7f235006a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.459+0000 7f2356d29700 1 --2- 172.21.15.121:0/779313847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f235006a680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f23500c4290 tx=0x7f233c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 -- 172.21.15.121:0/779313847 shutdown_connections 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 --2- 172.21.15.121:0/779313847 >> v2:172.21.15.122:3300/0 conn(0x7f235006a2a0 0x7f23500bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 --2- 172.21.15.121:0/779313847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f235006a680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 -- 172.21.15.121:0/779313847 >> 172.21.15.121:0/779313847 conn(0x7f23500c35a0 msgr2=0x7f23500c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 -- 172.21.15.121:0/779313847 shutdown_connections 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.460+0000 7f2356d29700 1 -- 172.21.15.121:0/779313847 wait complete. 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.461+0000 7f2356d29700 1 Processor -- start 2023-08-18T20:45:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.461+0000 7f2356d29700 1 -- start start 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235006a2a0 0x7f2350149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23500c6150 0x7f23501468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501e9f40 con 0x7f23500c14a0 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501ea130 con 0x7f235006a2a0 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f2356d29700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235006e790 con 0x7f23500c6150 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f234ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f234ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43274/0 (socket says 172.21.15.121:43274) 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.462+0000 7f234ffff700 1 -- 172.21.15.121:0/1927221854 learned_addr learned my addr 172.21.15.121:0/1927221854 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 -- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23500c6150 msgr2=0x7f23501468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23500c6150 0x7f23501468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 -- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235006a2a0 msgr2=0x7f2350149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235006a2a0 0x7f2350149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 -- 172.21.15.121:0/1927221854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009550 con 0x7f23500c14a0 2023-08-18T20:45:20.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234ffff700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f233c009130 tx=0x7f233c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c003d80 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c01f070 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23501ee1a0 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c011870 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.463+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23501ede90 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.464+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235004e620 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.464+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f233c021030 con 0x7f23500c14a0 2023-08-18T20:45:20.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.465+0000 7f234d7fa700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 0x7f233406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.465+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f233c089b60 con 0x7f23500c14a0 2023-08-18T20:45:20.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.465+0000 7f2354ac5700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 0x7f233406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.465+0000 7f2354ac5700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 0x7f233406c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f23500acc80 tx=0x7f2344008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.469+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f233c055280 con 0x7f23500c14a0 2023-08-18T20:45:20.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.701+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2350074730 con 0x7f23500c14a0 2023-08-18T20:45:20.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.701+0000 7f234d7fa700 1 -- 172.21.15.121:0/1927221854 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f233c0588a0 con 0x7f23500c14a0 2023-08-18T20:45:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:20.703 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/112571641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":112571641},{"type":"v1","addr":"172.21.15.121:6837","nonce":112571641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.703+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 msgr2=0x7f233406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.703+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 0x7f233406c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f23500acc80 tx=0x7f2344008040 comp rx=0 tx=0).stop 2023-08-18T20:45:20.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 msgr2=0x7f23501ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f233c009130 tx=0x7f233c004750 comp rx=0 tx=0).stop 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 shutdown_connections 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23500c6150 0x7f23501468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f235006a2a0 0x7f2350149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f233406a0e0 0x7f233406c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 --2- 172.21.15.121:0/1927221854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23500c14a0 0x7f23501ea630 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 >> 172.21.15.121:0/1927221854 conn(0x7f23500c35a0 msgr2=0x7f23500c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:20.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 shutdown_connections 2023-08-18T20:45:20.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.704+0000 7f2356d29700 1 -- 172.21.15.121:0/1927221854 wait complete. 2023-08-18T20:45:20.706 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2023-08-18T20:45:20.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.835+0000 7f9534b1e700 1 Processor -- start 2023-08-18T20:45:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.835+0000 7f9534b1e700 1 -- start start 2023-08-18T20:45:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f953014ed30 0x7f95300c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 0x7f95300c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300a6630 con 0x7f953014ed30 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300c2260 con 0x7f95300c19d0 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f9534b1e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9530151d90 con 0x7f953014e950 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f952dd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f953014ed30 0x7f95300c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f952dd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f953014ed30 0x7f95300c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43284/0 (socket says 172.21.15.121:43284) 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f952dd9b700 1 -- 172.21.15.121:0/1153855159 learned_addr learned my addr 172.21.15.121:0/1153855159 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f952e59c700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.836+0000 7f952ed9d700 1 --2- 172.21.15.121:0/1153855159 >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 0x7f95300c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 -- 172.21.15.121:0/1153855159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 msgr2=0x7f95300c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 -- 172.21.15.121:0/1153855159 >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 msgr2=0x7f95300c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1153855159 >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 0x7f95300c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 -- 172.21.15.121:0/1153855159 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530152070 con 0x7f953014ed30 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952ed9d700 1 --2- 172.21.15.121:0/1153855159 >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 0x7f95300c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f953014ed30 0x7f95300c1490 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9530068540 tx=0x7f9520009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98aa6e0fd79868c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952d59a700 1 -- 172.21.15.121:0/1153855159 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011830 con 0x7f953014ed30 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952d59a700 1 -- 172.21.15.121:0/1153855159 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520011990 con 0x7f953014ed30 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f952d59a700 1 -- 172.21.15.121:0/1153855159 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011d20 con 0x7f953014ed30 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f9534b1e700 1 -- 172.21.15.121:0/1153855159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f953014ed30 msgr2=0x7f95300c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.837+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f953014ed30 0x7f95300c1490 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9530068540 tx=0x7f9520009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 -- 172.21.15.121:0/1153855159 shutdown_connections 2023-08-18T20:45:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1153855159 >> v2:172.21.15.122:3300/0 conn(0x7f95300c19d0 0x7f95300c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1153855159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f953014ed30 0x7f95300c1490 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 -- 172.21.15.121:0/1153855159 >> 172.21.15.121:0/1153855159 conn(0x7f95300c6b10 msgr2=0x7f95300c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 -- 172.21.15.121:0/1153855159 shutdown_connections 2023-08-18T20:45:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.838+0000 7f9534b1e700 1 -- 172.21.15.121:0/1153855159 wait complete. 2023-08-18T20:45:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.839+0000 7f9534b1e700 1 Processor -- start 2023-08-18T20:45:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.839+0000 7f9534b1e700 1 -- start start 2023-08-18T20:45:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 0x7f95301480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953014a6c0 con 0x7f95300c19d0 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953014b400 con 0x7f953014ed30 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953014c450 con 0x7f953014e950 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43288/0 (socket says 172.21.15.121:43288) 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 -- 172.21.15.121:0/1870324576 learned_addr learned my addr 172.21.15.121:0/1870324576 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:20.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952ed9d700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 0x7f95301480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 -- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 msgr2=0x7f95300c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 -- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 msgr2=0x7f95301480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 0x7f95301480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 -- 172.21.15.121:0/1870324576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520009550 con 0x7f95300c19d0 2023-08-18T20:45:20.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952ed9d700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 0x7f95301480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f952e59c700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f952400e9e0 tx=0x7f952400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524009710 con 0x7f95300c19d0 2023-08-18T20:45:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400c850 con 0x7f95300c19d0 2023-08-18T20:45:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400cbc0 con 0x7f95300c19d0 2023-08-18T20:45:20.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95300c5610 con 0x7f95300c19d0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.840+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95300c58d0 con 0x7f95300c19d0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.842+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9530074730 con 0x7f95300c19d0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.842+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f952400cd20 con 0x7f95300c19d0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.842+0000 7f951effd700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 0x7f951006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.842+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f9524088620 con 0x7f95300c19d0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.842+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 0x7f951006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:20.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.843+0000 7f952dd9b700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 0x7f951006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f953014f150 tx=0x7f9520008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:20.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:20.847+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9524057750 con 0x7f95300c19d0 2023-08-18T20:45:21.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.083+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95300c53f0 con 0x7f95300c19d0 2023-08-18T20:45:21.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.084+0000 7f951effd700 1 -- 172.21.15.121:0/1870324576 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f95240572e0 con 0x7f95300c19d0 2023-08-18T20:45:21.085 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:21.085 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/112571641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":112571641},{"type":"v1","addr":"172.21.15.121:6837","nonce":112571641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:44:47.469185+0000","modified":"2023-08-18T20:44:51.084111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2546251365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2546251365},{"type":"v1","addr":"172.21.15.121:6836","nonce":2546251365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-18T20:45:21.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 msgr2=0x7f951006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 0x7f951006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f953014f150 tx=0x7f9520008030 comp rx=0 tx=0).stop 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 msgr2=0x7f953014ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f952400e9e0 tx=0x7f952400eda0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 shutdown_connections 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953014ed30 0x7f95301480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f951006a0e0 0x7f951006c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95300c19d0 0x7f953014ba20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 --2- 172.21.15.121:0/1870324576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f953014e950 0x7f95300c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 >> 172.21.15.121:0/1870324576 conn(0x7f95300c6b10 msgr2=0x7f953014e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 shutdown_connections 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.086+0000 7f9534b1e700 1 -- 172.21.15.121:0/1870324576 wait complete. 2023-08-18T20:45:21.088 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2023-08-18T20:45:21.098 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:21.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.218+0000 7f35636b7700 1 Processor -- start 2023-08-18T20:45:21.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.218+0000 7f35636b7700 1 -- start start 2023-08-18T20:45:21.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f35636b7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f355c0c6560 0x7f355c0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f35636b7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c151be0 con 0x7f355c0c2c80 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f35636b7700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c0c20d0 con 0x7f355c0c6120 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f35636b7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c14ed20 con 0x7f355c0c6560 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3560c52700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f355c0c6560 0x7f355c0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3561c54700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f355c0c2c80 0x7f355c15bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49882/0 (socket says 172.21.15.121:49882) 2023-08-18T20:45:21.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3561c54700 1 -- 172.21.15.121:0/1522812411 learned_addr learned my addr 172.21.15.121:0/1522812411 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3560c52700 1 -- 172.21.15.121:0/1522812411 >> v1:172.21.15.122:6789/0 conn(0x7f355c0c6120 legacy=0x7f355c0bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3560c52700 1 -- 172.21.15.121:0/1522812411 >> v1:172.21.15.121:6789/0 conn(0x7f355c0c2c80 legacy=0x7f355c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3560c52700 1 -- 172.21.15.121:0/1522812411 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0c23b0 con 0x7f355c0c6560 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3553fff700 1 -- 172.21.15.121:0/1522812411 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130861004 0 0) 0x7f355c151be0 con 0x7f355c0c2c80 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3560c52700 1 --2- 172.21.15.121:0/1522812411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c6560 0x7f355c0c4a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f354c009840 tx=0x7f354c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59424456b6567bf server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3553fff700 1 -- 172.21.15.121:0/1522812411 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c004230 con 0x7f355c0c6560 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3553fff700 1 -- 172.21.15.121:0/1522812411 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c004390 con 0x7f355c0c6560 2023-08-18T20:45:21.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.219+0000 7f3553fff700 1 -- 172.21.15.121:0/1522812411 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0036a0 con 0x7f355c0c6560 2023-08-18T20:45:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 -- 172.21.15.121:0/1522812411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c6560 msgr2=0x7f355c0c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 --2- 172.21.15.121:0/1522812411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c6560 0x7f355c0c4a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f354c009840 tx=0x7f354c009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 -- 172.21.15.121:0/1522812411 shutdown_connections 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 --2- 172.21.15.121:0/1522812411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c6560 0x7f355c0c4a20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 -- 172.21.15.121:0/1522812411 >> 172.21.15.121:0/1522812411 conn(0x7f355c0c35a0 msgr2=0x7f355c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 -- 172.21.15.121:0/1522812411 shutdown_connections 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.220+0000 7f35636b7700 1 -- 172.21.15.121:0/1522812411 wait complete. 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.221+0000 7f35636b7700 1 Processor -- start 2023-08-18T20:45:21.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.221+0000 7f35636b7700 1 -- start start 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 0x7f355c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f355c0c6560 0x7f355c1e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0711e0 con 0x7f355c0c2c80 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c152cc0 con 0x7f355c0c6120 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f35636b7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c152fa0 con 0x7f355c0c6560 2023-08-18T20:45:21.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43302/0 (socket says 172.21.15.121:43302) 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 -- 172.21.15.121:0/4176940987 learned_addr learned my addr 172.21.15.121:0/4176940987 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3560c52700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 0x7f355c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561c54700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f355c0c6560 0x7f355c1e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 -- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f355c0c6560 msgr2=0x7f355c1e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f355c0c6560 0x7f355c1e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 -- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 msgr2=0x7f355c071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 0x7f355c071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 -- 172.21.15.121:0/4176940987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0094a0 con 0x7f355c0c2c80 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3560c52700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 0x7f355c071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3561453700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f355800b4a0 tx=0x7f355800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.222+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558011830 con 0x7f355c0c2c80 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.223+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558011990 con 0x7f355c0c2c80 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.223+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c153280 con 0x7f355c0c2c80 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.223+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558011d40 con 0x7f355c0c2c80 2023-08-18T20:45:21.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.223+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c072500 con 0x7f355c0c2c80 2023-08-18T20:45:21.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.224+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c071660 con 0x7f355c0c2c80 2023-08-18T20:45:21.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.224+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f355801a400 con 0x7f355c0c2c80 2023-08-18T20:45:21.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.224+0000 7f3551ffb700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 0x7f354006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.224+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f35580882c0 con 0x7f355c0c2c80 2023-08-18T20:45:21.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.224+0000 7f3560c52700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 0x7f354006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.225+0000 7f3560c52700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 0x7f354006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f354c009840 tx=0x7f354c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.229+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f355c071660 con 0x7f355c0c2c80 2023-08-18T20:45:21.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.417+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f355c074730 con 0x7f355c0c2c80 2023-08-18T20:45:21.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.418+0000 7f3551ffb700 1 -- 172.21.15.121:0/4176940987 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f3558053950 con 0x7f355c0c2c80 2023-08-18T20:45:21.419 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:21.419 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:17.879607+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:44:45.110030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:44:46.431796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6837/1099144439":"2023-08-19T20:45:14.529157+0000","172.21.15.121:6835/1099144439":"2023-08-19T20:45:14.529157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 msgr2=0x7f354006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 0x7f354006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f354c009840 tx=0x7f354c01c040 comp rx=0 tx=0).stop 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 msgr2=0x7f355c1475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f355800b4a0 tx=0x7f355800b860 comp rx=0 tx=0).stop 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 shutdown_connections 2023-08-18T20:45:21.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f355c0c6560 0x7f355c1e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f354006a0e0 0x7f354006c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f355c0c2c80 0x7f355c1475c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 --2- 172.21.15.121:0/4176940987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f355c0c6120 0x7f355c071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 >> 172.21.15.121:0/4176940987 conn(0x7f355c0c35a0 msgr2=0x7f355c06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 shutdown_connections 2023-08-18T20:45:21.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.420+0000 7f35636b7700 1 -- 172.21.15.121:0/4176940987 wait complete. 2023-08-18T20:45:21.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-08-18T20:45:21.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.553+0000 7f7c48c36700 1 Processor -- start 2023-08-18T20:45:21.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.553+0000 7f7c48c36700 1 -- start start 2023-08-18T20:45:21.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c48c36700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c4406a510 0x7f7c440c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c48c36700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7c44157c10 0x7f7c441580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c48c36700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440c21f0 con 0x7f7c440c1cf0 2023-08-18T20:45:21.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c48c36700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440c2ba0 con 0x7f7c4406a510 2023-08-18T20:45:21.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c48c36700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440c6300 con 0x7f7c44157c10 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c41d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7c440c1cf0 0x7f7c44151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49892/0 (socket says 172.21.15.121:49892) 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c41d9b700 1 -- 172.21.15.121:0/953365726 learned_addr learned my addr 172.21.15.121:0/953365726 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4259c700 1 --2- 172.21.15.121:0/953365726 >> v2:172.21.15.121:3300/0 conn(0x7f7c4406a510 0x7f7c440c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c42d9d700 1 --2- 172.21.15.121:0/953365726 >> v2:172.21.15.122:3300/0 conn(0x7f7c44157c10 0x7f7c441580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4159a700 1 -- 172.21.15.121:0/953365726 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615438735 0 0) 0x7f7c440c21f0 con 0x7f7c440c1cf0 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4159a700 1 -- 172.21.15.121:0/953365726 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2c0035b0 con 0x7f7c440c1cf0 2023-08-18T20:45:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4259c700 1 -- 172.21.15.121:0/953365726 >> v2:172.21.15.122:3300/0 conn(0x7f7c44157c10 msgr2=0x7f7c441580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4259c700 1 --2- 172.21.15.121:0/953365726 >> v2:172.21.15.122:3300/0 conn(0x7f7c44157c10 0x7f7c441580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4259c700 1 -- 172.21.15.121:0/953365726 >> v1:172.21.15.121:6789/0 conn(0x7f7c440c1cf0 legacy=0x7f7c44151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.554+0000 7f7c4259c700 1 -- 172.21.15.121:0/953365726 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440c5b20 con 0x7f7c4406a510 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c4259c700 1 --2- 172.21.15.121:0/953365726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c440c5490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c440c2900 tx=0x7f7c38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c1c0295b582502 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c4159a700 1 -- 172.21.15.121:0/953365726 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38011830 con 0x7f7c4406a510 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c4159a700 1 -- 172.21.15.121:0/953365726 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38011990 con 0x7f7c4406a510 2023-08-18T20:45:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c4159a700 1 -- 172.21.15.121:0/953365726 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38011d20 con 0x7f7c4406a510 2023-08-18T20:45:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 -- 172.21.15.121:0/953365726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 msgr2=0x7f7c440c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 --2- 172.21.15.121:0/953365726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c440c5490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c440c2900 tx=0x7f7c38009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 -- 172.21.15.121:0/953365726 shutdown_connections 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 --2- 172.21.15.121:0/953365726 >> v2:172.21.15.122:3300/0 conn(0x7f7c44157c10 0x7f7c441580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 --2- 172.21.15.121:0/953365726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c440c5490 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 -- 172.21.15.121:0/953365726 >> 172.21.15.121:0/953365726 conn(0x7f7c440c6b10 msgr2=0x7f7c440c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 -- 172.21.15.121:0/953365726 shutdown_connections 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.555+0000 7f7c48c36700 1 -- 172.21.15.121:0/953365726 wait complete. 2023-08-18T20:45:21.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 Processor -- start 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 -- start start 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 0x7f7c440ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 0x7f7c44150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4406d6d0 con 0x7f7c4406a510 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441ea9d0 con 0x7f7c44157c10 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c48c36700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440aa120 con 0x7f7c440c1cf0 2023-08-18T20:45:21.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43314/0 (socket says 172.21.15.121:43314) 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.557+0000 7f7c4259c700 1 -- 172.21.15.121:0/3835202119 learned_addr learned my addr 172.21.15.121:0/3835202119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c41d9b700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 0x7f7c440ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c42d9d700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 0x7f7c44150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 -- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 msgr2=0x7f7c440ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 0x7f7c440ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 -- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 msgr2=0x7f7c44150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 0x7f7c44150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 -- 172.21.15.121:0/3835202119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380094a0 con 0x7f7c4406a510 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c41d9b700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 0x7f7c440ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c42d9d700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 0x7f7c44150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c4259c700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009b60 tx=0x7f7c38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380038a0 con 0x7f7c4406a510 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3801f070 con 0x7f7c4406a510 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c440aa400 con 0x7f7c4406a510 2023-08-18T20:45:21.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38003c40 con 0x7f7c4406a510 2023-08-18T20:45:21.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.558+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4406d8e0 con 0x7f7c4406a510 2023-08-18T20:45:21.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.559+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c44074730 con 0x7f7c4406a510 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.560+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c38026480 con 0x7f7c4406a510 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.560+0000 7f7c32ffd700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 0x7f7c2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.560+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7c38021070 con 0x7f7c4406a510 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.560+0000 7f7c41d9b700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 0x7f7c2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.560+0000 7f7c41d9b700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 0x7f7c2406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7c440c4030 tx=0x7f7c34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.564+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7c380554b0 con 0x7f7c4406a510 2023-08-18T20:45:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.796+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f7c44072110 con 0x7f7c4406a510 2023-08-18T20:45:21.797 INFO:tasks.ceph.mon.a.smithi121.stderr:2023-08-18T20:45:21.796+0000 7f5248ffa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-18T20:45:21.803 INFO:tasks.ceph.mds.a.smithi121.stderr: -3300> 2023-08-18T20:44:52.987+0000 7fe0e8844700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:45:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.803+0000 7f7c32ffd700 1 -- 172.21.15.121:0/3835202119 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7c38015020 con 0x7f7c4406a510 2023-08-18T20:45:21.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.805+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 msgr2=0x7f7c2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 0x7f7c2406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7c440c4030 tx=0x7f7c34009040 comp rx=0 tx=0).stop 2023-08-18T20:45:21.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 msgr2=0x7f7c441ea490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009b60 tx=0x7f7c38004750 comp rx=0 tx=0).stop 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 shutdown_connections 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c44157c10 0x7f7c44150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c2406a0e0 0x7f7c2406c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c4406a510 0x7f7c441ea490 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 --2- 172.21.15.121:0/3835202119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c440c1cf0 0x7f7c440ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 >> 172.21.15.121:0/3835202119 conn(0x7f7c440c6b10 msgr2=0x7f7c44155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 shutdown_connections 2023-08-18T20:45:21.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.806+0000 7f7c48c36700 1 -- 172.21.15.121:0/3835202119 wait complete. 2023-08-18T20:45:21.808 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-18T20:45:21.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-08-18T20:45:21.833 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2023-08-18T20:45:21.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 Processor -- start 2023-08-18T20:45:21.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 -- start start 2023-08-18T20:45:21.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d540c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9d540c1cf0 0x7f9d54151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540c21f0 con 0x7f9d54151ec0 2023-08-18T20:45:21.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540c2ba0 con 0x7f9d540c1cf0 2023-08-18T20:45:21.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5913a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c6300 con 0x7f9d5406a510 2023-08-18T20:45:21.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.944+0000 7f9d5359e700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9d54151ec0 0x7f9d54157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49920/0 (socket says 172.21.15.121:49920) 2023-08-18T20:45:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d5359e700 1 -- 172.21.15.121:0/2469709437 learned_addr learned my addr 172.21.15.121:0/2469709437 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196143099 0 0) 0x7f9d540c21f0 con 0x7f9d54151ec0 2023-08-18T20:45:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c0035b0 con 0x7f9d54151ec0 2023-08-18T20:45:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d540c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d5259c700 1 --2- 172.21.15.121:0/2469709437 >> v2:172.21.15.122:3300/0 conn(0x7f9d540c1cf0 0x7f9d54151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559026209 0 0) 0x7f9d3c0035b0 con 0x7f9d54151ec0 2023-08-18T20:45:21.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 msgr2=0x7f9d540c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d540c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 >> v2:172.21.15.122:3300/0 conn(0x7f9d540c1cf0 msgr2=0x7f9d54151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 --2- 172.21.15.121:0/2469709437 >> v2:172.21.15.122:3300/0 conn(0x7f9d540c1cf0 0x7f9d54151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540c5b20 con 0x7f9d54151ec0 2023-08-18T20:45:21.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f9d4c0019f0 con 0x7f9d54151ec0 2023-08-18T20:45:21.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 >> v1:172.21.15.121:6789/0 conn(0x7f9d54151ec0 legacy=0x7f9d54157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d3c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d3c004d90 0x7f9d3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c6300 con 0x7f9d3c003a00 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c00ba10 con 0x7f9d3c004d90 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c00bb50 con 0x7f9d5406a510 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d5259c700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d3c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.945+0000 7f9d5359e700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d3c004d90 0x7f9d3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 msgr2=0x7f9d3c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406a510 0x7f9d3c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d3c004d90 msgr2=0x7f9d3c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d3c004d90 0x7f9d3c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2469709437 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0035b0 con 0x7f9d3c003a00 2023-08-18T20:45:21.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009b60 tx=0x7f9d3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89364e15f3aa2ca6 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400e6c0 con 0x7f9d3c003a00 2023-08-18T20:45:21.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400e820 con 0x7f9d3c003a00 2023-08-18T20:45:21.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d51d9b700 1 -- 172.21.15.121:0/2469709437 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400eb90 con 0x7f9d3c003a00 2023-08-18T20:45:21.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 -- 172.21.15.121:0/2469709437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 msgr2=0x7f9d3c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2469709437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009b60 tx=0x7f9d3c005880 comp rx=0 tx=0).stop 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5359e700 1 -- 172.21.15.121:0/2469709437 reap_dead start 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 -- 172.21.15.121:0/2469709437 shutdown_connections 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 -- 172.21.15.121:0/2469709437 >> 172.21.15.121:0/2469709437 conn(0x7f9d540c6b10 msgr2=0x7f9d540c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 -- 172.21.15.121:0/2469709437 shutdown_connections 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.946+0000 7f9d5913a700 1 -- 172.21.15.121:0/2469709437 wait complete. 2023-08-18T20:45:21.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.948+0000 7f9d5913a700 1 Processor -- start 2023-08-18T20:45:21.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.948+0000 7f9d5913a700 1 -- start start 2023-08-18T20:45:21.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d5414ae60 0x7f9d54157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406c920 0x7f9d5406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5406d2f0 con 0x7f9d3c003a00 2023-08-18T20:45:21.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5414b420 con 0x7f9d5414ae60 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5414b700 con 0x7f9d5406c920 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43346/0 (socket says 172.21.15.121:43346) 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2875195391 learned_addr learned my addr 172.21.15.121:0/2875195391 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406c920 msgr2=0x7f9d5406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406c920 0x7f9d5406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d5414ae60 msgr2=0x7f9d54157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d5414ae60 0x7f9d54157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 -- 172.21.15.121:0/2875195391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5414b9e0 con 0x7f9d3c003a00 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d52d9d700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c004730 tx=0x7f9d440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400e6c0 con 0x7f9d3c003a00 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44003ab0 con 0x7f9d3c003a00 2023-08-18T20:45:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5406d2f0 con 0x7f9d3c003a00 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44003e60 con 0x7f9d3c003a00 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.949+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5414bfa0 con 0x7f9d3c003a00 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.950+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54072a20 con 0x7f9d3c003a00 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.951+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d44013470 con 0x7f9d3c003a00 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.951+0000 7f9d3b7fe700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 0x7f9d4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.951+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f9d4408a0c0 con 0x7f9d3c003a00 2023-08-18T20:45:21.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.951+0000 7f9d5259c700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 0x7f9d4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:21.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.951+0000 7f9d5259c700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 0x7f9d4006c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006f10 tx=0x7f9d48006e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:21.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:21.955+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9d54072a20 con 0x7f9d3c003a00 2023-08-18T20:45:22.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.194+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9d540729f0 con 0x7f9d3c003a00 2023-08-18T20:45:22.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.802+0000 7f9d3b7fe700 1 -- 172.21.15.121:0/2875195391 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9d440558b0 con 0x7f9d3c003a00 2023-08-18T20:45:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.804+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 msgr2=0x7f9d4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.804+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 0x7f9d4006c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006f10 tx=0x7f9d48006e80 comp rx=0 tx=0).stop 2023-08-18T20:45:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.804+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 msgr2=0x7f9d541e9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.804+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c004730 tx=0x7f9d440047c0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 shutdown_connections 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9d5406c920 0x7f9d5406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f9d4006a0e0 0x7f9d4006c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c003a00 0x7f9d541e9230 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 --2- 172.21.15.121:0/2875195391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d5414ae60 0x7f9d54157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 >> 172.21.15.121:0/2875195391 conn(0x7f9d540c6b10 msgr2=0x7f9d541561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 shutdown_connections 2023-08-18T20:45:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.805+0000 7f9d5913a700 1 -- 172.21.15.121:0/2875195391 wait complete. 2023-08-18T20:45:22.820 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-08-18T20:45:22.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.990+0000 7f8e7fb39700 1 Processor -- start 2023-08-18T20:45:22.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.990+0000 7f8e7fb39700 1 -- start start 2023-08-18T20:45:22.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7fb39700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e78154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7fb39700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780c6700 con 0x7f8e780c0230 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7fb39700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780a64b0 con 0x7f8e7806d540 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7fb39700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e781554d0 con 0x7f8e7814b0c0 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7d0d4700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8e780c0230 0x7f8e7806a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49938/0 (socket says 172.21.15.121:49938) 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7d0d4700 1 -- 172.21.15.121:0/3903078201 learned_addr learned my addr 172.21.15.121:0/3903078201 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:22.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644209523 0 0) 0x7f8e780c6700 con 0x7f8e780c0230 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e640035b0 con 0x7f8e780c0230 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e78154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1012099953 0 0) 0x7f8e640035b0 con 0x7f8e780c0230 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 msgr2=0x7f8e78154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e78154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 >> v1:172.21.15.122:6789/0 conn(0x7f8e7806d540 legacy=0x7f8e7806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780a5ef0 con 0x7f8e780c0230 2023-08-18T20:45:22.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f8e68001670 con 0x7f8e780c0230 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 >> v1:172.21.15.121:6789/0 conn(0x7f8e780c0230 legacy=0x7f8e7806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e64003aa0 0x7f8e64003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64004850 0x7f8e64004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bae0 con 0x7f8e64003aa0 2023-08-18T20:45:22.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bc50 con 0x7f8e64004850 2023-08-18T20:45:22.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.991+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400be10 con 0x7f8e7814b0c0 2023-08-18T20:45:22.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e64003aa0 0x7f8e64003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:22.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d0d4700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64004850 0x7f8e64004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:22.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 -- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 msgr2=0x7f8e64005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:22.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7e0d6700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e64005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 -- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64004850 msgr2=0x7f8e64004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64004850 0x7f8e64004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 -- 172.21.15.121:0/3903078201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e640035b0 con 0x7f8e64003aa0 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7e0d6700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e7814b0c0 0x7f8e64005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e64003aa0 0x7f8e64003ec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009b60 tx=0x7f8e64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe5239f197863fb server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400e6c0 con 0x7f8e64003aa0 2023-08-18T20:45:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400e820 con 0x7f8e64003aa0 2023-08-18T20:45:22.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.992+0000 7f8e7c8d3700 1 -- 172.21.15.121:0/3903078201 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400eb90 con 0x7f8e64003aa0 2023-08-18T20:45:22.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 -- 172.21.15.121:0/3903078201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e64003aa0 msgr2=0x7f8e64003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:22.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/3903078201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e64003aa0 0x7f8e64003ec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009b60 tx=0x7f8e64005880 comp rx=0 tx=0).stop 2023-08-18T20:45:22.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7e0d6700 1 -- 172.21.15.121:0/3903078201 reap_dead start 2023-08-18T20:45:22.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 -- 172.21.15.121:0/3903078201 shutdown_connections 2023-08-18T20:45:23.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 -- 172.21.15.121:0/3903078201 >> 172.21.15.121:0/3903078201 conn(0x7f8e780a8770 msgr2=0x7f8e780a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:23.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 -- 172.21.15.121:0/3903078201 shutdown_connections 2023-08-18T20:45:23.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.993+0000 7f8e7fb39700 1 -- 172.21.15.121:0/3903078201 wait complete. 2023-08-18T20:45:23.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.994+0000 7f8e7fb39700 1 Processor -- start 2023-08-18T20:45:23.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.994+0000 7f8e7fb39700 1 -- start start 2023-08-18T20:45:23.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.994+0000 7f8e7fb39700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64003aa0 0x7f8e781ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:23.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e780c3070 0x7f8e780c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780a8300 con 0x7f8e781e6c30 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e781edec0 con 0x7f8e64003aa0 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780c10b0 con 0x7f8e780c3070 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43370/0 (socket says 172.21.15.121:43370) 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 -- 172.21.15.121:0/708193732 learned_addr learned my addr 172.21.15.121:0/708193732 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:23.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64003aa0 0x7f8e781ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7e0d6700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e780c3070 0x7f8e780c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 -- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e780c3070 msgr2=0x7f8e780c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e780c3070 0x7f8e780c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 -- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64003aa0 msgr2=0x7f8e781ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64003aa0 0x7f8e781ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 -- 172.21.15.121:0/708193732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780c1370 con 0x7f8e781e6c30 2023-08-18T20:45:23.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7d0d4700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8e680011e0 tx=0x7f8e68007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68011580 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680116e0 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68011a90 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e780c1650 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.995+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e780c1930 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.996+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7814ca90 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.997+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e68011bf0 con 0x7f8e781e6c30 2023-08-18T20:45:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.997+0000 7f8e6e7fc700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 0x7f8e5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.997+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f8e680885c0 con 0x7f8e781e6c30 2023-08-18T20:45:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.997+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 0x7f8e5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:22.997+0000 7f8e7d8d5700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 0x7f8e5c06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e740090b0 tx=0x7f8e7401f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.001+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8e7814ca90 con 0x7f8e781e6c30 2023-08-18T20:45:23.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.190+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e7814ce70 con 0x7f8e781e6c30 2023-08-18T20:45:23.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.913+0000 7f8e6e7fc700 1 -- 172.21.15.121:0/708193732 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8e7814ce70 con 0x7f8e781e6c30 2023-08-18T20:45:23.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.917+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 msgr2=0x7f8e5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:23.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.917+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 0x7f8e5c06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e740090b0 tx=0x7f8e7401f040 comp rx=0 tx=0).stop 2023-08-18T20:45:23.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.917+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 msgr2=0x7f8e781e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:23.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.917+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8e680011e0 tx=0x7f8e68007570 comp rx=0 tx=0).stop 2023-08-18T20:45:23.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 shutdown_connections 2023-08-18T20:45:23.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e780c3070 0x7f8e780c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e64003aa0 0x7f8e781ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8e5c06a0e0 0x7f8e5c06c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 --2- 172.21.15.121:0/708193732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e781e6c30 0x7f8e781e70b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 >> 172.21.15.121:0/708193732 conn(0x7f8e780a8770 msgr2=0x7f8e780c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 shutdown_connections 2023-08-18T20:45:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:23.918+0000 7f8e7fb39700 1 -- 172.21.15.121:0/708193732 wait complete. 2023-08-18T20:45:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_metadata' removed 2023-08-18T20:45:23.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-08-18T20:45:24.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.062+0000 7f2278e20700 1 Processor -- start 2023-08-18T20:45:24.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.062+0000 7f2278e20700 1 -- start start 2023-08-18T20:45:24.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2278e20700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2278e20700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f227406d540 0x7f227406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2278e20700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740c4940 con 0x7f22740c0230 2023-08-18T20:45:24.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2278e20700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740a5e50 con 0x7f227406d540 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2278e20700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740c50b0 con 0x7f227414b0c0 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f227406d540 0x7f227406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f227406d540 0x7f227406d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43380/0 (socket says 172.21.15.121:43380) 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 -- 172.21.15.121:0/853178316 learned_addr learned my addr 172.21.15.121:0/853178316 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f227259c700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 -- 172.21.15.121:0/853178316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 msgr2=0x7f2274154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 -- 172.21.15.121:0/853178316 >> v1:172.21.15.122:6789/0 conn(0x7f22740c0230 legacy=0x7f227406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:24.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.063+0000 7f2272d9d700 1 -- 172.21.15.121:0/853178316 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740a6060 con 0x7f227406d540 2023-08-18T20:45:24.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2272d9d700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227406d540 0x7f227406d9f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7487ecbb3ea4e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:24.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f227159a700 1 -- 172.21.15.121:0/853178316 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00e070 con 0x7f227406d540 2023-08-18T20:45:24.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f227159a700 1 -- 172.21.15.121:0/853178316 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00b9c0 con 0x7f227406d540 2023-08-18T20:45:24.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f227159a700 1 -- 172.21.15.121:0/853178316 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00bd70 con 0x7f227406d540 2023-08-18T20:45:24.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 -- 172.21.15.121:0/853178316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227406d540 msgr2=0x7f227406d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:24.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227406d540 0x7f227406d9f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:24.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 -- 172.21.15.121:0/853178316 shutdown_connections 2023-08-18T20:45:24.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227406d540 0x7f227406d9f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 --2- 172.21.15.121:0/853178316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 -- 172.21.15.121:0/853178316 >> 172.21.15.121:0/853178316 conn(0x7f22740a8770 msgr2=0x7f22740a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 -- 172.21.15.121:0/853178316 shutdown_connections 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.064+0000 7f2278e20700 1 -- 172.21.15.121:0/853178316 wait complete. 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 Processor -- start 2023-08-18T20:45:24.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 -- start start 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406d540 0x7f22741e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22740c42d0 con 0x7f22740c0230 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22740ac420 con 0x7f227406d540 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2278e20700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740c3720 con 0x7f227414b0c0 2023-08-18T20:45:24.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2271d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2271d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43382/0 (socket says 172.21.15.121:43382) 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.066+0000 7f2271d9b700 1 -- 172.21.15.121:0/2280109281 learned_addr learned my addr 172.21.15.121:0/2280109281 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f227259c700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406d540 0x7f22741e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2272d9d700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 -- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 msgr2=0x7f2274155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:24.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 -- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406d540 msgr2=0x7f22741e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406d540 0x7f22741e6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 -- 172.21.15.121:0/2280109281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009b30 con 0x7f22740c0230 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2271d9b700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f226400c4e0 tx=0x7f226400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22640052d0 con 0x7f22740c0230 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226400ce90 con 0x7f22740c0230 2023-08-18T20:45:24.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22740c3c10 con 0x7f22740c0230 2023-08-18T20:45:24.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264003680 con 0x7f22740c0230 2023-08-18T20:45:24.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.067+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22740c3410 con 0x7f22740c0230 2023-08-18T20:45:24.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.068+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2274074730 con 0x7f22740c0230 2023-08-18T20:45:24.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.068+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22640037e0 con 0x7f22740c0230 2023-08-18T20:45:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.069+0000 7f2262ffd700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 0x7f225406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.069+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5798+0+0 (secure 0 0 0) 0x7f22640876d0 con 0x7f22740c0230 2023-08-18T20:45:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.069+0000 7f227259c700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 0x7f225406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.069+0000 7f227259c700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 0x7f225406c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2268006b20 tx=0x7f2268008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.074+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2264052f50 con 0x7f22740c0230 2023-08-18T20:45:24.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.262+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2274154f70 con 0x7f22740c0230 2023-08-18T20:45:24.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.917+0000 7f2262ffd700 1 -- 172.21.15.121:0/2280109281 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v43) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2264056570 con 0x7f22740c0230 2023-08-18T20:45:24.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 msgr2=0x7f225406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 0x7f225406c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2268006b20 tx=0x7f2268008040 comp rx=0 tx=0).stop 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 msgr2=0x7f22741e73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f226400c4e0 tx=0x7f226400c7f0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 shutdown_connections 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f227414b0c0 0x7f2274155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406d540 0x7f22741e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f225406a0e0 0x7f225406c5a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 --2- 172.21.15.121:0/2280109281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22740c0230 0x7f22741e73a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:24.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 >> 172.21.15.121:0/2280109281 conn(0x7f22740a8770 msgr2=0x7f22740a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:24.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 shutdown_connections 2023-08-18T20:45:24.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:24.920+0000 7f2278e20700 1 -- 172.21.15.121:0/2280109281 wait complete. 2023-08-18T20:45:24.923 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_data' removed 2023-08-18T20:45:24.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-18T20:45:25.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.059+0000 7feae0636700 1 Processor -- start 2023-08-18T20:45:25.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.059+0000 7feae0636700 1 -- start start 2023-08-18T20:45:25.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feae0636700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fead80c5ae0 0x7fead8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feae0636700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80c4f40 con 0x7fead80a6290 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feae0636700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80c6120 con 0x7fead80c0c50 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feae0636700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead81551f0 con 0x7fead80c5ae0 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fead80c5ae0 0x7fead8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feaddbd1700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fead80a6290 0x7fead80c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49974/0 (socket says 172.21.15.121:49974) 2023-08-18T20:45:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feaddbd1700 1 -- 172.21.15.121:0/2860011064 learned_addr learned my addr 172.21.15.121:0/2860011064 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fead80c5ae0 0x7fead8071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43394/0 (socket says 172.21.15.121:43394) 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 -- 172.21.15.121:0/2860011064 >> v1:172.21.15.122:6789/0 conn(0x7fead80c0c50 legacy=0x7fead806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 -- 172.21.15.121:0/2860011064 >> v1:172.21.15.121:6789/0 conn(0x7fead80a6290 legacy=0x7fead80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 -- 172.21.15.121:0/2860011064 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80c63a0 con 0x7fead80c5ae0 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadebd3700 1 --2- 172.21.15.121:0/2860011064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8071b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d90 tx=0x7fead000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba423253b722d99 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.060+0000 7feadd3d0700 1 -- 172.21.15.121:0/2860011064 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000e070 con 0x7fead80c5ae0 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feadd3d0700 1 -- 172.21.15.121:0/2860011064 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000bb90 con 0x7fead80c5ae0 2023-08-18T20:45:25.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feadd3d0700 1 -- 172.21.15.121:0/2860011064 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0003a20 con 0x7fead80c5ae0 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 -- 172.21.15.121:0/2860011064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 msgr2=0x7fead8071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 --2- 172.21.15.121:0/2860011064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8071b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d90 tx=0x7fead000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 -- 172.21.15.121:0/2860011064 shutdown_connections 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 --2- 172.21.15.121:0/2860011064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8071b80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 -- 172.21.15.121:0/2860011064 >> 172.21.15.121:0/2860011064 conn(0x7fead80c6b10 msgr2=0x7fead80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 -- 172.21.15.121:0/2860011064 shutdown_connections 2023-08-18T20:45:25.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.061+0000 7feae0636700 1 -- 172.21.15.121:0/2860011064 wait complete. 2023-08-18T20:45:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 Processor -- start 2023-08-18T20:45:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- start start 2023-08-18T20:45:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead80a6290 0x7fead8149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fead80c0c50 0x7fead8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8153350 con 0x7fead80c5ae0 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80aa0a0 con 0x7fead80a6290 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead81523a0 con 0x7fead80c0c50 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43400/0 (socket says 172.21.15.121:43400) 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 -- 172.21.15.121:0/2012658168 learned_addr learned my addr 172.21.15.121:0/2012658168 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feaddbd1700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fead80c0c50 0x7fead8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feade3d2700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead80a6290 0x7fead8149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 -- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fead80c0c50 msgr2=0x7fead8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fead80c0c50 0x7fead8152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 -- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead80a6290 msgr2=0x7fead8149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead80a6290 0x7fead8149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 -- 172.21.15.121:0/2012658168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009a70 con 0x7fead80c5ae0 2023-08-18T20:45:25.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feadebd3700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fead0004560 tx=0x7fead0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0012630 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0012790 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead81dda60 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0012b40 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.063+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead81528f0 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.065+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead8074730 con 0x7fead80c5ae0 2023-08-18T20:45:25.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.066+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fead0012ca0 con 0x7fead80c5ae0 2023-08-18T20:45:25.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.066+0000 7feaceffd700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 0x7feabc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.066+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fead008a400 con 0x7fead80c5ae0 2023-08-18T20:45:25.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.066+0000 7feade3d2700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 0x7feabc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.066+0000 7feade3d2700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 0x7feabc06c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fead814a430 tx=0x7feac8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.070+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fead0055e20 con 0x7fead80c5ae0 2023-08-18T20:45:25.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.271+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fead80c4a10 con 0x7fead80c5ae0 2023-08-18T20:45:25.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.275+0000 7feaceffd700 1 -- 172.21.15.121:0/2012658168 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fead0059440 con 0x7fead80c5ae0 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 msgr2=0x7feabc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 0x7feabc06c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fead814a430 tx=0x7feac8009040 comp rx=0 tx=0).stop 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 msgr2=0x7fead8153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fead0004560 tx=0x7fead0004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 shutdown_connections 2023-08-18T20:45:25.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7feabc06a0e0 0x7feabc06c5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80c5ae0 0x7fead8153ba0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead80a6290 0x7fead8149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 --2- 172.21.15.121:0/2012658168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fead80c0c50 0x7fead8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 >> 172.21.15.121:0/2012658168 conn(0x7fead80c6b10 msgr2=0x7fead80a7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 shutdown_connections 2023-08-18T20:45:25.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.277+0000 7feae0636700 1 -- 172.21.15.121:0/2012658168 wait complete. 2023-08-18T20:45:25.289 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-08-18T20:45:25.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 Processor -- start 2023-08-18T20:45:25.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 -- start start 2023-08-18T20:45:25.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e41518e0 0x7f25e4066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f25e40c1030 0x7f25e406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e406cc30 con 0x7f25e406b7f0 2023-08-18T20:45:25.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40c0b80 con 0x7f25e40c1030 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.409+0000 7f25eb190700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4155260 con 0x7f25e41518e0 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f25e40c1030 0x7f25e406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f25e40c1030 0x7f25e406b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43406/0 (socket says 172.21.15.121:43406) 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 -- 172.21.15.121:0/2753056094 learned_addr learned my addr 172.21.15.121:0/2753056094 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e8f2c700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e41518e0 0x7f25e4066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 -- 172.21.15.121:0/2753056094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e41518e0 msgr2=0x7f25e4066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:25.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e41518e0 0x7f25e4066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 -- 172.21.15.121:0/2753056094 >> v1:172.21.15.122:6789/0 conn(0x7f25e406b7f0 legacy=0x7f25e40bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 -- 172.21.15.121:0/2753056094 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e406ce80 con 0x7f25e40c1030 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e3fff700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e40c1030 0x7f25e406b2b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f25d0006fd0 tx=0x7f25d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d1ed2f8f2466f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e37fe700 1 -- 172.21.15.121:0/2753056094 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0005e30 con 0x7f25e40c1030 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e37fe700 1 -- 172.21.15.121:0/2753056094 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0004030 con 0x7f25e40c1030 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.410+0000 7f25e37fe700 1 -- 172.21.15.121:0/2753056094 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00043e0 con 0x7f25e40c1030 2023-08-18T20:45:25.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 -- 172.21.15.121:0/2753056094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e40c1030 msgr2=0x7f25e406b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e40c1030 0x7f25e406b2b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f25d0006fd0 tx=0x7f25d0009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 -- 172.21.15.121:0/2753056094 shutdown_connections 2023-08-18T20:45:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e41518e0 0x7f25e4066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 --2- 172.21.15.121:0/2753056094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e40c1030 0x7f25e406b2b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 -- 172.21.15.121:0/2753056094 >> 172.21.15.121:0/2753056094 conn(0x7f25e40c2ca0 msgr2=0x7f25e40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:25.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 -- 172.21.15.121:0/2753056094 shutdown_connections 2023-08-18T20:45:25.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.411+0000 7f25eb190700 1 -- 172.21.15.121:0/2753056094 wait complete. 2023-08-18T20:45:25.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.412+0000 7f25eb190700 1 Processor -- start 2023-08-18T20:45:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.412+0000 7f25eb190700 1 -- start start 2023-08-18T20:45:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25e406b7f0 0x7f25e41ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e40c1030 0x7f25e414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40ab4c0 con 0x7f25e41518e0 2023-08-18T20:45:25.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41eca70 con 0x7f25e406b7f0 2023-08-18T20:45:25.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25eb190700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41ed030 con 0x7f25e40c1030 2023-08-18T20:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43414/0 (socket says 172.21.15.121:43414) 2023-08-18T20:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 -- 172.21.15.121:0/1419602048 learned_addr learned my addr 172.21.15.121:0/1419602048 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:25.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e8f2c700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25e406b7f0 0x7f25e41ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e3fff700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e40c1030 0x7f25e414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 -- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e40c1030 msgr2=0x7f25e414be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e40c1030 0x7f25e414be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 -- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25e406b7f0 msgr2=0x7f25e41ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25e406b7f0 0x7f25e41ed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 -- 172.21.15.121:0/1419602048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0009500 con 0x7f25e41518e0 2023-08-18T20:45:25.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e972d700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00cb90 tx=0x7f25dc00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.413+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc003c50 con 0x7f25e41518e0 2023-08-18T20:45:25.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.414+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc003dd0 con 0x7f25e41518e0 2023-08-18T20:45:25.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.414+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4154840 con 0x7f25e41518e0 2023-08-18T20:45:25.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.414+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00aae0 con 0x7f25e41518e0 2023-08-18T20:45:25.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.414+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e41586e0 con 0x7f25e41518e0 2023-08-18T20:45:25.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.414+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e406e460 con 0x7f25e41518e0 2023-08-18T20:45:25.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.415+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25dc00ac40 con 0x7f25e41518e0 2023-08-18T20:45:25.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.415+0000 7f25e17fa700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 0x7f25c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:25.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.415+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f25dc088330 con 0x7f25e41518e0 2023-08-18T20:45:25.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.415+0000 7f25e8f2c700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 0x7f25c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:25.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.416+0000 7f25e8f2c700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 0x7f25c806c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007a30 tx=0x7f25d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:25.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.420+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f25dc053c30 con 0x7f25e41518e0 2023-08-18T20:45:25.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.686+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f25e4074730 con 0x7f25e41518e0 2023-08-18T20:45:25.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.924+0000 7f25e17fa700 1 -- 172.21.15.121:0/1419602048 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v116) v1 ==== 159+0+0 (secure 0 0 0) 0x7f25dc057250 con 0x7f25e41518e0 2023-08-18T20:45:25.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.926+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 msgr2=0x7f25c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.926+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 0x7f25c806c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007a30 tx=0x7f25d8008040 comp rx=0 tx=0).stop 2023-08-18T20:45:25.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.926+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 msgr2=0x7f25e41e9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.926+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00cb90 tx=0x7f25dc00cea0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 shutdown_connections 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f25c806a0e0 0x7f25c806c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25e41518e0 0x7f25e41e9500 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25e406b7f0 0x7f25e41ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 --2- 172.21.15.121:0/1419602048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25e40c1030 0x7f25e414be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:25.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 >> 172.21.15.121:0/1419602048 conn(0x7f25e40c2ca0 msgr2=0x7f25e4152140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:25.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 shutdown_connections 2023-08-18T20:45:25.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:25.927+0000 7f25eb190700 1 -- 172.21.15.121:0/1419602048 wait complete. 2023-08-18T20:45:25.938 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-08-18T20:45:25.939 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-08-18T20:45:25.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-08-18T20:45:26.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.060+0000 7fe1f90de700 1 Processor -- start 2023-08-18T20:45:26.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.060+0000 7fe1f90de700 1 -- start start 2023-08-18T20:45:26.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f90de700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe1f40c0c50 0x7fe1f406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f90de700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c5ae0 0x7fe1f4071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f90de700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f40c4f40 con 0x7fe1f406a7e0 2023-08-18T20:45:26.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f90de700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40c6120 con 0x7fe1f40c0c50 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f90de700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41551f0 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f2d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe1f40c0c50 0x7fe1f406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f259c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe1f406a7e0 0x7fe1f40c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50000/0 (socket says 172.21.15.121:50000) 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.061+0000 7fe1f259c700 1 -- 172.21.15.121:0/2056969218 learned_addr learned my addr 172.21.15.121:0/2056969218 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f359e700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c5ae0 0x7fe1f4071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f2d9d700 1 -- 172.21.15.121:0/2056969218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c5ae0 msgr2=0x7fe1f4071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c5ae0 0x7fe1f4071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f2d9d700 1 -- 172.21.15.121:0/2056969218 >> v1:172.21.15.121:6789/0 conn(0x7fe1f406a7e0 legacy=0x7fe1f40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f2d9d700 1 -- 172.21.15.121:0/2056969218 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f40c63a0 con 0x7fe1f40c0c50 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f1d9b700 1 -- 172.21.15.121:0/2056969218 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974159085 0 0) 0x7fe1f40c4f40 con 0x7fe1f406a7e0 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c0c50 0x7fe1f406a2a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009840 tx=0x7fe1e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac31e755502d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f1d9b700 1 -- 172.21.15.121:0/2056969218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011830 con 0x7fe1f40c0c50 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f1d9b700 1 -- 172.21.15.121:0/2056969218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8011990 con 0x7fe1f40c0c50 2023-08-18T20:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f1d9b700 1 -- 172.21.15.121:0/2056969218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011d20 con 0x7fe1f40c0c50 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 -- 172.21.15.121:0/2056969218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c0c50 msgr2=0x7fe1f406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c0c50 0x7fe1f406a2a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009840 tx=0x7fe1e8009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 -- 172.21.15.121:0/2056969218 shutdown_connections 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c5ae0 0x7fe1f4071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2056969218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c0c50 0x7fe1f406a2a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.062+0000 7fe1f90de700 1 -- 172.21.15.121:0/2056969218 >> 172.21.15.121:0/2056969218 conn(0x7fe1f40c6b10 msgr2=0x7fe1f40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.063+0000 7fe1f90de700 1 -- 172.21.15.121:0/2056969218 shutdown_connections 2023-08-18T20:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.063+0000 7fe1f90de700 1 -- 172.21.15.121:0/2056969218 wait complete. 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.064+0000 7fe1f90de700 1 Processor -- start 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.064+0000 7fe1f90de700 1 -- start start 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 0x7fe1f414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c0c50 0x7fe1f4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40ac330 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4150f60 con 0x7fe1f406a7e0 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f90de700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4151740 con 0x7fe1f40c0c50 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43428/0 (socket says 172.21.15.121:43428) 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.065+0000 7fe1f359e700 1 -- 172.21.15.121:0/2699362781 learned_addr learned my addr 172.21.15.121:0/2699362781 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f259c700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c0c50 0x7fe1f4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 0x7fe1f414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 -- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c0c50 msgr2=0x7fe1f4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c0c50 0x7fe1f4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 -- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 msgr2=0x7fe1f414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 0x7fe1f414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 -- 172.21.15.121:0/2699362781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80094a0 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 0x7fe1f414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f359e700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007e70 tx=0x7fe1ec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:26.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00ee50 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec014420 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f4151a20 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0147d0 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.066+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f40abfc0 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.067+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f41ecd30 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.067+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1ec014930 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.068+0000 7fe1db7fe700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 0x7fe1e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.068+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe1ec088a90 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.068+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 0x7fe1e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:26.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.068+0000 7fe1f2d9d700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 0x7fe1e006c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40ac710 tx=0x7fe1e8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:26.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.072+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe1f41ecd30 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.341+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fe1f41ecd30 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.926+0000 7fe1db7fe700 1 -- 172.21.15.121:0/2699362781 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v117) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe1f41ecd30 con 0x7fe1f40c5ae0 2023-08-18T20:45:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 msgr2=0x7fe1e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 0x7fe1e006c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40ac710 tx=0x7fe1e8008030 comp rx=0 tx=0).stop 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 msgr2=0x7fe1f414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007e70 tx=0x7fe1ec00e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 shutdown_connections 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe1e006a0e0 0x7fe1e006c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1f40c5ae0 0x7fe1f414ae60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f406a7e0 0x7fe1f414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 --2- 172.21.15.121:0/2699362781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1f40c0c50 0x7fe1f4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:26.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 >> 172.21.15.121:0/2699362781 conn(0x7fe1f40c6b10 msgr2=0x7fe1f40a6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:26.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 shutdown_connections 2023-08-18T20:45:26.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:26.929+0000 7fe1f90de700 1 -- 172.21.15.121:0/2699362781 wait complete. 2023-08-18T20:45:26.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:27.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.069+0000 7fe39b758700 1 Processor -- start 2023-08-18T20:45:27.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.069+0000 7fe39b758700 1 -- start start 2023-08-18T20:45:27.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.070+0000 7fe39b758700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.070+0000 7fe39b758700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.070+0000 7fe39b758700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3940c2260 con 0x7fe39414ed30 2023-08-18T20:45:27.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.070+0000 7fe39b758700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940a6630 con 0x7fe39414e950 2023-08-18T20:45:27.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.070+0000 7fe39b758700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe394151d90 con 0x7fe394070950 2023-08-18T20:45:27.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe3994f4700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39846/0 (socket says 172.21.15.121:39846) 2023-08-18T20:45:27.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe3994f4700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53270/0 (socket says 172.21.15.121:53270) 2023-08-18T20:45:27.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 -- 172.21.15.121:0/3853955556 learned_addr learned my addr 172.21.15.121:0/3853955556 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:27.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 -- 172.21.15.121:0/3853955556 >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 msgr2=0x7fe3940c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:27.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 --2- 172.21.15.121:0/3853955556 >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 -- 172.21.15.121:0/3853955556 >> v1:172.21.15.122:6789/0 conn(0x7fe39414ed30 legacy=0x7fe3940c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe38bfff700 1 -- 172.21.15.121:0/3853955556 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535340578 0 0) 0x7fe3940c2260 con 0x7fe39414ed30 2023-08-18T20:45:27.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 -- 172.21.15.121:0/3853955556 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394152070 con 0x7fe394070950 2023-08-18T20:45:27.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe3994f4700 1 --2- 172.21.15.121:0/3853955556 >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:27.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe399cf5700 1 --2- 172.21.15.121:0/3853955556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e50 tx=0x7fe38c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7145f67b8b5c2ea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe38bfff700 1 -- 172.21.15.121:0/3853955556 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00e070 con 0x7fe394070950 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe38bfff700 1 -- 172.21.15.121:0/3853955556 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00b910 con 0x7fe394070950 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.071+0000 7fe38bfff700 1 -- 172.21.15.121:0/3853955556 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00bcc0 con 0x7fe394070950 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 -- 172.21.15.121:0/3853955556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 msgr2=0x7fe3940c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 --2- 172.21.15.121:0/3853955556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e50 tx=0x7fe38c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 -- 172.21.15.121:0/3853955556 shutdown_connections 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 --2- 172.21.15.121:0/3853955556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe3940c4b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 --2- 172.21.15.121:0/3853955556 >> v2:172.21.15.122:3300/0 conn(0x7fe39414e950 0x7fe3940c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 -- 172.21.15.121:0/3853955556 >> 172.21.15.121:0/3853955556 conn(0x7fe3940c6b10 msgr2=0x7fe3940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 -- 172.21.15.121:0/3853955556 shutdown_connections 2023-08-18T20:45:27.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.072+0000 7fe39b758700 1 -- 172.21.15.121:0/3853955556 wait complete. 2023-08-18T20:45:27.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.074+0000 7fe39b758700 1 Processor -- start 2023-08-18T20:45:27.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.074+0000 7fe39b758700 1 -- start start 2023-08-18T20:45:27.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.074+0000 7fe39b758700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe39406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.074+0000 7fe39b758700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe39414e950 0x7fe39406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe39b758700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe39b758700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940ab0d0 con 0x7fe39414ed30 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe39b758700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940aaa50 con 0x7fe39414e950 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe39b758700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39406dc80 con 0x7fe394070950 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43442/0 (socket says 172.21.15.121:43442) 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 -- 172.21.15.121:0/2229611826 learned_addr learned my addr 172.21.15.121:0/2229611826 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe3994f4700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe39406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe398cf3700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe39414e950 0x7fe39406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 -- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 msgr2=0x7fe39406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe39406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 -- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe39414e950 msgr2=0x7fe39406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe39414e950 0x7fe39406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 -- 172.21.15.121:0/2229611826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840094a0 con 0x7fe39414ed30 2023-08-18T20:45:27.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe399cf5700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe394151ed0 tx=0x7fe38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c003ea0 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0099b0 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c009b30 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.075+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c01b670 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.076+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3940aa770 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.076+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394074730 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.077+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe38c01b7d0 con 0x7fe39414ed30 2023-08-18T20:45:27.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.077+0000 7fe389ffb700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 0x7fe37806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.077+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe38c089c70 con 0x7fe39414ed30 2023-08-18T20:45:27.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.077+0000 7fe3994f4700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 0x7fe37806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.078+0000 7fe3994f4700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 0x7fe37806c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe384009d00 tx=0x7fe384008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.082+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe38c0555f0 con 0x7fe39414ed30 2023-08-18T20:45:27.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.271+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3940713d0 con 0x7fe39414ed30 2023-08-18T20:45:27.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.272+0000 7fe389ffb700 1 -- 172.21.15.121:0/2229611826 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14892 (secure 0 0 0) 0x7fe38c058c10 con 0x7fe39414ed30 2023-08-18T20:45:27.271 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:27.271 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:24.911820+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6836/2546251365":"2023-08-19T20:45:21.797737+0000","172.21.15.121:6834/2546251365":"2023-08-19T20:45:21.797737+0000","172.21.15.121:6835/1099144439":"2023-08-19T20:45:14.529157+0000","172.21.15.121:6837/1099144439":"2023-08-19T20:45:14.529157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:27.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 msgr2=0x7fe37806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 0x7fe37806c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe384009d00 tx=0x7fe384008040 comp rx=0 tx=0).stop 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 msgr2=0x7fe3940abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe394151ed0 tx=0x7fe38c004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 shutdown_connections 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe37806a0e0 0x7fe37806c5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe39414ed30 0x7fe3940abee0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe394070950 0x7fe39406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 --2- 172.21.15.121:0/2229611826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe39414e950 0x7fe39406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 >> 172.21.15.121:0/2229611826 conn(0x7fe3940c6b10 msgr2=0x7fe3941da7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 shutdown_connections 2023-08-18T20:45:27.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.274+0000 7fe39b758700 1 -- 172.21.15.121:0/2229611826 wait complete. 2023-08-18T20:45:27.285 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:27.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:27.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.410+0000 7f6bf0737700 1 Processor -- start 2023-08-18T20:45:27.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.410+0000 7f6bf0737700 1 -- start start 2023-08-18T20:45:27.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bf0737700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be80c0c50 0x7f6be806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bf0737700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6be80c5ae0 0x7f6be8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bf0737700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80c4f40 con 0x7f6be806a7e0 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bf0737700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80c6120 con 0x7f6be80c5ae0 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bf0737700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81551f0 con 0x7f6be80c0c50 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6beecd4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6be80c5ae0 0x7f6be8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bedcd2700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6be806a7e0 0x7f6be80c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50030/0 (socket says 172.21.15.121:50030) 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bedcd2700 1 -- 172.21.15.121:0/2019385544 learned_addr learned my addr 172.21.15.121:0/2019385544 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.411+0000 7f6bee4d3700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be80c0c50 0x7f6be806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6beecd4700 1 -- 172.21.15.121:0/2019385544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be80c0c50 msgr2=0x7f6be806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6beecd4700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be80c0c50 0x7f6be806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6beecd4700 1 -- 172.21.15.121:0/2019385544 >> v1:172.21.15.121:6789/0 conn(0x7f6be806a7e0 legacy=0x7f6be80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6beecd4700 1 -- 172.21.15.121:0/2019385544 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80c63a0 con 0x7f6be80c5ae0 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6beecd4700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c5ae0 0x7f6be8071b80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009d90 tx=0x7f6be000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7817e9a6f37f183 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bed4d1700 1 -- 172.21.15.121:0/2019385544 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000e070 con 0x7f6be80c5ae0 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bed4d1700 1 -- 172.21.15.121:0/2019385544 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000bbd0 con 0x7f6be80c5ae0 2023-08-18T20:45:27.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bed4d1700 1 -- 172.21.15.121:0/2019385544 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0012430 con 0x7f6be80c5ae0 2023-08-18T20:45:27.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 -- 172.21.15.121:0/2019385544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c5ae0 msgr2=0x7f6be8071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c5ae0 0x7f6be8071b80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009d90 tx=0x7f6be000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 -- 172.21.15.121:0/2019385544 shutdown_connections 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c5ae0 0x7f6be8071b80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 --2- 172.21.15.121:0/2019385544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be80c0c50 0x7f6be806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.412+0000 7f6bf0737700 1 -- 172.21.15.121:0/2019385544 >> 172.21.15.121:0/2019385544 conn(0x7f6be80c6b10 msgr2=0x7f6be80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.413+0000 7f6bf0737700 1 -- 172.21.15.121:0/2019385544 shutdown_connections 2023-08-18T20:45:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.413+0000 7f6bf0737700 1 -- 172.21.15.121:0/2019385544 wait complete. 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 Processor -- start 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 -- start start 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be806a7e0 0x7f6be81ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 0x7f6be81e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81ed6c0 con 0x7f6be80c0c50 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be8157390 con 0x7f6be80c5ae0 2023-08-18T20:45:27.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bf0737700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81566c0 con 0x7f6be806a7e0 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bedcd2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bedcd2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43454/0 (socket says 172.21.15.121:43454) 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.414+0000 7f6bedcd2700 1 -- 172.21.15.121:0/689074234 learned_addr learned my addr 172.21.15.121:0/689074234 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bee4d3700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be806a7e0 0x7f6be81ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6beecd4700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 0x7f6be81e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 -- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be806a7e0 msgr2=0x7f6be81ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be806a7e0 0x7f6be81ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 -- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 msgr2=0x7f6be81e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 0x7f6be81e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 -- 172.21.15.121:0/689074234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009a70 con 0x7f6be80c0c50 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6beecd4700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 0x7f6be81e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bedcd2700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c480 tx=0x7f6be400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4005d70 con 0x7f6be80c0c50 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40070d0 con 0x7f6be80c0c50 2023-08-18T20:45:27.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be81e0df0 con 0x7f6be80c0c50 2023-08-18T20:45:27.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007440 con 0x7f6be80c0c50 2023-08-18T20:45:27.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.415+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be81569f0 con 0x7f6be80c0c50 2023-08-18T20:45:27.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.416+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be81574d0 con 0x7f6be80c0c50 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.416+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6be40075a0 con 0x7f6be80c0c50 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.417+0000 7f6bdeffd700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 0x7f6bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.417+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6be4087690 con 0x7f6be80c0c50 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.417+0000 7f6bee4d3700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 0x7f6bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.417+0000 7f6bee4d3700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 0x7f6bcc06c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009930 tx=0x7f6bd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.421+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6be81574d0 con 0x7f6be80c0c50 2023-08-18T20:45:27.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.611+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6be81574d0 con 0x7f6be80c0c50 2023-08-18T20:45:27.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.611+0000 7f6bdeffd700 1 -- 172.21.15.121:0/689074234 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6be81574d0 con 0x7f6be80c0c50 2023-08-18T20:45:27.611 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:27.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 msgr2=0x7f6bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 0x7f6bcc06c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009930 tx=0x7f6bd8008040 comp rx=0 tx=0).stop 2023-08-18T20:45:27.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 msgr2=0x7f6be81e0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c480 tx=0x7f6be400c840 comp rx=0 tx=0).stop 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 shutdown_connections 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be80c5ae0 0x7f6be81e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6be806a7e0 0x7f6be81ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6bcc06a0e0 0x7f6bcc06c5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 --2- 172.21.15.121:0/689074234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6be80c0c50 0x7f6be81e0370 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 >> 172.21.15.121:0/689074234 conn(0x7f6be80c6b10 msgr2=0x7f6be80c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 shutdown_connections 2023-08-18T20:45:27.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.613+0000 7f6bf0737700 1 -- 172.21.15.121:0/689074234 wait complete. 2023-08-18T20:45:27.625 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:27.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.747+0000 7f40f00a8700 1 Processor -- start 2023-08-18T20:45:27.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.747+0000 7f40f00a8700 1 -- start start 2023-08-18T20:45:27.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40f00a8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40f00a8700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40f00a8700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e80c21f0 con 0x7f40e8151ec0 2023-08-18T20:45:27.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40f00a8700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e80c2ba0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40f00a8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80c6300 con 0x7f40e806a510 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40ed643700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40ede44700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40ed643700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53300/0 (socket says 172.21.15.121:53300) 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40ede44700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39870/0 (socket says 172.21.15.121:39870) 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.748+0000 7f40ed643700 1 -- 172.21.15.121:0/1628068314 learned_addr learned my addr 172.21.15.121:0/1628068314 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:27.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ede44700 1 -- 172.21.15.121:0/1628068314 >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 msgr2=0x7f40e8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:27.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ede44700 1 --2- 172.21.15.121:0/1628068314 >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ede44700 1 -- 172.21.15.121:0/1628068314 >> v1:172.21.15.122:6789/0 conn(0x7f40e8151ec0 legacy=0x7f40e8157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ede44700 1 -- 172.21.15.121:0/1628068314 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80c5b20 con 0x7f40e806a510 2023-08-18T20:45:27.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ed643700 1 --2- 172.21.15.121:0/1628068314 >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:27.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ede44700 1 --2- 172.21.15.121:0/1628068314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009840 tx=0x7f40d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163bad0676caafd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ece42700 1 -- 172.21.15.121:0/1628068314 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8011830 con 0x7f40e806a510 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ece42700 1 -- 172.21.15.121:0/1628068314 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8011990 con 0x7f40e806a510 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40ece42700 1 -- 172.21.15.121:0/1628068314 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8011d20 con 0x7f40e806a510 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40f00a8700 1 -- 172.21.15.121:0/1628068314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 msgr2=0x7f40e80c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.749+0000 7f40f00a8700 1 --2- 172.21.15.121:0/1628068314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009840 tx=0x7f40d8009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:27.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 -- 172.21.15.121:0/1628068314 shutdown_connections 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 --2- 172.21.15.121:0/1628068314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e806a510 0x7f40e80c5490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 --2- 172.21.15.121:0/1628068314 >> v2:172.21.15.122:3300/0 conn(0x7f40e80c1cf0 0x7f40e8151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 -- 172.21.15.121:0/1628068314 >> 172.21.15.121:0/1628068314 conn(0x7f40e80c6b10 msgr2=0x7f40e80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 -- 172.21.15.121:0/1628068314 shutdown_connections 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.750+0000 7f40f00a8700 1 -- 172.21.15.121:0/1628068314 wait complete. 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.751+0000 7f40f00a8700 1 Processor -- start 2023-08-18T20:45:27.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.751+0000 7f40f00a8700 1 -- start start 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 0x7f40e80a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e8151ec0 0x7f40e80ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e81edad0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8156660 con 0x7f40e806a510 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40f00a8700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e814cf10 con 0x7f40e8151ec0 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43468/0 (socket says 172.21.15.121:43468) 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 -- 172.21.15.121:0/3522722934 learned_addr learned my addr 172.21.15.121:0/3522722934 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ede44700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 0x7f40e80a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ee645700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e8151ec0 0x7f40e80ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 -- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e8151ec0 msgr2=0x7f40e80ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e8151ec0 0x7f40e80ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 -- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 msgr2=0x7f40e80a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 0x7f40e80a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ed643700 1 -- 172.21.15.121:0/3522722934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009550 con 0x7f40e80c1cf0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.752+0000 7f40ede44700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 0x7f40e80a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40ed643700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f40e400ebe0 tx=0x7f40e4009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400c8b0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400ca10 con 0x7f40e80c1cf0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400cd80 con 0x7f40e80c1cf0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d80094a0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.753+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e81edd70 con 0x7f40e80c1cf0 2023-08-18T20:45:27.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.754+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e80aa9f0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.754+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40e4013470 con 0x7f40e80c1cf0 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.755+0000 7f40de7fc700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 0x7f40cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.755+0000 7f40ede44700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 0x7f40cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.755+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f40e40883f0 con 0x7f40e80c1cf0 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.755+0000 7f40ede44700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 0x7f40cc06c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:27.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.759+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f40e4053e10 con 0x7f40e80c1cf0 2023-08-18T20:45:27.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.949+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40e8074730 con 0x7f40e80c1cf0 2023-08-18T20:45:27.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.950+0000 7f40de7fc700 1 -- 172.21.15.121:0/3522722934 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40e4057430 con 0x7f40e80c1cf0 2023-08-18T20:45:27.950 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:27.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 msgr2=0x7f40cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 0x7f40cc06c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d801c040 comp rx=0 tx=0).stop 2023-08-18T20:45:27.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 msgr2=0x7f40e80aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:27.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f40e400ebe0 tx=0x7f40e4009e70 comp rx=0 tx=0).stop 2023-08-18T20:45:27.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 shutdown_connections 2023-08-18T20:45:27.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40e8151ec0 0x7f40e80ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e806a510 0x7f40e80a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f40cc06a0e0 0x7f40cc06c5a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 --2- 172.21.15.121:0/3522722934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40e80c1cf0 0x7f40e80aaba0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:27.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 >> 172.21.15.121:0/3522722934 conn(0x7f40e80c6b10 msgr2=0x7f40e8155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:27.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 shutdown_connections 2023-08-18T20:45:27.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:27.952+0000 7f40f00a8700 1 -- 172.21.15.121:0/3522722934 wait complete. 2023-08-18T20:45:27.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-18T20:45:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.088+0000 7f3c32ff6700 1 Processor -- start 2023-08-18T20:45:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.088+0000 7f3c32ff6700 1 -- start start 2023-08-18T20:45:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c32ff6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c2c0a6290 0x7f3c2c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c32ff6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c32ff6700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2c0c4f40 con 0x7f3c2c0c0c50 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c32ff6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c5e50 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c32ff6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c6120 con 0x7f3c2c0a6290 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43478/0 (socket says 172.21.15.121:43478) 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 -- 172.21.15.121:0/1833244323 learned_addr learned my addr 172.21.15.121:0/1833244323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c2bfff700 1 --2- 172.21.15.121:0/1833244323 >> v2:172.21.15.122:3300/0 conn(0x7f3c2c0a6290 0x7f3c2c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 -- 172.21.15.121:0/1833244323 >> v2:172.21.15.122:3300/0 conn(0x7f3c2c0a6290 msgr2=0x7f3c2c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 --2- 172.21.15.121:0/1833244323 >> v2:172.21.15.122:3300/0 conn(0x7f3c2c0a6290 0x7f3c2c0c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 -- 172.21.15.121:0/1833244323 >> v1:172.21.15.122:6789/0 conn(0x7f3c2c0c0c50 legacy=0x7f3c2c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 -- 172.21.15.121:0/1833244323 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c1551f0 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c31593700 1 --2- 172.21.15.121:0/1833244323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0c45c0 tx=0x7f3c2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5baddaaa7751a62 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.089+0000 7f3c2b7fe700 1 -- 172.21.15.121:0/1833244323 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400e070 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c2b7fe700 1 -- 172.21.15.121:0/1833244323 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24003a20 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c2b7fe700 1 -- 172.21.15.121:0/1833244323 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24003dd0 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 -- 172.21.15.121:0/1833244323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0c1b10 msgr2=0x7f3c2c0c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/1833244323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0c45c0 tx=0x7f3c2400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 -- 172.21.15.121:0/1833244323 shutdown_connections 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/1833244323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c0c5910 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/1833244323 >> v2:172.21.15.122:3300/0 conn(0x7f3c2c0a6290 0x7f3c2c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 -- 172.21.15.121:0/1833244323 >> 172.21.15.121:0/1833244323 conn(0x7f3c2c0c6b10 msgr2=0x7f3c2c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:28.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 -- 172.21.15.121:0/1833244323 shutdown_connections 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.090+0000 7f3c32ff6700 1 -- 172.21.15.121:0/1833244323 wait complete. 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.091+0000 7f3c32ff6700 1 Processor -- start 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.091+0000 7f3c32ff6700 1 -- start start 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c2c0c0c50 0x7f3c2c1eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c1ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1e9ce0 con 0x7f3c2c0a6290 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0ac7f0 con 0x7f3c2c0c1b10 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c32ff6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1ea240 con 0x7f3c2c0c0c50 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43480/0 (socket says 172.21.15.121:43480) 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 -- 172.21.15.121:0/16129990 learned_addr learned my addr 172.21.15.121:0/16129990 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c2bfff700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c2c0c0c50 0x7f3c2c1eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c31593700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c1ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 -- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c2c0c0c50 msgr2=0x7f3c2c1eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c2c0c0c50 0x7f3c2c1eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 -- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 msgr2=0x7f3c2c1ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.092+0000 7f3c30d92700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c1ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c30d92700 1 -- 172.21.15.121:0/16129990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009b30 con 0x7f3c2c0a6290 2023-08-18T20:45:28.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c31593700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c1ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:28.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c30d92700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c4d0 tx=0x7f3c2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20011790 con 0x7f3c2c0a6290 2023-08-18T20:45:28.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c200118f0 con 0x7f3c2c0a6290 2023-08-18T20:45:28.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c1ee170 con 0x7f3c2c0a6290 2023-08-18T20:45:28.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20011ca0 con 0x7f3c2c0a6290 2023-08-18T20:45:28.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.093+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c1eac10 con 0x7f3c2c0a6290 2023-08-18T20:45:28.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.094+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c0c7a50 con 0x7f3c2c0a6290 2023-08-18T20:45:28.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.094+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c2001c460 con 0x7f3c2c0a6290 2023-08-18T20:45:28.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.095+0000 7f3c297fa700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 0x7f3c1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.095+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3c20088070 con 0x7f3c2c0a6290 2023-08-18T20:45:28.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.095+0000 7f3c2bfff700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 0x7f3c1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.095+0000 7f3c2bfff700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 0x7f3c1006c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0acb90 tx=0x7f3c18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.099+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3c20053a90 con 0x7f3c2c0a6290 2023-08-18T20:45:28.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.288+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3c2c074730 con 0x7f3c2c0a6290 2023-08-18T20:45:28.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.294+0000 7f3c297fa700 1 -- 172.21.15.121:0/16129990 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c200570b0 con 0x7f3c2c0a6290 2023-08-18T20:45:28.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 msgr2=0x7f3c1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 0x7f3c1006c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0acb90 tx=0x7f3c18008040 comp rx=0 tx=0).stop 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 msgr2=0x7f3c2c1edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c4d0 tx=0x7f3c2000c890 comp rx=0 tx=0).stop 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 shutdown_connections 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c2c0c1b10 0x7f3c2c1ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3c1006a0e0 0x7f3c1006c5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c2c0a6290 0x7f3c2c1edc30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 --2- 172.21.15.121:0/16129990 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c2c0c0c50 0x7f3c2c1eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 >> 172.21.15.121:0/16129990 conn(0x7f3c2c0c6b10 msgr2=0x7f3c2c0a75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:28.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 shutdown_connections 2023-08-18T20:45:28.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.296+0000 7f3c32ff6700 1 -- 172.21.15.121:0/16129990 wait complete. 2023-08-18T20:45:28.307 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-18T20:45:28.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:45:28.351 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-18T20:45:28.403 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-18T20:45:28.404 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:28.404 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:28.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13297 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-18T20:45:28.422 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:28.422 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:28.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16734 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-18T20:45:28.443 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-18T20:45:28.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:28.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.581+0000 7fc260b9f700 1 Processor -- start 2023-08-18T20:45:28.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.581+0000 7fc260b9f700 1 -- start start 2023-08-18T20:45:28.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc260b9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc25c0bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc260b9f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc25c0c14a0 0x7fc25c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc260b9f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c152050 con 0x7fc25c0c6150 2023-08-18T20:45:28.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc260b9f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25c0bbbf0 con 0x7fc25c0c14a0 2023-08-18T20:45:28.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc260b9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c154400 con 0x7fc25c06a2a0 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc25ad9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc25c0c6150 0x7fc25c154be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50074/0 (socket says 172.21.15.121:50074) 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.582+0000 7fc25ad9d700 1 -- 172.21.15.121:0/4084670667 learned_addr learned my addr 172.21.15.121:0/4084670667 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc25c0bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc259d9b700 1 --2- 172.21.15.121:0/4084670667 >> v2:172.21.15.122:3300/0 conn(0x7fc25c0c14a0 0x7fc25c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346521975 0 0) 0x7fc25c152050 con 0x7fc25c0c6150 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2440035b0 con 0x7fc25c0c6150 2023-08-18T20:45:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529418610 0 0) 0x7fc2440035b0 con 0x7fc25c0c6150 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 msgr2=0x7fc25c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc25c0bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 >> v2:172.21.15.122:3300/0 conn(0x7fc25c0c14a0 msgr2=0x7fc25c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 --2- 172.21.15.121:0/4084670667 >> v2:172.21.15.122:3300/0 conn(0x7fc25c0c14a0 0x7fc25c06a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c0bcfd0 con 0x7fc25c0c6150 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fc2540019f0 con 0x7fc25c0c6150 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 >> v1:172.21.15.121:6789/0 conn(0x7fc25c0c6150 legacy=0x7fc25c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc244003a70 0x7fc244003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc244004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244004d90 0x7fc244005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0bbbf0 con 0x7fc244003a70 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c154400 con 0x7fc244004d90 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24400ba10 con 0x7fc25c06a2a0 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc244003a70 0x7fc244003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc259d9b700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc244004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25ad9d700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244004d90 0x7fc244005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 -- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 msgr2=0x7fc244004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c06a2a0 0x7fc244004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 -- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244004d90 msgr2=0x7fc244005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244004d90 0x7fc244005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25a59c700 1 -- 172.21.15.121:0/4084670667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440035b0 con 0x7fc244003a70 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.583+0000 7fc25ad9d700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244004d90 0x7fc244005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:28.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc25a59c700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc244003a70 0x7fc244003e90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc250009b60 tx=0x7fc244005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120cc5e4c0f5b75d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000e6c0 con 0x7fc244003a70 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25000e820 con 0x7fc244003a70 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc25959a700 1 -- 172.21.15.121:0/4084670667 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000eb90 con 0x7fc244003a70 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 -- 172.21.15.121:0/4084670667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc244003a70 msgr2=0x7fc244003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 --2- 172.21.15.121:0/4084670667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc244003a70 0x7fc244003e90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc250009b60 tx=0x7fc244005880 comp rx=0 tx=0).stop 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc25ad9d700 1 -- 172.21.15.121:0/4084670667 reap_dead start 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 -- 172.21.15.121:0/4084670667 shutdown_connections 2023-08-18T20:45:28.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 -- 172.21.15.121:0/4084670667 >> 172.21.15.121:0/4084670667 conn(0x7fc25c0c35a0 msgr2=0x7fc25c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:28.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 -- 172.21.15.121:0/4084670667 shutdown_connections 2023-08-18T20:45:28.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.584+0000 7fc260b9f700 1 -- 172.21.15.121:0/4084670667 wait complete. 2023-08-18T20:45:28.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 Processor -- start 2023-08-18T20:45:28.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 -- start start 2023-08-18T20:45:28.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244003a70 0x7fc25c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c146e20 0x7fc25c1eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c158140 con 0x7fc25c14c950 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c06d950 con 0x7fc244003a70 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc260b9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c06cdd0 con 0x7fc25c146e20 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc259d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc259d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43502/0 (socket says 172.21.15.121:43502) 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc259d9b700 1 -- 172.21.15.121:0/572823973 learned_addr learned my addr 172.21.15.121:0/572823973 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:28.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.586+0000 7fc25ad9d700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c146e20 0x7fc25c1eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc25a59c700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244003a70 0x7fc25c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 -- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c146e20 msgr2=0x7fc25c1eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c146e20 0x7fc25c1eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 -- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244003a70 msgr2=0x7fc25c14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244003a70 0x7fc25c14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 -- 172.21.15.121:0/572823973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c06d0b0 con 0x7fc25c14c950 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc259d9b700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc24c011aa0 tx=0x7fc24c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00f9e0 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00fb40 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c06d390 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c014440 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.587+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c06c9f0 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.588+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c1eb210 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.588+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc24c0145a0 con 0x7fc25c14c950 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.589+0000 7fc24affd700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 0x7fc23c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:28.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.589+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc24c088a20 con 0x7fc25c14c950 2023-08-18T20:45:28.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.589+0000 7fc25a59c700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 0x7fc23c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:28.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.589+0000 7fc25a59c700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 0x7fc23c06c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc2500090b0 tx=0x7fc250008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:28.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.593+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc24c0543a0 con 0x7fc25c14c950 2023-08-18T20:45:28.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.823+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc25c0bd570 con 0x7fc25c14c950 2023-08-18T20:45:28.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.823+0000 7fc24affd700 1 -- 172.21.15.121:0/572823973 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fc25c0bd570 con 0x7fc25c14c950 2023-08-18T20:45:28.824 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:28.824 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/251064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":251064883},{"type":"v1","addr":"172.21.15.122:6834","nonce":251064883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2609018085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":2609018085},{"type":"v1","addr":"172.21.15.122:6835","nonce":2609018085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/112571641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":112571641},{"type":"v1","addr":"172.21.15.121:6837","nonce":112571641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2691025847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2691025847},{"type":"v1","addr":"172.21.15.121:6836","nonce":2691025847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-08-18T20:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 msgr2=0x7fc23c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 0x7fc23c06c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc2500090b0 tx=0x7fc250008030 comp rx=0 tx=0).stop 2023-08-18T20:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 msgr2=0x7fc25c1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc24c011aa0 tx=0x7fc24c011e60 comp rx=0 tx=0).stop 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 shutdown_connections 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc25c146e20 0x7fc25c1eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc244003a70 0x7fc25c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fc23c06a0e0 0x7fc23c06c5a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.825+0000 7fc260b9f700 1 --2- 172.21.15.121:0/572823973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc25c14c950 0x7fc25c1468e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.826+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 >> 172.21.15.121:0/572823973 conn(0x7fc25c0c35a0 msgr2=0x7fc25c154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.826+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 shutdown_connections 2023-08-18T20:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:28.826+0000 7fc260b9f700 1 -- 172.21.15.121:0/572823973 wait complete. 2023-08-18T20:45:28.827 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 24 2023-08-18T20:45:28.838 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-18T20:45:28.838 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-18T20:45:28.838 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-18T20:45:28.839 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:45:28.839 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-18T20:45:28.839 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-18T20:45:28.839 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-18T20:45:28.840 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:45:28.840 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-18T20:45:28.840 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-18T20:45:28.840 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-18T20:45:28.840 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:45:28.841 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-18T20:45:28.841 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-18T20:45:28.841 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-18T20:45:28.841 INFO:teuthology.orchestra.run:waiting for 300 2023-08-18T20:45:28.847 INFO:tasks.ceph.mds.a:Stopped 2023-08-18T20:45:28.848 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-18T20:45:28.849 INFO:tasks.ceph.mds.c:Stopped 2023-08-18T20:45:28.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-18T20:45:28.854 INFO:tasks.ceph.mds.d:Stopped 2023-08-18T20:45:28.854 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-18T20:45:28.855 INFO:tasks.ceph.mds.b:Stopped 2023-08-18T20:45:28.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-18T20:45:28.890 INFO:tasks.ceph.mds.a:Started 2023-08-18T20:45:28.891 DEBUG:teuthology.parallel:result is None 2023-08-18T20:45:28.892 INFO:tasks.ceph.mds.c:Started 2023-08-18T20:45:28.892 DEBUG:teuthology.parallel:result is None 2023-08-18T20:45:28.896 INFO:tasks.ceph.mds.d:Started 2023-08-18T20:45:28.897 DEBUG:teuthology.parallel:result is None 2023-08-18T20:45:28.898 INFO:tasks.ceph.mds.b:Started 2023-08-18T20:45:28.898 DEBUG:teuthology.parallel:result is None 2023-08-18T20:45:28.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-18T20:45:28.970 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2023-08-18T20:45:28.971 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2023-08-18T20:45:28.984 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-08-18T20:45:28.984 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-08-18T20:45:29.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.026+0000 7f7c2d0ef700 1 Processor -- start 2023-08-18T20:45:29.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.026+0000 7f7c2d0ef700 1 -- start start 2023-08-18T20:45:29.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2d0ef700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c280c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2d0ef700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c28070150 0x7f7c2806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2d0ef700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c28150d80 con 0x7f7c280c37c0 2023-08-18T20:45:29.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2d0ef700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280c10c0 con 0x7f7c28070150 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2d0ef700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c2510 con 0x7f7c2814a8c0 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2759e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c28070150 0x7f7c2806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2759e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c28070150 0x7f7c2806b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43536/0 (socket says 172.21.15.121:43536) 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c2759e700 1 -- 172.21.15.121:0/592367839 learned_addr learned my addr 172.21.15.121:0/592367839 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.027+0000 7f7c26d9d700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c280c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2759e700 1 -- 172.21.15.121:0/592367839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 msgr2=0x7f7c280c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:29.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2759e700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c280c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:29.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2759e700 1 -- 172.21.15.121:0/592367839 >> v1:172.21.15.122:6789/0 conn(0x7f7c280c37c0 legacy=0x7f7c28151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:29.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2759e700 1 -- 172.21.15.121:0/592367839 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280c2a90 con 0x7f7c28070150 2023-08-18T20:45:29.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2759e700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c28070150 0x7f7c2806b2b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009e50 tx=0x7f7c2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187d35a626a61067 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:29.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c25d9b700 1 -- 172.21.15.121:0/592367839 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000e070 con 0x7f7c28070150 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c25d9b700 1 -- 172.21.15.121:0/592367839 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20003a70 con 0x7f7c28070150 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c25d9b700 1 -- 172.21.15.121:0/592367839 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20003e20 con 0x7f7c28070150 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/592367839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c28070150 msgr2=0x7f7c2806b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c28070150 0x7f7c2806b2b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009e50 tx=0x7f7c2000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/592367839 shutdown_connections 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c28070150 0x7f7c2806b2b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/592367839 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c280c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:29.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/592367839 >> 172.21.15.121:0/592367839 conn(0x7f7c280c2ca0 msgr2=0x7f7c280c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:29.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/592367839 shutdown_connections 2023-08-18T20:45:29.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.028+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/592367839 wait complete. 2023-08-18T20:45:29.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.030+0000 7f7c2d0ef700 1 Processor -- start 2023-08-18T20:45:29.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.030+0000 7f7c2d0ef700 1 -- start start 2023-08-18T20:45:29.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.030+0000 7f7c2d0ef700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 0x7f7c280c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.030+0000 7f7c2d0ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c28148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2814b140 con 0x7f7c280c37c0 2023-08-18T20:45:29.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28152e80 con 0x7f7c28070150 2023-08-18T20:45:29.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281533b0 con 0x7f7c2814a8c0 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 0x7f7c280c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43540/0 (socket says 172.21.15.121:43540) 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2659c700 1 -- 172.21.15.121:0/2865516120 learned_addr learned my addr 172.21.15.121:0/2865516120 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2759e700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c28148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.036 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 -- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 msgr2=0x7f7c28148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c28148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 -- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 msgr2=0x7f7c28148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 -- 172.21.15.121:0/2865516120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20009b30 con 0x7f7c28070150 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2659c700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2759e700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c28148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:29.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c26d9d700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 0x7f7c280c4a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00e810 tx=0x7f7c1c00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:29.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00c070 con 0x7f7c28070150 2023-08-18T20:45:29.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c013610 con 0x7f7c28070150 2023-08-18T20:45:29.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0139a0 con 0x7f7c28070150 2023-08-18T20:45:29.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c281530d0 con 0x7f7c28070150 2023-08-18T20:45:29.038 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.031+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280c4f80 con 0x7f7c28070150 2023-08-18T20:45:29.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.032+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2814b2f0 con 0x7f7c28070150 2023-08-18T20:45:29.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.033+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c1c013b00 con 0x7f7c28070150 2023-08-18T20:45:29.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.033+0000 7f7c0f7fe700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 0x7f7c1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:29.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.033+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7c1c087f70 con 0x7f7c28070150 2023-08-18T20:45:29.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.033+0000 7f7c2659c700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 0x7f7c1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:29.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.034+0000 7f7c2659c700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 0x7f7c1406c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c28154bf0 tx=0x7f7c180038e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:29.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.038+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7c1c0538f0 con 0x7f7c28070150 2023-08-18T20:45:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:29.242+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7c2814c7e0 con 0x7f7c28070150 2023-08-18T20:45:30.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.908+0000 7f7c0f7fe700 1 -- 172.21.15.121:0/2865516120 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7c1c013db0 con 0x7f7c28070150 2023-08-18T20:45:30.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 msgr2=0x7f7c1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:30.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 0x7f7c1406c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c28154bf0 tx=0x7f7c180038e0 comp rx=0 tx=0).stop 2023-08-18T20:45:30.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 msgr2=0x7f7c280c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:30.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 0x7f7c280c4a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00e810 tx=0x7f7c1c00eb20 comp rx=0 tx=0).stop 2023-08-18T20:45:30.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 shutdown_connections 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7c2814a8c0 0x7f7c28148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c28070150 0x7f7c280c4a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c1406a0e0 0x7f7c1406c5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 --2- 172.21.15.121:0/2865516120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c280c37c0 0x7f7c28148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 >> 172.21.15.121:0/2865516120 conn(0x7f7c280c2ca0 msgr2=0x7f7c2814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:30.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 shutdown_connections 2023-08-18T20:45:30.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:30.911+0000 7f7c2d0ef700 1 -- 172.21.15.121:0/2865516120 wait complete. 2023-08-18T20:45:30.913 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2023-08-18T20:45:30.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-18T20:45:31.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.053+0000 7fb7d2d51700 1 Processor -- start 2023-08-18T20:45:31.053 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.053+0000 7fb7d2d51700 1 -- start start 2023-08-18T20:45:31.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d2d51700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d2d51700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb7cc157c10 0x7fb7cc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d2d51700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0c21f0 con 0x7fb7cc06a510 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d2d51700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0c2ba0 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d2d51700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0c6300 con 0x7fb7cc157c10 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d0aed700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb7cc06a510 0x7fb7cc151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50132/0 (socket says 172.21.15.121:50132) 2023-08-18T20:45:31.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d0aed700 1 -- 172.21.15.121:0/4245896247 learned_addr learned my addr 172.21.15.121:0/4245896247 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:31.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43552/0 (socket says 172.21.15.121:43552) 2023-08-18T20:45:31.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7d12ee700 1 --2- 172.21.15.121:0/4245896247 >> v2:172.21.15.122:3300/0 conn(0x7fb7cc157c10 0x7fb7cc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 -- 172.21.15.121:0/4245896247 >> v2:172.21.15.122:3300/0 conn(0x7fb7cc157c10 msgr2=0x7fb7cc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:31.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 --2- 172.21.15.121:0/4245896247 >> v2:172.21.15.122:3300/0 conn(0x7fb7cc157c10 0x7fb7cc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 -- 172.21.15.121:0/4245896247 >> v1:172.21.15.121:6789/0 conn(0x7fb7cc06a510 legacy=0x7fb7cc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 -- 172.21.15.121:0/4245896247 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0c5b20 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cb7fe700 1 -- 172.21.15.121:0/4245896247 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260920926 0 0) 0x7fb7cc0c21f0 con 0x7fb7cc06a510 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cbfff700 1 --2- 172.21.15.121:0/4245896247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0c2900 tx=0x7fb7b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1ee5480644790f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cb7fe700 1 -- 172.21.15.121:0/4245896247 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011830 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cb7fe700 1 -- 172.21.15.121:0/4245896247 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8011990 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.054+0000 7fb7cb7fe700 1 -- 172.21.15.121:0/4245896247 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011d20 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 -- 172.21.15.121:0/4245896247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc0c1cf0 msgr2=0x7fb7cc0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/4245896247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0c2900 tx=0x7fb7b8009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 -- 172.21.15.121:0/4245896247 shutdown_connections 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/4245896247 >> v2:172.21.15.122:3300/0 conn(0x7fb7cc157c10 0x7fb7cc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/4245896247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc0c1cf0 0x7fb7cc0c5490 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 -- 172.21.15.121:0/4245896247 >> 172.21.15.121:0/4245896247 conn(0x7fb7cc0c6b10 msgr2=0x7fb7cc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 -- 172.21.15.121:0/4245896247 shutdown_connections 2023-08-18T20:45:31.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.055+0000 7fb7d2d51700 1 -- 172.21.15.121:0/4245896247 wait complete. 2023-08-18T20:45:31.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.056+0000 7fb7d2d51700 1 Processor -- start 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.056+0000 7fb7d2d51700 1 -- start start 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 0x7fb7cc14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 0x7fb7cc1468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc147600 con 0x7fb7cc157c10 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc147850 con 0x7fb7cc06a510 2023-08-18T20:45:31.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d2d51700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc1e96c0 con 0x7fb7cc0c1cf0 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43560/0 (socket says 172.21.15.121:43560) 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 -- 172.21.15.121:0/927455510 learned_addr learned my addr 172.21.15.121:0/927455510 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d0aed700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 0x7fb7cc14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7cbfff700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 0x7fb7cc1468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 -- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 msgr2=0x7fb7cc1468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 0x7fb7cc1468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 -- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 msgr2=0x7fb7cc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 0x7fb7cc14e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d12ee700 1 -- 172.21.15.121:0/927455510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80094a0 con 0x7fb7cc157c10 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7d0aed700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 0x7fb7cc14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.057+0000 7fb7cbfff700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 0x7fb7cc1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7d12ee700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4007e90 tx=0x7fb7c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400ede0 con 0x7fb7cc157c10 2023-08-18T20:45:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4014420 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc06c6f0 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c40147d0 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.058+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc14ea00 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.059+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc06c550 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.059+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb7c4014930 con 0x7fb7cc157c10 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.060+0000 7fb7c97fa700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 0x7fb7b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.060+0000 7fb7d0aed700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 0x7fb7b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.060+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb7c40888d0 con 0x7fb7cc157c10 2023-08-18T20:45:31.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.060+0000 7fb7d0aed700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 0x7fb7b006c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0000f60 tx=0x7fb7c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.064+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb7cc06c550 con 0x7fb7cc157c10 2023-08-18T20:45:31.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.331+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb7cc06c550 con 0x7fb7cc157c10 2023-08-18T20:45:31.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.332+0000 7fb7c97fa700 1 -- 172.21.15.121:0/927455510 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fb7cc06c550 con 0x7fb7cc157c10 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2023-08-18T20:45:31.332 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199ktYKlJRAAs3mdbvzBKm1gLPfu8TLwlg==", 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kqtgxMhAAdpQQEmGpyIJyUuUXtpzLow==", 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.334 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.335 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kW+0aLRAAud1uvjmNRpU23rxK9nkK3Q==", 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.336 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kBXpoORAA10zaeB/8n2rpDXJwCxolLA==", 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.337 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2023-08-18T20:45:31.338 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDP199kr+27DhAAPoOB9TF8z4jkfi5FxHUlEw==", 2023-08-18T20:45:31.339 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.339 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.339 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.339 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.339 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.340 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDS199kn0mkDxAAj5a4T282EkIifx69SShtMg==", 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV199kw+X/DhAAQ2yTAFT/Km+Ew2TPwuJLOQ==", 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY199keIxJDhAAnPMJ66EEeCVapCyfpeX8Cg==", 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe199kAK1DFBAAI9P5XM6ck/pDxTKY9p5MwQ==", 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDh199kJWQJFBAAoNVlAuCLrwWSyyrc40GklQ==", 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDk199k9nbEExAA+21djSBfGKMzVRbn3fofkg==", 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDn199kreETExAAuxx2sXu016kvAc8Mj1dV8A==", 2023-08-18T20:45:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2023-08-18T20:45:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2023-08-18T20:45:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2023-08-18T20:45:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ==", 2023-08-18T20:45:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2023-08-18T20:45:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-18T20:45:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2023-08-18T20:45:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A==", 2023-08-18T20:45:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2023-08-18T20:45:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2023-08-18T20:45:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw pool=cephfs2_data" 2023-08-18T20:45:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2023-08-18T20:45:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199kAD3xBxAAddKwPSoc28i6a0+nXOE8MQ==", 2023-08-18T20:45:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:45:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2023-08-18T20:45:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2023-08-18T20:45:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.testuser", 2023-08-18T20:45:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQBO2N9kpl3JBhAAQrcW73bKbvMeqNN6gaZ7SA==", 2023-08-18T20:45:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow rw fsname=cephfs", 2023-08-18T20:45:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r fsname=cephfs", 2023-08-18T20:45:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-18T20:45:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2023-08-18T20:45:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199k071CIhAA4ietCYXB23iN50L9O0VEAw==", 2023-08-18T20:45:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:45:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2023-08-18T20:45:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2023-08-18T20:45:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL199k4X4vHRAA02Ik8CbuInP8RM5T3Z9qqw==", 2023-08-18T20:45:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2023-08-18T20:45:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2023-08-18T20:45:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2023-08-18T20:45:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2023-08-18T20:45:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2023-08-18T20:45:31.365 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-08-18T20:45:31.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 msgr2=0x7fb7b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 0x7fb7b006c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0000f60 tx=0x7fb7c0009040 comp rx=0 tx=0).stop 2023-08-18T20:45:31.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 msgr2=0x7fb7cc146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4007e90 tx=0x7fb7c400e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 shutdown_connections 2023-08-18T20:45:31.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb7b006a0e0 0x7fb7b006c5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc157c10 0x7fb7cc146e10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7cc06a510 0x7fb7cc14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 --2- 172.21.15.121:0/927455510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7cc0c1cf0 0x7fb7cc1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 >> 172.21.15.121:0/927455510 conn(0x7fb7cc0c6b10 msgr2=0x7fb7cc155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:31.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 shutdown_connections 2023-08-18T20:45:31.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.334+0000 7fb7d2d51700 1 -- 172.21.15.121:0/927455510 wait complete. 2023-08-18T20:45:31.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-08-18T20:45:31.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 Processor -- start 2023-08-18T20:45:31.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 -- start start 2023-08-18T20:45:31.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f468006b520 0x7f4680072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680152d30 0x7f468014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f468014fa00 0x7f4680155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4680066380 con 0x7f468006b520 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46801531b0 con 0x7f468014fa00 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.494+0000 7f468498d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4680066080 con 0x7f4680152d30 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f468006b520 0x7f4680072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f468006b520 0x7f4680072360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43564/0 (socket says 172.21.15.121:43564) 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 -- 172.21.15.121:0/405068297 learned_addr learned my addr 172.21.15.121:0/405068297 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467dd9b700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680152d30 0x7f468014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 -- 172.21.15.121:0/405068297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680152d30 msgr2=0x7f468014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467ed9d700 1 --2- 172.21.15.121:0/405068297 >> v2:172.21.15.122:3300/0 conn(0x7f468014fa00 0x7f4680155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680152d30 0x7f468014f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 -- 172.21.15.121:0/405068297 >> v2:172.21.15.122:3300/0 conn(0x7f468014fa00 msgr2=0x7f4680155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 --2- 172.21.15.121:0/405068297 >> v2:172.21.15.122:3300/0 conn(0x7f468014fa00 0x7f4680155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 -- 172.21.15.121:0/405068297 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468006d0f0 con 0x7f468006b520 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467e59c700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f4680072360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f46800c2c70 tx=0x7f4674009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b151cc181e5607 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467d59a700 1 -- 172.21.15.121:0/405068297 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400b870 con 0x7f468006b520 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467d59a700 1 -- 172.21.15.121:0/405068297 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400b9d0 con 0x7f468006b520 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.495+0000 7f467d59a700 1 -- 172.21.15.121:0/405068297 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400bd60 con 0x7f468006b520 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 -- 172.21.15.121:0/405068297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 msgr2=0x7f4680072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f4680072360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f46800c2c70 tx=0x7f4674009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 -- 172.21.15.121:0/405068297 shutdown_connections 2023-08-18T20:45:31.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 --2- 172.21.15.121:0/405068297 >> v2:172.21.15.122:3300/0 conn(0x7f468014fa00 0x7f4680155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f4680072360 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 --2- 172.21.15.121:0/405068297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680152d30 0x7f468014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 -- 172.21.15.121:0/405068297 >> 172.21.15.121:0/405068297 conn(0x7f46800c2ca0 msgr2=0x7f46800c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:31.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 -- 172.21.15.121:0/405068297 shutdown_connections 2023-08-18T20:45:31.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.496+0000 7f468498d700 1 -- 172.21.15.121:0/405068297 wait complete. 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.497+0000 7f468498d700 1 Processor -- start 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.497+0000 7f468498d700 1 -- start start 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 0x7f46800bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 0x7f4680151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680154c10 con 0x7f468006b520 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680155910 con 0x7f4680152d30 2023-08-18T20:45:31.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f468498d700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46800bfd80 con 0x7f468014fa00 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43570/0 (socket says 172.21.15.121:43570) 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 -- 172.21.15.121:0/1715544046 learned_addr learned my addr 172.21.15.121:0/1715544046 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467dd9b700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 0x7f46800bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467ed9d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 0x7f4680151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 -- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 msgr2=0x7f46800bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 0x7f46800bf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 -- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 msgr2=0x7f4680151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 0x7f4680151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 -- 172.21.15.121:0/1715544046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009550 con 0x7f468006b520 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467dd9b700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 0x7f46800bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467ed9d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 0x7f4680151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f467e59c700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4674009fd0 tx=0x7f4674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674004310 con 0x7f468006b520 2023-08-18T20:45:31.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.498+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467401f070 con 0x7f468006b520 2023-08-18T20:45:31.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.499+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680153620 con 0x7f468006b520 2023-08-18T20:45:31.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.499+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740036a0 con 0x7f468006b520 2023-08-18T20:45:31.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.499+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4680154660 con 0x7f468006b520 2023-08-18T20:45:31.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.499+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680074730 con 0x7f468006b520 2023-08-18T20:45:31.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.500+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4674021030 con 0x7f468006b520 2023-08-18T20:45:31.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.500+0000 7f466effd700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 0x7f466006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.500+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f46740895a0 con 0x7f468006b520 2023-08-18T20:45:31.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.500+0000 7f467dd9b700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 0x7f466006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.501+0000 7f467dd9b700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 0x7f466006c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46800c3800 tx=0x7f4670008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.505+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4674055070 con 0x7f468006b520 2023-08-18T20:45:31.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.772+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f468014bf20 con 0x7f468006b520 2023-08-18T20:45:31.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.776+0000 7f466effd700 1 -- 172.21.15.121:0/1715544046 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v12) v1 ==== 85+0+0 (secure 0 0 0) 0x7f4674058690 con 0x7f468006b520 2023-08-18T20:45:31.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 msgr2=0x7f466006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 0x7f466006c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46800c3800 tx=0x7f4670008040 comp rx=0 tx=0).stop 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 msgr2=0x7f46801ea900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4674009fd0 tx=0x7f4674004750 comp rx=0 tx=0).stop 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 shutdown_connections 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680152d30 0x7f4680151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f466006a0e0 0x7f466006c5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468006b520 0x7f46801ea900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 --2- 172.21.15.121:0/1715544046 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468014fa00 0x7f46800bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 >> 172.21.15.121:0/1715544046 conn(0x7f46800c2ca0 msgr2=0x7f468014c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:31.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 shutdown_connections 2023-08-18T20:45:31.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.778+0000 7f468498d700 1 -- 172.21.15.121:0/1715544046 wait complete. 2023-08-18T20:45:31.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:31.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.911+0000 7f615cba2700 1 Processor -- start 2023-08-18T20:45:31.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.911+0000 7f615cba2700 1 -- start start 2023-08-18T20:45:31.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615cba2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615cba2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 0x7f615806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615cba2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6158155970 con 0x7f615806a7e0 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615cba2700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615814ff70 con 0x7f6158152250 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615cba2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615806e830 con 0x7f615814fb90 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f6155d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 0x7f615806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:39988/0 (socket says 172.21.15.121:39988) 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 -- 172.21.15.121:0/3113101656 learned_addr learned my addr 172.21.15.121:0/3113101656 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:31.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f6155d9b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 0x7f615806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53418/0 (socket says 172.21.15.121:53418) 2023-08-18T20:45:31.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 -- 172.21.15.121:0/3113101656 >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 msgr2=0x7f615806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:31.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 --2- 172.21.15.121:0/3113101656 >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 0x7f615806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 -- 172.21.15.121:0/3113101656 >> v1:172.21.15.122:6789/0 conn(0x7f615806a7e0 legacy=0x7f6158155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.912+0000 7f615659c700 1 -- 172.21.15.121:0/3113101656 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615806df90 con 0x7f615814fb90 2023-08-18T20:45:31.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615659c700 1 --2- 172.21.15.121:0/3113101656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f614c0098f0 tx=0x7f614c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786fe11e908b7219 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615559a700 1 -- 172.21.15.121:0/3113101656 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c011830 con 0x7f615814fb90 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615559a700 1 -- 172.21.15.121:0/3113101656 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c011990 con 0x7f615814fb90 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615559a700 1 -- 172.21.15.121:0/3113101656 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c011d20 con 0x7f615814fb90 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 -- 172.21.15.121:0/3113101656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 msgr2=0x7f61580c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 --2- 172.21.15.121:0/3113101656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f614c0098f0 tx=0x7f614c009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 -- 172.21.15.121:0/3113101656 shutdown_connections 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 --2- 172.21.15.121:0/3113101656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615814fb90 0x7f61580c5d10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 --2- 172.21.15.121:0/3113101656 >> v2:172.21.15.122:3300/0 conn(0x7f6158152250 0x7f615806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 -- 172.21.15.121:0/3113101656 >> 172.21.15.121:0/3113101656 conn(0x7f61580c6b10 msgr2=0x7f61580c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:31.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 -- 172.21.15.121:0/3113101656 shutdown_connections 2023-08-18T20:45:31.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.913+0000 7f615cba2700 1 -- 172.21.15.121:0/3113101656 wait complete. 2023-08-18T20:45:31.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 Processor -- start 2023-08-18T20:45:31.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 -- start start 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615806a7e0 0x7f61580a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f615814fb90 0x7f6158149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581e71b0 con 0x7f6158152250 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580aa520 con 0x7f615814fb90 2023-08-18T20:45:31.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.915+0000 7f615cba2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6158149170 con 0x7f615806a7e0 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43588/0 (socket says 172.21.15.121:43588) 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 -- 172.21.15.121:0/2688044528 learned_addr learned my addr 172.21.15.121:0/2688044528 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6155d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f615814fb90 0x7f6158149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f615659c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615806a7e0 0x7f61580a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 -- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615806a7e0 msgr2=0x7f61580a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615806a7e0 0x7f61580a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 -- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f615814fb90 msgr2=0x7f6158149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f615814fb90 0x7f6158149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 -- 172.21.15.121:0/2688044528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009550 con 0x7f6158152250 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6156d9d700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f615000cb50 tx=0x7f615000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150003c00 con 0x7f6158152250 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150003d60 con 0x7f6158152250 2023-08-18T20:45:31.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000aa20 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61581e73a0 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.916+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158149660 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.917+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6158074730 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.918+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f615000ab80 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.918+0000 7f6146ffd700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 0x7f613806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.918+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6150088190 con 0x7f6158152250 2023-08-18T20:45:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.918+0000 7f615659c700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 0x7f613806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:31.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.918+0000 7f615659c700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 0x7f613806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f614c000c00 tx=0x7f614c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:31.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:31.922+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6150053c60 con 0x7f6158152250 2023-08-18T20:45:32.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.115+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61580c6620 con 0x7f6158152250 2023-08-18T20:45:32.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.116+0000 7f6146ffd700 1 -- 172.21.15.121:0/2688044528 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f6150057280 con 0x7f6158152250 2023-08-18T20:45:32.115 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:32.115 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":48,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:30.901597+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:32.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 msgr2=0x7f613806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 0x7f613806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f614c000c00 tx=0x7f614c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:32.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 msgr2=0x7f615814a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f615000cb50 tx=0x7f615000ce60 comp rx=0 tx=0).stop 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 shutdown_connections 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f613806a0e0 0x7f613806c5a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6158152250 0x7f615814a0c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f615806a7e0 0x7f61580a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 --2- 172.21.15.121:0/2688044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f615814fb90 0x7f6158149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 >> 172.21.15.121:0/2688044528 conn(0x7f61580c6b10 msgr2=0x7f6158155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 shutdown_connections 2023-08-18T20:45:32.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.118+0000 7f615cba2700 1 -- 172.21.15.121:0/2688044528 wait complete. 2023-08-18T20:45:32.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:32.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.256+0000 7f5098166700 1 Processor -- start 2023-08-18T20:45:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.256+0000 7f5098166700 1 -- start start 2023-08-18T20:45:32.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5098166700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50900c1030 0x7f5090066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5098166700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509006cc30 con 0x7f50901518e0 2023-08-18T20:45:32.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5098166700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900c0b80 con 0x7f50900bf550 2023-08-18T20:45:32.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5098166700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5090155260 con 0x7f50900c1030 2023-08-18T20:45:32.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5095f02700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f50901518e0 0x7f509006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50174/0 (socket says 172.21.15.121:50174) 2023-08-18T20:45:32.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5095f02700 1 -- 172.21.15.121:0/2494604892 learned_addr learned my addr 172.21.15.121:0/2494604892 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:32.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061985557 0 0) 0x7f509006cc30 con 0x7f50901518e0 2023-08-18T20:45:32.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5095701700 1 --2- 172.21.15.121:0/2494604892 >> v2:172.21.15.122:3300/0 conn(0x7f50900c1030 0x7f5090066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c0035b0 con 0x7f50901518e0 2023-08-18T20:45:32.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615747606 0 0) 0x7f507c0035b0 con 0x7f50901518e0 2023-08-18T20:45:32.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 >> v2:172.21.15.122:3300/0 conn(0x7f50900c1030 msgr2=0x7f5090066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:32.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 --2- 172.21.15.121:0/2494604892 >> v2:172.21.15.122:3300/0 conn(0x7f50900c1030 0x7f5090066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 >> v1:172.21.15.122:6789/0 conn(0x7f50900bf550 legacy=0x7f509015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509006ce80 con 0x7f50901518e0 2023-08-18T20:45:32.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f508c001670 con 0x7f50901518e0 2023-08-18T20:45:32.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 >> v1:172.21.15.121:6789/0 conn(0x7f50901518e0 legacy=0x7f509006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f507c003a00 0x7f507c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f507c004850 0x7f507c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f507c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090155260 con 0x7f507c005210 2023-08-18T20:45:32.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c00c1b0 con 0x7f507c003a00 2023-08-18T20:45:32.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.257+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c00c370 con 0x7f507c004850 2023-08-18T20:45:32.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f507c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5095f02700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f507c003a00 0x7f507c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5095701700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f507c004850 0x7f507c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 -- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f507c004850 msgr2=0x7f507c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:32.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f507c004850 0x7f507c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 -- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f507c003a00 msgr2=0x7f507c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:32.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f507c003a00 0x7f507c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 -- 172.21.15.121:0/2494604892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0035b0 con 0x7f507c005210 2023-08-18T20:45:32.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 -- 172.21.15.121:0/2494604892 reap_dead start 2023-08-18T20:45:32.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5096703700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f507c00ba10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f508800c110 tx=0x7f507c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04cfd0ebbc2434f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088001da0 con 0x7f507c005210 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5088003c50 con 0x7f507c005210 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5094f00700 1 -- 172.21.15.121:0/2494604892 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800ca50 con 0x7f507c005210 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5098166700 1 -- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 msgr2=0x7f507c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.258+0000 7f5098166700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f507c00ba10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f508800c110 tx=0x7f507c005880 comp rx=0 tx=0).stop 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.259+0000 7f5098166700 1 -- 172.21.15.121:0/2494604892 shutdown_connections 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.259+0000 7f5098166700 1 --2- 172.21.15.121:0/2494604892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f507c00ba10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.259+0000 7f5098166700 1 -- 172.21.15.121:0/2494604892 >> 172.21.15.121:0/2494604892 conn(0x7f50900c2ca0 msgr2=0x7f50900c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.259+0000 7f5098166700 1 -- 172.21.15.121:0/2494604892 shutdown_connections 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.259+0000 7f5098166700 1 -- 172.21.15.121:0/2494604892 wait complete. 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 Processor -- start 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 -- start start 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50901e9380 0x7f50901eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50900c54c0 0x7f50901ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50901583a0 con 0x7f507c005210 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50901588d0 con 0x7f50901e9380 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.260+0000 7f5098166700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509014a7a0 con 0x7f50900c54c0 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43606/0 (socket says 172.21.15.121:43606) 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 -- 172.21.15.121:0/3511853316 learned_addr learned my addr 172.21.15.121:0/3511853316 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095701700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50901e9380 0x7f50901eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5096703700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50900c54c0 0x7f50901ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 -- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50900c54c0 msgr2=0x7f50901ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50900c54c0 0x7f50901ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 -- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50901e9380 msgr2=0x7f50901eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50901e9380 0x7f50901eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 -- 172.21.15.121:0/3511853316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50901585f0 con 0x7f507c005210 2023-08-18T20:45:32.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5095f02700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f508c007310 tx=0x7f508c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c012560 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c0126c0 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c012a50 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50901ec990 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.261+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900c5f60 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.262+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50901ecbd0 con 0x7f507c005210 2023-08-18T20:45:32.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.262+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f508c012bb0 con 0x7f507c005210 2023-08-18T20:45:32.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.263+0000 7f50867fc700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 0x7f507406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.263+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f508c088070 con 0x7f507c005210 2023-08-18T20:45:32.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.263+0000 7f5095701700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 0x7f507406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.263+0000 7f5095701700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 0x7f507406c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50901e9760 tx=0x7f50800091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.267+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f50901ecbd0 con 0x7f507c005210 2023-08-18T20:45:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.454+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f509006d130 con 0x7f507c005210 2023-08-18T20:45:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.455+0000 7f50867fc700 1 -- 172.21.15.121:0/3511853316 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f508c0575d0 con 0x7f507c005210 2023-08-18T20:45:32.455 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:32.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 msgr2=0x7f507406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 0x7f507406c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50901e9760 tx=0x7f50800091c0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 msgr2=0x7f50901546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f508c007310 tx=0x7f508c007620 comp rx=0 tx=0).stop 2023-08-18T20:45:32.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 shutdown_connections 2023-08-18T20:45:32.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50900c54c0 0x7f50901ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f507406a0e0 0x7f507406c5a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f507c005210 0x7f50901546e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 --2- 172.21.15.121:0/3511853316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50901e9380 0x7f50901eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 >> 172.21.15.121:0/3511853316 conn(0x7f50900c2ca0 msgr2=0x7f509006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 shutdown_connections 2023-08-18T20:45:32.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.457+0000 7f5098166700 1 -- 172.21.15.121:0/3511853316 wait complete. 2023-08-18T20:45:32.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:32.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.592+0000 7fd2d6aa5700 1 Processor -- start 2023-08-18T20:45:32.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.592+0000 7fd2d6aa5700 1 -- start start 2023-08-18T20:45:32.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d6aa5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d006fd30 0x7fd2d00c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d6aa5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd2d01559c0 0x7fd2d00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d6aa5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d01529a0 con 0x7fd2d0152450 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d6aa5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d0152c80 con 0x7fd2d01559c0 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d6aa5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0152f60 con 0x7fd2d006fd30 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd2d01559c0 0x7fd2d00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd2d01559c0 0x7fd2d00c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43616/0 (socket says 172.21.15.121:43616) 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 -- 172.21.15.121:0/4207556065 learned_addr learned my addr 172.21.15.121:0/4207556065 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d4841700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d006fd30 0x7fd2d00c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 -- 172.21.15.121:0/4207556065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d006fd30 msgr2=0x7fd2d00c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d006fd30 0x7fd2d00c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 -- 172.21.15.121:0/4207556065 >> v1:172.21.15.122:6789/0 conn(0x7fd2d0152450 legacy=0x7fd2d014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 -- 172.21.15.121:0/4207556065 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0153240 con 0x7fd2d01559c0 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2d5042700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d01559c0 0x7fd2d00c7270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b002c10a49b3654 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2cf7fe700 1 -- 172.21.15.121:0/4207556065 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800e070 con 0x7fd2d01559c0 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2cf7fe700 1 -- 172.21.15.121:0/4207556065 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c800b910 con 0x7fd2d01559c0 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.593+0000 7fd2cf7fe700 1 -- 172.21.15.121:0/4207556065 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800bcc0 con 0x7fd2d01559c0 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/4207556065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d01559c0 msgr2=0x7fd2d00c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d01559c0 0x7fd2d00c7270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c800b330 comp rx=0 tx=0).stop 2023-08-18T20:45:32.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/4207556065 shutdown_connections 2023-08-18T20:45:32.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d01559c0 0x7fd2d00c7270 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/4207556065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d006fd30 0x7fd2d00c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/4207556065 >> 172.21.15.121:0/4207556065 conn(0x7fd2d00c7bf0 msgr2=0x7fd2d00c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/4207556065 shutdown_connections 2023-08-18T20:45:32.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.594+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/4207556065 wait complete. 2023-08-18T20:45:32.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.595+0000 7fd2d6aa5700 1 Processor -- start 2023-08-18T20:45:32.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.595+0000 7fd2d6aa5700 1 -- start start 2023-08-18T20:45:32.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 0x7fd2d00a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d01559c0 0x7fd2d00bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00bfe00 con 0x7fd2d0152450 2023-08-18T20:45:32.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00beef0 con 0x7fd2d006fd30 2023-08-18T20:45:32.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d6aa5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00c1620 con 0x7fd2d01559c0 2023-08-18T20:45:32.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43620/0 (socket says 172.21.15.121:43620) 2023-08-18T20:45:32.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 -- 172.21.15.121:0/2039134790 learned_addr learned my addr 172.21.15.121:0/2039134790 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d5042700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d01559c0 0x7fd2d00bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d4841700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 0x7fd2d00a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 -- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d01559c0 msgr2=0x7fd2d00bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d01559c0 0x7fd2d00bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 -- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 msgr2=0x7fd2d00a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 0x7fd2d00a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 -- 172.21.15.121:0/2039134790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009b30 con 0x7fd2d0152450 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2d4841700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 0x7fd2d00a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.596+0000 7fd2cffff700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c4b0 tx=0x7fd2bc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.597+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0052d0 con 0x7fd2d0152450 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.597+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc005430 con 0x7fd2d0152450 2023-08-18T20:45:32.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.597+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d00c0010 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.597+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0038c0 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.597+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d00a79c0 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.598+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d00c1b00 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.598+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2bc003a20 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.598+0000 7fd2cd7fa700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 0x7fd2b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.598+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd2bc087610 con 0x7fd2d0152450 2023-08-18T20:45:32.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.598+0000 7fd2d4841700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 0x7fd2b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.599+0000 7fd2d4841700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 0x7fd2b406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009c30 tx=0x7fd2c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.603+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd2bc053060 con 0x7fd2d0152450 2023-08-18T20:45:32.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.794+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2d00bf060 con 0x7fd2d0152450 2023-08-18T20:45:32.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.795+0000 7fd2cd7fa700 1 -- 172.21.15.121:0/2039134790 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2bc056680 con 0x7fd2d0152450 2023-08-18T20:45:32.795 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:32.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 msgr2=0x7fd2b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 0x7fd2b406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009c30 tx=0x7fd2c4008040 comp rx=0 tx=0).stop 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 msgr2=0x7fd2d00bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c4b0 tx=0x7fd2bc00c7c0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 shutdown_connections 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d01559c0 0x7fd2d00bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d006fd30 0x7fd2d00a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd2b406a0e0 0x7fd2b406c5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 --2- 172.21.15.121:0/2039134790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2d0152450 0x7fd2d00bf380 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 >> 172.21.15.121:0/2039134790 conn(0x7fd2d00c7bf0 msgr2=0x7fd2d0153480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 shutdown_connections 2023-08-18T20:45:32.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.797+0000 7fd2d6aa5700 1 -- 172.21.15.121:0/2039134790 wait complete. 2023-08-18T20:45:32.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-18T20:45:32.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 Processor -- start 2023-08-18T20:45:32.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 -- start start 2023-08-18T20:45:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fca3c155070 0x7fca3c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 0x7fca3c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c1554d0 con 0x7fca3c14e6c0 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c06e980 con 0x7fca3c155070 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.929+0000 7fca415db700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c06f920 con 0x7fca3c0c8060 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fca3c155070 0x7fca3c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3affd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fca3c14e6c0 0x7fca3c0a6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50208/0 (socket says 172.21.15.121:50208) 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3affd700 1 -- 172.21.15.121:0/2162033914 learned_addr learned my addr 172.21.15.121:0/2162033914 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3b7fe700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 0x7fca3c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 -- 172.21.15.121:0/2162033914 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 msgr2=0x7fca3c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 0x7fca3c0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 -- 172.21.15.121:0/2162033914 >> v1:172.21.15.121:6789/0 conn(0x7fca3c14e6c0 legacy=0x7fca3c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca39ffb700 1 -- 172.21.15.121:0/2162033914 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002793834 0 0) 0x7fca3c1554d0 con 0x7fca3c14e6c0 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 -- 172.21.15.121:0/2162033914 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c06eb60 con 0x7fca3c155070 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3b7fe700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 0x7fca3c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca3a7fc700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c155070 0x7fca3c0c7b20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca30009840 tx=0x7fca30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd36b3b5afc9ea7b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca39ffb700 1 -- 172.21.15.121:0/2162033914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30011830 con 0x7fca3c155070 2023-08-18T20:45:32.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca39ffb700 1 -- 172.21.15.121:0/2162033914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30011990 con 0x7fca3c155070 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.930+0000 7fca39ffb700 1 -- 172.21.15.121:0/2162033914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30011d20 con 0x7fca3c155070 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 -- 172.21.15.121:0/2162033914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c155070 msgr2=0x7fca3c0c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c155070 0x7fca3c0c7b20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca30009840 tx=0x7fca30009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 -- 172.21.15.121:0/2162033914 shutdown_connections 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c0c8060 0x7fca3c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 --2- 172.21.15.121:0/2162033914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c155070 0x7fca3c0c7b20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 -- 172.21.15.121:0/2162033914 >> 172.21.15.121:0/2162033914 conn(0x7fca3c0a96a0 msgr2=0x7fca3c0a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:32.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 -- 172.21.15.121:0/2162033914 shutdown_connections 2023-08-18T20:45:32.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.931+0000 7fca415db700 1 -- 172.21.15.121:0/2162033914 wait complete. 2023-08-18T20:45:32.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.932+0000 7fca415db700 1 Processor -- start 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.932+0000 7fca415db700 1 -- start start 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3c0c8060 0x7fca3c0c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 0x7fca3c1eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c14c4d0 con 0x7fca3c14e6c0 2023-08-18T20:45:32.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c1ed590 con 0x7fca3c0c8060 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0c4ed0 con 0x7fca3c155070 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43634/0 (socket says 172.21.15.121:43634) 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 -- 172.21.15.121:0/4022022589 learned_addr learned my addr 172.21.15.121:0/4022022589 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3affd700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3c0c8060 0x7fca3c0c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3b7fe700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 0x7fca3c1eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 -- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 msgr2=0x7fca3c1eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 0x7fca3c1eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 -- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3c0c8060 msgr2=0x7fca3c0c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3c0c8060 0x7fca3c0c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 -- 172.21.15.121:0/4022022589 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300094a0 con 0x7fca3c14e6c0 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3b7fe700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 0x7fca3c1eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca3a7fc700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fca300090b0 tx=0x7fca30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300038a0 con 0x7fca3c14e6c0 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3001f070 con 0x7fca3c14e6c0 2023-08-18T20:45:32.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c153960 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30003c20 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.933+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0c5170 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.934+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c0c5390 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.935+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca3001a430 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.935+0000 7fca237fe700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 0x7fca2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.935+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca30021070 con 0x7fca3c14e6c0 2023-08-18T20:45:32.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.935+0000 7fca3affd700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 0x7fca2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:32.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.936+0000 7fca3affd700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 0x7fca2806c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca2c000f60 tx=0x7fca2c007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:32.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:32.939+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fca300556a0 con 0x7fca3c14e6c0 2023-08-18T20:45:33.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.133+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca3c074730 con 0x7fca3c14e6c0 2023-08-18T20:45:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.133+0000 7fca237fe700 1 -- 172.21.15.121:0/4022022589 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+126 (secure 0 0 0) 0x7fca3002b090 con 0x7fca3c14e6c0 2023-08-18T20:45:33.133 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:33.133 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2023-08-18T20:45:33.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:33.133 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:33.134 INFO:teuthology.orchestra.run.smithi121.stdout:] 2023-08-18T20:45:33.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 msgr2=0x7fca2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 0x7fca2806c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca2c000f60 tx=0x7fca2c007c90 comp rx=0 tx=0).stop 2023-08-18T20:45:33.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 msgr2=0x7fca3c153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fca300090b0 tx=0x7fca30004750 comp rx=0 tx=0).stop 2023-08-18T20:45:33.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 shutdown_connections 2023-08-18T20:45:33.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca3c155070 0x7fca3c1eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3c0c8060 0x7fca3c0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fca2806a0e0 0x7fca2806c5a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 --2- 172.21.15.121:0/4022022589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca3c14e6c0 0x7fca3c153420 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 >> 172.21.15.121:0/4022022589 conn(0x7fca3c0a96a0 msgr2=0x7fca3c0a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 shutdown_connections 2023-08-18T20:45:33.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.135+0000 7fca415db700 1 -- 172.21.15.121:0/4022022589 wait complete. 2023-08-18T20:45:33.147 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-18T20:45:33.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-18T20:45:33.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.272+0000 7fe2b3f46700 1 Processor -- start 2023-08-18T20:45:33.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.272+0000 7fe2b3f46700 1 -- start start 2023-08-18T20:45:33.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac0c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe2ac0662c0 0x7fe2ac0aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe2ac0aaf70 0x7fe2ac155830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac0ab870 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac152c60 con 0x7fe2ac0662c0 2023-08-18T20:45:33.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b3f46700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0722e0 con 0x7fe2ac14f910 2023-08-18T20:45:33.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe2ac0aaf70 0x7fe2ac155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe2ac0aaf70 0x7fe2ac155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43644/0 (socket says 172.21.15.121:43644) 2023-08-18T20:45:33.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 -- 172.21.15.121:0/3940968169 learned_addr learned my addr 172.21.15.121:0/3940968169 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:33.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b1ce2700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac0c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b14e1700 1 --2- 172.21.15.121:0/3940968169 >> v2:172.21.15.122:3300/0 conn(0x7fe2ac0662c0 0x7fe2ac0aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 -- 172.21.15.121:0/3940968169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 msgr2=0x7fe2ac0c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:33.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac0c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 -- 172.21.15.121:0/3940968169 >> v2:172.21.15.122:3300/0 conn(0x7fe2ac0662c0 msgr2=0x7fe2ac0aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:33.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 --2- 172.21.15.121:0/3940968169 >> v2:172.21.15.122:3300/0 conn(0x7fe2ac0662c0 0x7fe2ac0aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 -- 172.21.15.121:0/3940968169 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac153140 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b24e3700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac155830 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0729b0 tx=0x7fe2a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9daf2d2e38f8989 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b0ce0700 1 -- 172.21.15.121:0/3940968169 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400e070 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.273+0000 7fe2b0ce0700 1 -- 172.21.15.121:0/3940968169 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a400b9c0 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b0ce0700 1 -- 172.21.15.121:0/3940968169 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400bd70 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 -- 172.21.15.121:0/3940968169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0aaf70 msgr2=0x7fe2ac155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac155830 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0729b0 tx=0x7fe2a400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 -- 172.21.15.121:0/3940968169 shutdown_connections 2023-08-18T20:45:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac155830 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/3940968169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac0c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/3940968169 >> v2:172.21.15.122:3300/0 conn(0x7fe2ac0662c0 0x7fe2ac0aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 -- 172.21.15.121:0/3940968169 >> 172.21.15.121:0/3940968169 conn(0x7fe2ac06bdc0 msgr2=0x7fe2ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 -- 172.21.15.121:0/3940968169 shutdown_connections 2023-08-18T20:45:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.274+0000 7fe2b3f46700 1 -- 172.21.15.121:0/3940968169 wait complete. 2023-08-18T20:45:33.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.275+0000 7fe2b3f46700 1 Processor -- start 2023-08-18T20:45:33.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.275+0000 7fe2b3f46700 1 -- start start 2023-08-18T20:45:33.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac14ea40 con 0x7fe2ac0662c0 2023-08-18T20:45:33.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac071cb0 con 0x7fe2ac0aaf70 2023-08-18T20:45:33.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b3f46700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac1ea9e0 con 0x7fe2ac14f910 2023-08-18T20:45:33.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43646/0 (socket says 172.21.15.121:43646) 2023-08-18T20:45:33.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 -- 172.21.15.121:0/113328260 learned_addr learned my addr 172.21.15.121:0/113328260 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:33.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b14e1700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b24e3700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 -- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 msgr2=0x7fe2ac071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 -- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 msgr2=0x7fe2ac071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b1ce2700 1 -- 172.21.15.121:0/113328260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009b30 con 0x7fe2ac0662c0 2023-08-18T20:45:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.276+0000 7fe2b14e1700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2b1ce2700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800d800 tx=0x7fe2a800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80125f0 con 0x7fe2ac0662c0 2023-08-18T20:45:33.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8012750 con 0x7fe2ac0662c0 2023-08-18T20:45:33.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8012b00 con 0x7fe2ac0662c0 2023-08-18T20:45:33.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac14e110 con 0x7fe2ac0662c0 2023-08-18T20:45:33.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.277+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac14e6d0 con 0x7fe2ac0662c0 2023-08-18T20:45:33.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.278+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac14e890 con 0x7fe2ac0662c0 2023-08-18T20:45:33.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.278+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2a8012c60 con 0x7fe2ac0662c0 2023-08-18T20:45:33.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.278+0000 7fe2a27fc700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 0x7fe29006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:33.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.278+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe2a80885a0 con 0x7fe2ac0662c0 2023-08-18T20:45:33.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.279+0000 7fe2b14e1700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 0x7fe29006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:33.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.279+0000 7fe2b14e1700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 0x7fe29006c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac14d1e0 tx=0x7fe29c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.283+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe2a8053fe0 con 0x7fe2ac0662c0 2023-08-18T20:45:33.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.470+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe2ac14ed20 con 0x7fe2ac0662c0 2023-08-18T20:45:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.957+0000 7fe2a27fc700 1 -- 172.21.15.121:0/113328260 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe2a8057600 con 0x7fe2ac0662c0 2023-08-18T20:45:33.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 msgr2=0x7fe29006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 0x7fe29006c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac14d1e0 tx=0x7fe29c008040 comp rx=0 tx=0).stop 2023-08-18T20:45:33.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 msgr2=0x7fe2ac0bf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:33.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800d800 tx=0x7fe2a800dbc0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 shutdown_connections 2023-08-18T20:45:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2ac14f910 0x7fe2ac071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fe29006a0e0 0x7fe29006c5a0 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac14d1e0 tx=0x7fe29c008040 comp rx=0 tx=0).stop 2023-08-18T20:45:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2ac0662c0 0x7fe2ac0bf860 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 --2- 172.21.15.121:0/113328260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2ac0aaf70 0x7fe2ac071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 >> 172.21.15.121:0/113328260 conn(0x7fe2ac06bdc0 msgr2=0x7fe2ac152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 shutdown_connections 2023-08-18T20:45:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:33.961+0000 7fe2b3f46700 1 -- 172.21.15.121:0/113328260 wait complete. 2023-08-18T20:45:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2023-08-18T20:45:33.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-18T20:45:34.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.102+0000 7ff144052700 1 Processor -- start 2023-08-18T20:45:34.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.102+0000 7ff144052700 1 -- start start 2023-08-18T20:45:34.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff144052700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff13c070950 0x7ff13c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff144052700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0c2260 con 0x7ff13c14e950 2023-08-18T20:45:34.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff144052700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c151d90 con 0x7ff13c14ed30 2023-08-18T20:45:34.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff144052700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0a6630 con 0x7ff13c070950 2023-08-18T20:45:34.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff141dee700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff13c14e950 0x7ff13c0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50236/0 (socket says 172.21.15.121:50236) 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff141dee700 1 -- 172.21.15.121:0/319150516 learned_addr learned my addr 172.21.15.121:0/319150516 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119117298 0 0) 0x7ff13c0c2260 con 0x7ff13c14e950 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1280035b0 con 0x7ff13c14e950 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff1425ef700 1 --2- 172.21.15.121:0/319150516 >> v2:172.21.15.122:3300/0 conn(0x7ff13c070950 0x7ff13c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.103+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3381721378 0 0) 0x7ff1280035b0 con 0x7ff13c14e950 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 >> v2:172.21.15.122:3300/0 conn(0x7ff13c070950 msgr2=0x7ff13c0c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 --2- 172.21.15.121:0/319150516 >> v2:172.21.15.122:3300/0 conn(0x7ff13c070950 0x7ff13c0c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 >> v1:172.21.15.122:6789/0 conn(0x7ff13c14ed30 legacy=0x7ff13c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c152070 con 0x7ff13c14e950 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7ff12c001670 con 0x7ff13c14e950 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 >> v1:172.21.15.121:6789/0 conn(0x7ff13c14e950 legacy=0x7ff13c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 0x7ff128003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff128004850 0x7ff128004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128005210 0x7ff12800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0a6630 con 0x7ff128003a00 2023-08-18T20:45:34.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12800c1b0 con 0x7ff128005210 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12800c370 con 0x7ff128004850 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 0x7ff128003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff1425ef700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128005210 0x7ff12800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff1415ed700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff128004850 0x7ff128004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 -- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff128004850 msgr2=0x7ff128004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:34.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff128004850 0x7ff128004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 -- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128005210 msgr2=0x7ff12800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:34.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128005210 0x7ff12800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 -- 172.21.15.121:0/319150516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280035b0 con 0x7ff128003a00 2023-08-18T20:45:34.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff1425ef700 1 -- 172.21.15.121:0/319150516 reap_dead start 2023-08-18T20:45:34.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff141dee700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 0x7ff128003e20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c240 tx=0x7ff128005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825f64627ff3bd3f server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:34.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c007c10 con 0x7ff128003a00 2023-08-18T20:45:34.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c00ce00 con 0x7ff128003a00 2023-08-18T20:45:34.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.104+0000 7ff140dec700 1 -- 172.21.15.121:0/319150516 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c005ba0 con 0x7ff128003a00 2023-08-18T20:45:34.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 -- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 msgr2=0x7ff128003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 0x7ff128003e20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c240 tx=0x7ff128005880 comp rx=0 tx=0).stop 2023-08-18T20:45:34.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 -- 172.21.15.121:0/319150516 shutdown_connections 2023-08-18T20:45:34.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 --2- 172.21.15.121:0/319150516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff128003a00 0x7ff128003e20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 -- 172.21.15.121:0/319150516 >> 172.21.15.121:0/319150516 conn(0x7ff13c0c6b10 msgr2=0x7ff13c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:34.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 -- 172.21.15.121:0/319150516 shutdown_connections 2023-08-18T20:45:34.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.105+0000 7ff144052700 1 -- 172.21.15.121:0/319150516 wait complete. 2023-08-18T20:45:34.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.106+0000 7ff144052700 1 Processor -- start 2023-08-18T20:45:34.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.106+0000 7ff144052700 1 -- start start 2023-08-18T20:45:34.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128003a00 0x7ff13c1d8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13c151330 0x7ff13c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c0b10 con 0x7ff13c0bff80 2023-08-18T20:45:34.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1e8fd0 con 0x7ff128003a00 2023-08-18T20:45:34.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c0590 con 0x7ff13c151330 2023-08-18T20:45:34.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43670/0 (socket says 172.21.15.121:43670) 2023-08-18T20:45:34.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 -- 172.21.15.121:0/3683548185 learned_addr learned my addr 172.21.15.121:0/3683548185 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:34.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff141dee700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128003a00 0x7ff13c1d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1415ed700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13c151330 0x7ff13c143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 -- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13c151330 msgr2=0x7ff13c143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13c151330 0x7ff13c143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 -- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128003a00 msgr2=0x7ff13c1d8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128003a00 0x7ff13c1d8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 -- 172.21.15.121:0/3683548185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0c4a10 con 0x7ff13c0bff80 2023-08-18T20:45:34.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1425ef700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0c1110 tx=0x7ff134011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:34.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400e040 con 0x7ff13c0bff80 2023-08-18T20:45:34.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400f040 con 0x7ff13c0bff80 2023-08-18T20:45:34.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c150be0 con 0x7ff13c0bff80 2023-08-18T20:45:34.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.107+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400fbe0 con 0x7ff13c0bff80 2023-08-18T20:45:34.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.108+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c150ec0 con 0x7ff13c0bff80 2023-08-18T20:45:34.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.108+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c1e9190 con 0x7ff13c0bff80 2023-08-18T20:45:34.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.109+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff13400fd80 con 0x7ff13c0bff80 2023-08-18T20:45:34.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.109+0000 7ff1327fc700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 0x7ff12006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:34.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.109+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff134088e20 con 0x7ff13c0bff80 2023-08-18T20:45:34.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.109+0000 7ff141dee700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 0x7ff12006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:34.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.110+0000 7ff141dee700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 0x7ff12006c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:34.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.114+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff134058210 con 0x7ff13c0bff80 2023-08-18T20:45:34.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.304+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff13c074730 con 0x7ff13c0bff80 2023-08-18T20:45:34.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.960+0000 7ff1327fc700 1 -- 172.21.15.121:0/3683548185 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff134057da0 con 0x7ff13c0bff80 2023-08-18T20:45:34.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.964+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 msgr2=0x7ff12006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.964+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 0x7ff12006c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c007000 comp rx=0 tx=0).stop 2023-08-18T20:45:34.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.964+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 msgr2=0x7ff13c144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:34.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.964+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0c1110 tx=0x7ff134011ed0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 shutdown_connections 2023-08-18T20:45:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ff12006a0e0 0x7ff12006c5a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff13c0bff80 0x7ff13c144330 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff128003a00 0x7ff13c1d8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 --2- 172.21.15.121:0/3683548185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13c151330 0x7ff13c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.967+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 >> 172.21.15.121:0/3683548185 conn(0x7ff13c0c6b10 msgr2=0x7ff13c149300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:34.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.969+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 shutdown_connections 2023-08-18T20:45:34.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:34.970+0000 7ff144052700 1 -- 172.21.15.121:0/3683548185 wait complete. 2023-08-18T20:45:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2023-08-18T20:45:34.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-18T20:45:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.117+0000 7fbacb56f700 1 Processor -- start 2023-08-18T20:45:35.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.117+0000 7fbacb56f700 1 -- start start 2023-08-18T20:45:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbacb56f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbac40c7440 0x7fbac414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbacb56f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac41529a0 con 0x7fbac406fd30 2023-08-18T20:45:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbacb56f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac4152c80 con 0x7fbac4152450 2023-08-18T20:45:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbacb56f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac4152f60 con 0x7fbac40c7440 2023-08-18T20:45:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac8b0a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbac40c7440 0x7fbac414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac930b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbac406fd30 0x7fbac40c6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50256/0 (socket says 172.21.15.121:50256) 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac930b700 1 -- 172.21.15.121:0/3426993582 learned_addr learned my addr 172.21.15.121:0/3426993582 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac8b0a700 1 -- 172.21.15.121:0/3426993582 >> v1:172.21.15.122:6789/0 conn(0x7fbac4152450 legacy=0x7fbac414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac8b0a700 1 -- 172.21.15.121:0/3426993582 >> v1:172.21.15.121:6789/0 conn(0x7fbac406fd30 legacy=0x7fbac40c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbabbfff700 1 -- 172.21.15.121:0/3426993582 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138527569 0 0) 0x7fbac41529a0 con 0x7fbac406fd30 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac8b0a700 1 -- 172.21.15.121:0/3426993582 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4153240 con 0x7fbac40c7440 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.118+0000 7fbac8b0a700 1 --2- 172.21.15.121:0/3426993582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac40c7440 0x7fbac414f3b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009840 tx=0x7fbac0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693be2441019e7d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbabbfff700 1 -- 172.21.15.121:0/3426993582 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0004230 con 0x7fbac40c7440 2023-08-18T20:45:35.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbabbfff700 1 -- 172.21.15.121:0/3426993582 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0004390 con 0x7fbac40c7440 2023-08-18T20:45:35.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbabbfff700 1 -- 172.21.15.121:0/3426993582 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00036a0 con 0x7fbac40c7440 2023-08-18T20:45:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 -- 172.21.15.121:0/3426993582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac40c7440 msgr2=0x7fbac414f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 --2- 172.21.15.121:0/3426993582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac40c7440 0x7fbac414f3b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009840 tx=0x7fbac0009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 -- 172.21.15.121:0/3426993582 shutdown_connections 2023-08-18T20:45:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 --2- 172.21.15.121:0/3426993582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac40c7440 0x7fbac414f3b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 -- 172.21.15.121:0/3426993582 >> 172.21.15.121:0/3426993582 conn(0x7fbac40c7bf0 msgr2=0x7fbac40c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 -- 172.21.15.121:0/3426993582 shutdown_connections 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.119+0000 7fbacb56f700 1 -- 172.21.15.121:0/3426993582 wait complete. 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.120+0000 7fbacb56f700 1 Processor -- start 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.120+0000 7fbacb56f700 1 -- start start 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 0x7fbac414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40beb10 con 0x7fbac406fd30 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac414f370 con 0x7fbac40c7440 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbacb56f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40be540 con 0x7fbac4152450 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43680/0 (socket says 172.21.15.121:43680) 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 -- 172.21.15.121:0/4119233038 learned_addr learned my addr 172.21.15.121:0/4119233038 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac8b0a700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 0x7fbac414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:35.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac9b0c700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 -- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 msgr2=0x7fbac414ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac414ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 -- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 msgr2=0x7fbac414e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 0x7fbac414e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac930b700 1 -- 172.21.15.121:0/4119233038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00094a0 con 0x7fbac406fd30 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.121+0000 7fbac8b0a700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 0x7fbac414e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbac930b700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c750 tx=0x7fbab400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4004c80 con 0x7fbac406fd30 2023-08-18T20:45:35.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4004e00 con 0x7fbac406fd30 2023-08-18T20:45:35.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4007310 con 0x7fbac406fd30 2023-08-18T20:45:35.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac40bdae0 con 0x7fbac406fd30 2023-08-18T20:45:35.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.122+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40a98f0 con 0x7fbac406fd30 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.123+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40a9bd0 con 0x7fbac406fd30 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.123+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbab4007470 con 0x7fbac406fd30 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.124+0000 7fbab9ffb700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 0x7fbaa806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.124+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fbab4088230 con 0x7fbac406fd30 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.124+0000 7fbac8b0a700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 0x7fbaa806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:35.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.124+0000 7fbac8b0a700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 0x7fbaa806c5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009790 tx=0x7fbac001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:35.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.128+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbab4053a10 con 0x7fbac406fd30 2023-08-18T20:45:35.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.358+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbac4074730 con 0x7fbac406fd30 2023-08-18T20:45:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.968+0000 7fbab9ffb700 1 -- 172.21.15.121:0/4119233038 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbab4057030 con 0x7fbac406fd30 2023-08-18T20:45:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 msgr2=0x7fbaa806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 0x7fbaa806c5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009790 tx=0x7fbac001c040 comp rx=0 tx=0).stop 2023-08-18T20:45:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 msgr2=0x7fbac40c0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c750 tx=0x7fbab400cb10 comp rx=0 tx=0).stop 2023-08-18T20:45:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 shutdown_connections 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbac4152450 0x7fbac414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbaa806a110 0x7fbaa806c5d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac406fd30 0x7fbac40c0e70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 --2- 172.21.15.121:0/4119233038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbac40c7440 0x7fbac414e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.971+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 >> 172.21.15.121:0/4119233038 conn(0x7fbac40c7bf0 msgr2=0x7fbac4071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.972+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 shutdown_connections 2023-08-18T20:45:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:35.972+0000 7fbacb56f700 1 -- 172.21.15.121:0/4119233038 wait complete. 2023-08-18T20:45:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 9 and data pool 10 2023-08-18T20:45:35.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:36.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.105+0000 7fa0483c7700 1 Processor -- start 2023-08-18T20:45:36.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 -- start start 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 0x7fa0400c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa040152250 0x7fa04006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa040155970 con 0x7fa04006a7e0 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04014ff70 con 0x7fa040152250 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.106+0000 7fa0483c7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04006e830 con 0x7fa04014fb90 2023-08-18T20:45:36.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa046964700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa04006a7e0 0x7fa040155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50286/0 (socket says 172.21.15.121:50286) 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa046964700 1 -- 172.21.15.121:0/50919153 learned_addr learned my addr 172.21.15.121:0/50919153 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa046163700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 0x7fa0400c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 --2- 172.21.15.121:0/50919153 >> v2:172.21.15.122:3300/0 conn(0x7fa040152250 0x7fa04006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045161700 1 -- 172.21.15.121:0/50919153 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050645871 0 0) 0x7fa040155970 con 0x7fa04006a7e0 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045161700 1 -- 172.21.15.121:0/50919153 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c0035b0 con 0x7fa04006a7e0 2023-08-18T20:45:36.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 -- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 msgr2=0x7fa0400c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 0x7fa0400c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 -- 172.21.15.121:0/50919153 >> v1:172.21.15.121:6789/0 conn(0x7fa04006a7e0 legacy=0x7fa040155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 -- 172.21.15.121:0/50919153 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04006df90 con 0x7fa040152250 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa046163700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 0x7fa0400c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045962700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa040152250 0x7fa04006a2a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa030009840 tx=0x7fa030009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de10da8dd0b94b52 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045161700 1 -- 172.21.15.121:0/50919153 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030011830 con 0x7fa040152250 2023-08-18T20:45:36.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045161700 1 -- 172.21.15.121:0/50919153 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030011990 con 0x7fa040152250 2023-08-18T20:45:36.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.107+0000 7fa045161700 1 -- 172.21.15.121:0/50919153 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030011d00 con 0x7fa040152250 2023-08-18T20:45:36.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 -- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa040152250 msgr2=0x7fa04006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa040152250 0x7fa04006a2a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa030009840 tx=0x7fa030009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:36.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 -- 172.21.15.121:0/50919153 shutdown_connections 2023-08-18T20:45:36.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa04014fb90 0x7fa0400c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 --2- 172.21.15.121:0/50919153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa040152250 0x7fa04006a2a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 -- 172.21.15.121:0/50919153 >> 172.21.15.121:0/50919153 conn(0x7fa0400c6b10 msgr2=0x7fa0400c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 -- 172.21.15.121:0/50919153 shutdown_connections 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.108+0000 7fa0483c7700 1 -- 172.21.15.121:0/50919153 wait complete. 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.109+0000 7fa0483c7700 1 Processor -- start 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.109+0000 7fa0483c7700 1 -- start start 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa04006a7e0 0x7fa0400bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa040152250 0x7fa04014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401ed720 con 0x7fa04014fb90 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa040148f20 con 0x7fa04006a7e0 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa0483c7700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401ecaa0 con 0x7fa040152250 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43708/0 (socket says 172.21.15.121:43708) 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 -- 172.21.15.121:0/543008144 learned_addr learned my addr 172.21.15.121:0/543008144 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:36.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa046163700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa04006a7e0 0x7fa0400bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa046964700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa040152250 0x7fa04014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 -- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa040152250 msgr2=0x7fa04014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa040152250 0x7fa04014e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 -- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa04006a7e0 msgr2=0x7fa0400bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa04006a7e0 0x7fa0400bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 -- 172.21.15.121:0/543008144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0094a0 con 0x7fa04014fb90 2023-08-18T20:45:36.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.110+0000 7fa045962700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.111+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030004550 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.111+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03001f070 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.111+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0300094a0 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.111+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300038c0 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.111+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0401ed060 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.112+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa040074730 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.112+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa030003a20 con 0x7fa04014fb90 2023-08-18T20:45:36.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.112+0000 7fa036ffd700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 0x7fa02406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.112+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa030021070 con 0x7fa04014fb90 2023-08-18T20:45:36.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.113+0000 7fa046163700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 0x7fa02406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.113+0000 7fa046163700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 0x7fa02406c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009cd0 tx=0x7fa03c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.117+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa0300553e0 con 0x7fa04014fb90 2023-08-18T20:45:36.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.305+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0401ed860 con 0x7fa04014fb90 2023-08-18T20:45:36.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.306+0000 7fa036ffd700 1 -- 172.21.15.121:0/543008144 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18296 (secure 0 0 0) 0x7fa030058a00 con 0x7fa04014fb90 2023-08-18T20:45:36.306 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:36.306 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":51,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:35.359167+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 msgr2=0x7fa02406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 0x7fa02406c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009cd0 tx=0x7fa03c009210 comp rx=0 tx=0).stop 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 msgr2=0x7fa04014e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030004750 comp rx=0 tx=0).stop 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 shutdown_connections 2023-08-18T20:45:36.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa040152250 0x7fa04014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa04006a7e0 0x7fa0400bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa02406a0e0 0x7fa02406c5a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 --2- 172.21.15.121:0/543008144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa04014fb90 0x7fa04014e1f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 >> 172.21.15.121:0/543008144 conn(0x7fa0400c6b10 msgr2=0x7fa0400c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 shutdown_connections 2023-08-18T20:45:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.308+0000 7fa0483c7700 1 -- 172.21.15.121:0/543008144 wait complete. 2023-08-18T20:45:36.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:36.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.440+0000 7f9496d15700 1 Processor -- start 2023-08-18T20:45:36.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.440+0000 7f9496d15700 1 -- start start 2023-08-18T20:45:36.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f9496d15700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 0x7f94900c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f9496d15700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f94900c2c80 0x7f94900c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f9496d15700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490151be0 con 0x7f94900c6120 2023-08-18T20:45:36.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f9496d15700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949014ed20 con 0x7f94900c2c80 2023-08-18T20:45:36.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f9496d15700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c20d0 con 0x7f94900c6560 2023-08-18T20:45:36.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f948ffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 0x7f94900c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.441+0000 7f94952b2700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f94900c2c80 0x7f94900c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f948ffff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 0x7f94900c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40126/0 (socket says 172.21.15.121:40126) 2023-08-18T20:45:36.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f948ffff700 1 -- 172.21.15.121:0/1204091000 learned_addr learned my addr 172.21.15.121:0/1204091000 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:36.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f94952b2700 1 -- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 msgr2=0x7f94900c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f94952b2700 1 --2- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 0x7f94900c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f94952b2700 1 -- 172.21.15.121:0/1204091000 >> v1:172.21.15.122:6789/0 conn(0x7f94900c6120 legacy=0x7f94900bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f94952b2700 1 -- 172.21.15.121:0/1204091000 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900c23b0 con 0x7f94900c2c80 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f94952b2700 1 --2- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94900c4f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f948800bfa0 tx=0x7f948800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5d23b6683678ca server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f948f7fe700 1 -- 172.21.15.121:0/1204091000 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488010070 con 0x7f94900c2c80 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f948f7fe700 1 -- 172.21.15.121:0/1204091000 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800b2e0 con 0x7f94900c2c80 2023-08-18T20:45:36.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.442+0000 7f948f7fe700 1 -- 172.21.15.121:0/1204091000 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800dc40 con 0x7f94900c2c80 2023-08-18T20:45:36.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 -- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 msgr2=0x7f94900c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 --2- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94900c4f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f948800bfa0 tx=0x7f948800d330 comp rx=0 tx=0).stop 2023-08-18T20:45:36.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 -- 172.21.15.121:0/1204091000 shutdown_connections 2023-08-18T20:45:36.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 --2- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94900c4f60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 --2- 172.21.15.121:0/1204091000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6560 0x7f94900c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 -- 172.21.15.121:0/1204091000 >> 172.21.15.121:0/1204091000 conn(0x7f94900c35a0 msgr2=0x7f94900c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 -- 172.21.15.121:0/1204091000 shutdown_connections 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.443+0000 7f9496d15700 1 -- 172.21.15.121:0/1204091000 wait complete. 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.444+0000 7f9496d15700 1 Processor -- start 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.444+0000 7f9496d15700 1 -- start start 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94901e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 0x7f94900bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900bf490 con 0x7f94900c6560 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901e9610 con 0x7f94900c2c80 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9496d15700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900beb60 con 0x7f94900c6120 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43724/0 (socket says 172.21.15.121:43724) 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 -- 172.21.15.121:0/3068035256 learned_addr learned my addr 172.21.15.121:0/3068035256 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:36.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f948ffff700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 0x7f94900bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9494ab1700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94901e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 -- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 msgr2=0x7f94900bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 0x7f94900bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 -- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 msgr2=0x7f94901e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94901e8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 -- 172.21.15.121:0/3068035256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948800bc80 con 0x7f94900c6560 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f948ffff700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 0x7f94900bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:36.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f9494ab1700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94901e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.445+0000 7f94952b2700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9488014000 tx=0x7f9488004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.446+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800b450 con 0x7f94900c6560 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.446+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488004250 con 0x7f94900c6560 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.446+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900bee40 con 0x7f94900c6560 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.446+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880045e0 con 0x7f94900c6560 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.446+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490145e00 con 0x7f94900c6560 2023-08-18T20:45:36.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.447+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900bf640 con 0x7f94900c6560 2023-08-18T20:45:36.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.447+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9488004740 con 0x7f94900c6560 2023-08-18T20:45:36.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.447+0000 7f948d7fa700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 0x7f947406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.448+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f948808b8b0 con 0x7f94900c6560 2023-08-18T20:45:36.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.448+0000 7f9494ab1700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 0x7f947406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.448+0000 7f9494ab1700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 0x7f947406c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9484000f60 tx=0x7f9484009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.452+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f94900bf640 con 0x7f94900c6560 2023-08-18T20:45:36.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.643+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94900bf640 con 0x7f94900c6560 2023-08-18T20:45:36.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.645+0000 7f948d7fa700 1 -- 172.21.15.121:0/3068035256 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18296 (secure 0 0 0) 0x7f94900bf640 con 0x7f94900c6560 2023-08-18T20:45:36.644 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:36.645 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":51,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:35.359167+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:36.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 msgr2=0x7f947406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 0x7f947406c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9484000f60 tx=0x7f9484009040 comp rx=0 tx=0).stop 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 msgr2=0x7f94900bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9488014000 tx=0x7f9488004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 shutdown_connections 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f947406a0e0 0x7f947406c5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94900c6560 0x7f94900bfe60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94900c2c80 0x7f94901e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 --2- 172.21.15.121:0/3068035256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94900c6120 0x7f94900bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 >> 172.21.15.121:0/3068035256 conn(0x7f94900c35a0 msgr2=0x7f94900c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 shutdown_connections 2023-08-18T20:45:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.647+0000 7f9496d15700 1 -- 172.21.15.121:0/3068035256 wait complete. 2023-08-18T20:45:36.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-18T20:45:36.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.783+0000 7f2e8f99f700 1 Processor -- start 2023-08-18T20:45:36.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.783+0000 7f2e8f99f700 1 -- start start 2023-08-18T20:45:36.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.784+0000 7f2e8f99f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.784+0000 7f2e8f99f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.784+0000 7f2e8f99f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e880c4f40 con 0x7f2e880a6290 2023-08-18T20:45:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.784+0000 7f2e8f99f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880c6120 con 0x7f2e880c0c50 2023-08-18T20:45:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.784+0000 7f2e8f99f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e881551f0 con 0x7f2e8806a7e0 2023-08-18T20:45:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8d73b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40140/0 (socket says 172.21.15.121:40140) 2023-08-18T20:45:36.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8d73b700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53566/0 (socket says 172.21.15.121:53566) 2023-08-18T20:45:36.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 -- 172.21.15.121:0/3276916137 learned_addr learned my addr 172.21.15.121:0/3276916137 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:36.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 -- 172.21.15.121:0/3276916137 >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 msgr2=0x7f2e8806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:36.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 --2- 172.21.15.121:0/3276916137 >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 -- 172.21.15.121:0/3276916137 >> v1:172.21.15.122:6789/0 conn(0x7f2e880a6290 legacy=0x7f2e88071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 -- 172.21.15.121:0/3276916137 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880c63a0 con 0x7f2e8806a7e0 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8d73b700 1 --2- 172.21.15.121:0/3276916137 >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e8cf3a700 1 --2- 172.21.15.121:0/3276916137 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098f0 tx=0x7f2e84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5508b6fb8a28f505 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e7ffff700 1 -- 172.21.15.121:0/3276916137 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84011830 con 0x7f2e8806a7e0 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e7ffff700 1 -- 172.21.15.121:0/3276916137 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84011990 con 0x7f2e8806a7e0 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.785+0000 7f2e7ffff700 1 -- 172.21.15.121:0/3276916137 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84011d20 con 0x7f2e8806a7e0 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 -- 172.21.15.121:0/3276916137 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 msgr2=0x7f2e880c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/3276916137 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098f0 tx=0x7f2e84009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 -- 172.21.15.121:0/3276916137 shutdown_connections 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/3276916137 >> v2:172.21.15.122:3300/0 conn(0x7f2e880c0c50 0x7f2e8806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/3276916137 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e880c53d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 -- 172.21.15.121:0/3276916137 >> 172.21.15.121:0/3276916137 conn(0x7f2e880c6b10 msgr2=0x7f2e880c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 -- 172.21.15.121:0/3276916137 shutdown_connections 2023-08-18T20:45:36.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.786+0000 7f2e8f99f700 1 -- 172.21.15.121:0/3276916137 wait complete. 2023-08-18T20:45:36.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.787+0000 7f2e8f99f700 1 Processor -- start 2023-08-18T20:45:36.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.787+0000 7f2e8f99f700 1 -- start start 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e880a6290 0x7f2e88153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 0x7f2e88149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88153180 con 0x7f2e880c0c50 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e881569f0 con 0x7f2e880a6290 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88154950 con 0x7f2e8806a7e0 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8d73b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 0x7f2e88149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8d73b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40144/0 (socket says 172.21.15.121:40144) 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8d73b700 1 -- 172.21.15.121:0/2323805189 learned_addr learned my addr 172.21.15.121:0/2323805189 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8cf3a700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e880a6290 0x7f2e88153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 -- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 msgr2=0x7f2e881564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 -- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e880a6290 msgr2=0x7f2e88153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:36.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e880a6290 0x7f2e88153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 -- 172.21.15.121:0/2323805189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780094a0 con 0x7f2e880c0c50 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8d73b700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8df3c700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 0x7f2e88149b30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000cb90 tx=0x7f2e8000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80003c00 con 0x7f2e880c0c50 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80003d60 con 0x7f2e880c0c50 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e84009550 con 0x7f2e880c0c50 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.788+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000aa80 con 0x7f2e880c0c50 2023-08-18T20:45:36.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.789+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88152e10 con 0x7f2e880c0c50 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.790+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e88074730 con 0x7f2e880c0c50 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.790+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e8000abe0 con 0x7f2e880c0c50 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.790+0000 7f2e7dffb700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 0x7f2e6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.790+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e80088500 con 0x7f2e880c0c50 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.790+0000 7f2e8d73b700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 0x7f2e6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:36.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.791+0000 7f2e8d73b700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 0x7f2e6c06c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e880acc00 tx=0x7f2e78009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:36.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:36.795+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2e80053b70 con 0x7f2e880c0c50 2023-08-18T20:45:37.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.031+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e88151db0 con 0x7f2e880c0c50 2023-08-18T20:45:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.981+0000 7f2e7dffb700 1 -- 172.21.15.121:0/2323805189 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e80057190 con 0x7f2e880c0c50 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 msgr2=0x7f2e6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 0x7f2e6c06c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e880acc00 tx=0x7f2e78009210 comp rx=0 tx=0).stop 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 msgr2=0x7f2e88149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 0x7f2e88149b30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000cb90 tx=0x7f2e8000cea0 comp rx=0 tx=0).stop 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 shutdown_connections 2023-08-18T20:45:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2e6c06a0e0 0x7f2e6c06c5a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e880c0c50 0x7f2e88149b30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e8806a7e0 0x7f2e881564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 --2- 172.21.15.121:0/2323805189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e880a6290 0x7f2e88153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 >> 172.21.15.121:0/2323805189 conn(0x7f2e880c6b10 msgr2=0x7f2e880a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 shutdown_connections 2023-08-18T20:45:37.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:37.983+0000 7f2e8f99f700 1 -- 172.21.15.121:0/2323805189 wait complete. 2023-08-18T20:45:37.997 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-18T20:45:37.997 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-18T20:45:38.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.123+0000 7fb61bd24700 1 Processor -- start 2023-08-18T20:45:38.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.123+0000 7fb61bd24700 1 -- start start 2023-08-18T20:45:38.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61bd24700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 0x7fb6140c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61bd24700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61bd24700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140c21f0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61bd24700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140c2ba0 con 0x7fb61406a510 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61bd24700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c6300 con 0x7fb614157c10 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61a2c1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb619ac0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 0x7fb6140c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61a2c1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40156/0 (socket says 172.21.15.121:40156) 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb61a2c1700 1 -- 172.21.15.121:0/4211130911 learned_addr learned my addr 172.21.15.121:0/4211130911 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:38.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.124+0000 7fb619ac0700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 0x7fb6140c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:53580/0 (socket says 172.21.15.121:53580) 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61a2c1700 1 -- 172.21.15.121:0/4211130911 >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 msgr2=0x7fb6140c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61a2c1700 1 --2- 172.21.15.121:0/4211130911 >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 0x7fb6140c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61a2c1700 1 -- 172.21.15.121:0/4211130911 >> v1:172.21.15.122:6789/0 conn(0x7fb6140c1cf0 legacy=0x7fb614151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61a2c1700 1 -- 172.21.15.121:0/4211130911 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140c5b20 con 0x7fb614157c10 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61a2c1700 1 --2- 172.21.15.121:0/4211130911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d019b0b350d28c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb618abe700 1 -- 172.21.15.121:0/4211130911 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00e070 con 0x7fb614157c10 2023-08-18T20:45:38.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb618abe700 1 -- 172.21.15.121:0/4211130911 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00b910 con 0x7fb614157c10 2023-08-18T20:45:38.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb618abe700 1 -- 172.21.15.121:0/4211130911 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00bcc0 con 0x7fb614157c10 2023-08-18T20:45:38.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 -- 172.21.15.121:0/4211130911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 msgr2=0x7fb6141580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 --2- 172.21.15.121:0/4211130911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:38.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 -- 172.21.15.121:0/4211130911 shutdown_connections 2023-08-18T20:45:38.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 --2- 172.21.15.121:0/4211130911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb6141580a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 --2- 172.21.15.121:0/4211130911 >> v2:172.21.15.122:3300/0 conn(0x7fb61406a510 0x7fb6140c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.125+0000 7fb61bd24700 1 -- 172.21.15.121:0/4211130911 >> 172.21.15.121:0/4211130911 conn(0x7fb6140c6b10 msgr2=0x7fb6140c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.126+0000 7fb61bd24700 1 -- 172.21.15.121:0/4211130911 shutdown_connections 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.126+0000 7fb61bd24700 1 -- 172.21.15.121:0/4211130911 wait complete. 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 Processor -- start 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 -- start start 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb61406a510 0x7fb6141e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb61414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406d5b0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406c930 con 0x7fb61406a510 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb61bd24700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406cc10 con 0x7fb614157c10 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb6192bf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb6192bf700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43748/0 (socket says 172.21.15.121:43748) 2023-08-18T20:45:38.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.127+0000 7fb6192bf700 1 -- 172.21.15.121:0/3745973688 learned_addr learned my addr 172.21.15.121:0/3745973688 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb619ac0700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb61406a510 0x7fb6141e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb61a2c1700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb61414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 -- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 msgr2=0x7fb61414a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb61414a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 -- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb61406a510 msgr2=0x7fb6141e9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb61406a510 0x7fb6141e9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 -- 172.21.15.121:0/3745973688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009b30 con 0x7fb6140c1cf0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb6192bf700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c4e0 tx=0x7fb61000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100052d0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610005430 con 0x7fb6140c1cf0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100038c0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61406cef0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.128+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61414a730 con 0x7fb6140c1cf0 2023-08-18T20:45:38.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.129+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140c6590 con 0x7fb6140c1cf0 2023-08-18T20:45:38.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.129+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb610003a20 con 0x7fb6140c1cf0 2023-08-18T20:45:38.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.130+0000 7fb60a7fc700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 0x7fb5f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:38.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.130+0000 7fb619ac0700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 0x7fb5f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:38.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.130+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6100879b0 con 0x7fb6140c1cf0 2023-08-18T20:45:38.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.130+0000 7fb619ac0700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 0x7fb5f806c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b70 tx=0x7fb604008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:38.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.134+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb6140c6590 con 0x7fb6140c1cf0 2023-08-18T20:45:38.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.367+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb6140c6590 con 0x7fb6140c1cf0 2023-08-18T20:45:38.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.994+0000 7fb60a7fc700 1 -- 172.21.15.121:0/3745973688 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb6140c6590 con 0x7fb6140c1cf0 2023-08-18T20:45:38.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 msgr2=0x7fb5f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 0x7fb5f806c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b70 tx=0x7fb604008040 comp rx=0 tx=0).stop 2023-08-18T20:45:38.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 msgr2=0x7fb61406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:38.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c4e0 tx=0x7fb61000c8a0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 shutdown_connections 2023-08-18T20:45:38.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb614157c10 0x7fb61414a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb61406a510 0x7fb6141e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fb5f806a0e0 0x7fb5f806c5a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 --2- 172.21.15.121:0/3745973688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6140c1cf0 0x7fb61406d9d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 >> 172.21.15.121:0/3745973688 conn(0x7fb6140c6b10 msgr2=0x7fb614073340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 shutdown_connections 2023-08-18T20:45:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:38.997+0000 7fb61bd24700 1 -- 172.21.15.121:0/3745973688 wait complete. 2023-08-18T20:45:39.010 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-18T20:45:39.010 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:39.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.133+0000 7fd840da6700 1 Processor -- start 2023-08-18T20:45:39.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.133+0000 7fd840da6700 1 -- start start 2023-08-18T20:45:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd840da6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd83c14ed30 0x7fd83c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd840da6700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd83c070950 0x7fd83c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd840da6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0c2260 con 0x7fd83c14e950 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd840da6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c0a6630 con 0x7fd83c14ed30 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd840da6700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c151d90 con 0x7fd83c070950 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd839d9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd83c14ed30 0x7fd83c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd83a59c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd83c14e950 0x7fd83c0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50338/0 (socket says 172.21.15.121:50338) 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd83a59c700 1 -- 172.21.15.121:0/4071820295 learned_addr learned my addr 172.21.15.121:0/4071820295 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd839d9b700 1 -- 172.21.15.121:0/4071820295 >> v2:172.21.15.122:3300/0 conn(0x7fd83c070950 msgr2=0x7fd83c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4071820295 >> v2:172.21.15.122:3300/0 conn(0x7fd83c070950 0x7fd83c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd839d9b700 1 -- 172.21.15.121:0/4071820295 >> v1:172.21.15.121:6789/0 conn(0x7fd83c14e950 legacy=0x7fd83c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd839d9b700 1 -- 172.21.15.121:0/4071820295 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c152070 con 0x7fd83c14ed30 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.134+0000 7fd83959a700 1 -- 172.21.15.121:0/4071820295 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657205451 0 0) 0x7fd83c0c2260 con 0x7fd83c14e950 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4071820295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c14ed30 0x7fd83c0c2ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0c64f0 tx=0x7fd82c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc320da6837a07b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd83959a700 1 -- 172.21.15.121:0/4071820295 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011830 con 0x7fd83c14ed30 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd83959a700 1 -- 172.21.15.121:0/4071820295 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c011990 con 0x7fd83c14ed30 2023-08-18T20:45:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd83959a700 1 -- 172.21.15.121:0/4071820295 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011d20 con 0x7fd83c14ed30 2023-08-18T20:45:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 -- 172.21.15.121:0/4071820295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c14ed30 msgr2=0x7fd83c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 --2- 172.21.15.121:0/4071820295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c14ed30 0x7fd83c0c2ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0c64f0 tx=0x7fd82c009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 -- 172.21.15.121:0/4071820295 shutdown_connections 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 --2- 172.21.15.121:0/4071820295 >> v2:172.21.15.122:3300/0 conn(0x7fd83c070950 0x7fd83c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 --2- 172.21.15.121:0/4071820295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c14ed30 0x7fd83c0c2ed0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 -- 172.21.15.121:0/4071820295 >> 172.21.15.121:0/4071820295 conn(0x7fd83c0c6b10 msgr2=0x7fd83c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 -- 172.21.15.121:0/4071820295 shutdown_connections 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.135+0000 7fd840da6700 1 -- 172.21.15.121:0/4071820295 wait complete. 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 Processor -- start 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 -- start start 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 0x7fd83c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 0x7fd83c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1db350 con 0x7fd83c070950 2023-08-18T20:45:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1459c0 con 0x7fd83c14ed30 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd840da6700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0c0a00 con 0x7fd83c14e950 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd83a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd83a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43762/0 (socket says 172.21.15.121:43762) 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.137+0000 7fd83a59c700 1 -- 172.21.15.121:0/4046830332 learned_addr learned my addr 172.21.15.121:0/4046830332 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 0x7fd83c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 -- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 msgr2=0x7fd83c1448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83ad9d700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 0x7fd83c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 0x7fd83c1448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 -- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 msgr2=0x7fd83c144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 0x7fd83c144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 -- 172.21.15.121:0/4046830332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0094a0 con 0x7fd83c070950 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 0x7fd83c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83ad9d700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 0x7fd83c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd83a59c700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c750 tx=0x7fd83000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830004c80 con 0x7fd83c070950 2023-08-18T20:45:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830004e00 con 0x7fd83c070950 2023-08-18T20:45:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0c0720 con 0x7fd83c070950 2023-08-18T20:45:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830007310 con 0x7fd83c070950 2023-08-18T20:45:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.138+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c14b0f0 con 0x7fd83c070950 2023-08-18T20:45:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.139+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c074730 con 0x7fd83c070950 2023-08-18T20:45:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.139+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd830007470 con 0x7fd83c070950 2023-08-18T20:45:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.140+0000 7fd82affd700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.140+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd830088290 con 0x7fd83c070950 2023-08-18T20:45:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.140+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.140+0000 7fd839d9b700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06b340 tx=0x7fd82c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.144+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd830053a10 con 0x7fd83c070950 2023-08-18T20:45:39.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.374+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd83c150630 con 0x7fd83c070950 2023-08-18T20:45:39.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.375+0000 7fd82affd700 1 -- 172.21.15.121:0/4046830332 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4885 (secure 0 0 0) 0x7fd830057030 con 0x7fd83c070950 2023-08-18T20:45:39.375 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:39.375 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1055475719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1055475719},{"type":"v1","addr":"172.21.15.122:6834","nonce":1055475719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1049001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":1049001574},{"type":"v1","addr":"172.21.15.122:6835","nonce":1049001574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5841,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2177141850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2177141850},{"type":"v1","addr":"172.21.15.121:6836","nonce":2177141850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:45:35.359510+0000","modified":"2023-08-18T20:45:38.985103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5844":{"gid":5844,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/891706193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":891706193},{"type":"v1","addr":"172.21.15.121:6837","nonce":891706193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-18T20:45:39.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 msgr2=0x7fd81c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06b340 tx=0x7fd82c008030 comp rx=0 tx=0).stop 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 msgr2=0x7fd83c14ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c750 tx=0x7fd83000cb10 comp rx=0 tx=0).stop 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 shutdown_connections 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd83c14ed30 0x7fd83c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd83c070950 0x7fd83c14ddc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 --2- 172.21.15.121:0/4046830332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd83c14e950 0x7fd83c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 >> 172.21.15.121:0/4046830332 conn(0x7fd83c0c6b10 msgr2=0x7fd83c1db930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:39.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 shutdown_connections 2023-08-18T20:45:39.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.377+0000 7fd840da6700 1 -- 172.21.15.121:0/4046830332 wait complete. 2023-08-18T20:45:39.378 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2023-08-18T20:45:39.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:39.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.509+0000 7fed0d03c700 1 Processor -- start 2023-08-18T20:45:39.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.509+0000 7fed0d03c700 1 -- start start 2023-08-18T20:45:39.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0d03c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed081518e0 0x7fed08066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0d03c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed080bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0d03c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0806cc30 con 0x7fed080c1030 2023-08-18T20:45:39.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0d03c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080c0b80 con 0x7fed081518e0 2023-08-18T20:45:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0d03c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed08155260 con 0x7fed080bf550 2023-08-18T20:45:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed06d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed081518e0 0x7fed08066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed06d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed081518e0 0x7fed08066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43770/0 (socket says 172.21.15.121:43770) 2023-08-18T20:45:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed06d9d700 1 -- 172.21.15.121:0/502243164 learned_addr learned my addr 172.21.15.121:0/502243164 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.510+0000 7fed0759e700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed080bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed06d9d700 1 -- 172.21.15.121:0/502243164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 msgr2=0x7fed080bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed06d9d700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed080bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed06d9d700 1 -- 172.21.15.121:0/502243164 >> v1:172.21.15.122:6789/0 conn(0x7fed080c1030 legacy=0x7fed0806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed06d9d700 1 -- 172.21.15.121:0/502243164 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0806ce80 con 0x7fed081518e0 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed06d9d700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed08066340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098f0 tx=0x7fecfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56742938eead74c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed05d9b700 1 -- 172.21.15.121:0/502243164 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011830 con 0x7fed081518e0 2023-08-18T20:45:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed05d9b700 1 -- 172.21.15.121:0/502243164 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc011990 con 0x7fed081518e0 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed05d9b700 1 -- 172.21.15.121:0/502243164 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011d20 con 0x7fed081518e0 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 -- 172.21.15.121:0/502243164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 msgr2=0x7fed08066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed08066340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098f0 tx=0x7fecfc009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 -- 172.21.15.121:0/502243164 shutdown_connections 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed080bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 --2- 172.21.15.121:0/502243164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed08066340 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.511+0000 7fed0d03c700 1 -- 172.21.15.121:0/502243164 >> 172.21.15.121:0/502243164 conn(0x7fed080c2ca0 msgr2=0x7fed080c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.512+0000 7fed0d03c700 1 -- 172.21.15.121:0/502243164 shutdown_connections 2023-08-18T20:45:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.512+0000 7fed0d03c700 1 -- 172.21.15.121:0/502243164 wait complete. 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.513+0000 7fed0d03c700 1 Processor -- start 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.513+0000 7fed0d03c700 1 -- start start 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed0814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 0x7fed08152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080aa1f0 con 0x7fed081518e0 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0814a440 con 0x7fed080c1030 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0814a720 con 0x7fed080bf550 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43778/0 (socket says 172.21.15.121:43778) 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 -- 172.21.15.121:0/4292535476 learned_addr learned my addr 172.21.15.121:0/4292535476 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed06d9d700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed0814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0659c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 0x7fed08152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 -- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 msgr2=0x7fed0814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed0814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 -- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 msgr2=0x7fed08152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 0x7fed08152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 -- 172.21.15.121:0/4292535476 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc009550 con 0x7fed081518e0 2023-08-18T20:45:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0659c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 0x7fed08152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0759e700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fed0000efc0 tx=0x7fed0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00009ea0 con 0x7fed081518e0 2023-08-18T20:45:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0000f040 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed080a9e80 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00014480 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.514+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed08156090 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.515+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0806e460 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.516+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed000145e0 con 0x7fed081518e0 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.516+0000 7fecef7fe700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 0x7fecf406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.516+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed000890d0 con 0x7fed081518e0 2023-08-18T20:45:39.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.516+0000 7fed06d9d700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 0x7fecf406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.516+0000 7fed06d9d700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 0x7fecf406c5d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecfc014040 tx=0x7fecfc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.520+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fed00054850 con 0x7fed081518e0 2023-08-18T20:45:39.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.712+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed08074730 con 0x7fed081518e0 2023-08-18T20:45:39.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.713+0000 7fecef7fe700 1 -- 172.21.15.121:0/4292535476 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18283 (secure 0 0 0) 0x7fed00057e70 con 0x7fed081518e0 2023-08-18T20:45:39.713 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:39.713 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:36.882005+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:39.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 msgr2=0x7fecf406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 0x7fecf406c5d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecfc014040 tx=0x7fecfc008030 comp rx=0 tx=0).stop 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 msgr2=0x7fed081534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fed0000efc0 tx=0x7fed0000c3a0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 shutdown_connections 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fecf406a110 0x7fecf406c5d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed081518e0 0x7fed081534f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed080bf550 0x7fed0814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 --2- 172.21.15.121:0/4292535476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed080c1030 0x7fed08152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 >> 172.21.15.121:0/4292535476 conn(0x7fed080c2ca0 msgr2=0x7fed080c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:39.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 shutdown_connections 2023-08-18T20:45:39.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.715+0000 7fed0d03c700 1 -- 172.21.15.121:0/4292535476 wait complete. 2023-08-18T20:45:39.727 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-18T20:45:39.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:45:39.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.847+0000 7f3bb7f94700 1 Processor -- start 2023-08-18T20:45:39.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.847+0000 7f3bb7f94700 1 -- start start 2023-08-18T20:45:39.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 0x7f3bb00c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3bb0152450 0x7f3bb00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb01559c0 0x7f3bb014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb01529a0 con 0x7f3bb0152450 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb0152c80 con 0x7f3bb006fd30 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb7f94700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0152f60 con 0x7f3bb01559c0 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb552f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3bb0152450 0x7f3bb00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb552f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3bb0152450 0x7f3bb00c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43784/0 (socket says 172.21.15.121:43784) 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.848+0000 7f3bb552f700 1 -- 172.21.15.121:0/3366235116 learned_addr learned my addr 172.21.15.121:0/3366235116 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb6531700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb01559c0 0x7f3bb014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb5d30700 1 --2- 172.21.15.121:0/3366235116 >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 0x7f3bb00c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 -- 172.21.15.121:0/3366235116 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb01559c0 msgr2=0x7f3bb014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb01559c0 0x7f3bb014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 -- 172.21.15.121:0/3366235116 >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 msgr2=0x7f3bb00c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 --2- 172.21.15.121:0/3366235116 >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 0x7f3bb00c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 -- 172.21.15.121:0/3366235116 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0153240 con 0x7f3bb0152450 2023-08-18T20:45:39.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb5d30700 1 --2- 172.21.15.121:0/3366235116 >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 0x7f3bb00c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb552f700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb0152450 0x7f3bb00c7270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006eec0 tx=0x7f3bac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f16be7e001965c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb4d2e700 1 -- 172.21.15.121:0/3366235116 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00b870 con 0x7f3bb0152450 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb4d2e700 1 -- 172.21.15.121:0/3366235116 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00b9d0 con 0x7f3bb0152450 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb4d2e700 1 -- 172.21.15.121:0/3366235116 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00bd60 con 0x7f3bb0152450 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb7f94700 1 -- 172.21.15.121:0/3366235116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb0152450 msgr2=0x7f3bb00c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.849+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb0152450 0x7f3bb00c7270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006eec0 tx=0x7f3bac009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 -- 172.21.15.121:0/3366235116 shutdown_connections 2023-08-18T20:45:39.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/3366235116 >> v2:172.21.15.122:3300/0 conn(0x7f3bb006fd30 0x7f3bb00c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb01559c0 0x7f3bb014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/3366235116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb0152450 0x7f3bb00c7270 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 -- 172.21.15.121:0/3366235116 >> 172.21.15.121:0/3366235116 conn(0x7f3bb00c7bf0 msgr2=0x7f3bb00c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 -- 172.21.15.121:0/3366235116 shutdown_connections 2023-08-18T20:45:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.850+0000 7f3bb7f94700 1 -- 172.21.15.121:0/3366235116 wait complete. 2023-08-18T20:45:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 Processor -- start 2023-08-18T20:45:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 -- start start 2023-08-18T20:45:39.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb006fd30 0x7f3bb01eb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb0152450 0x7f3bb00aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00ad3b0 con 0x7f3bb01559c0 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00be390 con 0x7f3bb006fd30 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.851+0000 7f3bb7f94700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00a9840 con 0x7f3bb0152450 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43790/0 (socket says 172.21.15.121:43790) 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 -- 172.21.15.121:0/2882247721 learned_addr learned my addr 172.21.15.121:0/2882247721 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb5d30700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb006fd30 0x7f3bb01eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb552f700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb0152450 0x7f3bb00aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 -- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb0152450 msgr2=0x7f3bb00aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb0152450 0x7f3bb00aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 -- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb006fd30 msgr2=0x7f3bb01eb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb006fd30 0x7f3bb01eb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:39.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 -- 172.21.15.121:0/2882247721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009550 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb6531700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8007e60 tx=0x7f3ba800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba800ed30 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8014420 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80147d0 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb00a9b20 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.852+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00acf60 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.853+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb00ad840 con 0x7f3bb01559c0 2023-08-18T20:45:39.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.854+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ba8014930 con 0x7f3bb01559c0 2023-08-18T20:45:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.854+0000 7f3ba67fc700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.854+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ba8088af0 con 0x7f3bb01559c0 2023-08-18T20:45:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.854+0000 7f3bb5d30700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.854+0000 7f3bb5d30700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00c1c20 tx=0x7f3ba0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:39.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:39.858+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3bb00ad840 con 0x7f3bb01559c0 2023-08-18T20:45:39.941 INFO:tasks.ceph.mds.c.smithi121.stderr:2023-08-18T20:45:39.942+0000 7f3fe0d6d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:45:40.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.047+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bb00a99b0 con 0x7f3b9406a0e0 2023-08-18T20:45:40.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.055+0000 7f3ba67fc700 1 -- 172.21.15.121:0/2882247721 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311471 (secure 0 0 0) 0x7f3bb00a99b0 con 0x7f3b9406a0e0 2023-08-18T20:45:40.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 msgr2=0x7f3b9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00c1c20 tx=0x7f3ba0008040 comp rx=0 tx=0).stop 2023-08-18T20:45:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 msgr2=0x7f3bb00bd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8007e60 tx=0x7f3ba800e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 shutdown_connections 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bb01559c0 0x7f3bb00bd8f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb006fd30 0x7f3bb01eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 --2- 172.21.15.121:0/2882247721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bb0152450 0x7f3bb00aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 >> 172.21.15.121:0/2882247721 conn(0x7f3bb00c7bf0 msgr2=0x7f3bb0154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 shutdown_connections 2023-08-18T20:45:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.059+0000 7f3bb7f94700 1 -- 172.21.15.121:0/2882247721 wait complete. 2023-08-18T20:45:40.061 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:45:40.071 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-08-18T20:45:38.941026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226092,"kb_used_data":5824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754748628,"statfs":{"total":773094113280,"available":772862595072,"internally_reserved":0,"allocated":5963776,"data_stored":3277008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985321"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909754+0000","last_change":"2023-08-18T20:45:35.904053+0000","last_active":"2023-08-18T20:45:35.909754+0000","last_peered":"2023-08-18T20:45:35.909754+0000","last_clean":"2023-08-18T20:45:35.909754+0000","last_became_active":"2023-08-18T20:45:35.903735+0000","last_became_peered":"2023-08-18T20:45:35.903735+0000","last_unstale":"2023-08-18T20:45:35.909754+0000","last_undegraded":"2023-08-18T20:45:35.909754+0000","last_fullsized":"2023-08-18T20:45:35.909754+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.902649+0000","last_change":"2023-08-18T20:45:35.899964+0000","last_active":"2023-08-18T20:45:35.902649+0000","last_peered":"2023-08-18T20:45:35.902649+0000","last_clean":"2023-08-18T20:45:35.902649+0000","last_became_active":"2023-08-18T20:45:35.899670+0000","last_became_peered":"2023-08-18T20:45:35.899670+0000","last_unstale":"2023-08-18T20:45:35.902649+0000","last_undegraded":"2023-08-18T20:45:35.902649+0000","last_fullsized":"2023-08-18T20:45:35.902649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:14:01.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911080+0000","last_change":"2023-08-18T20:45:35.906068+0000","last_active":"2023-08-18T20:45:35.911080+0000","last_peered":"2023-08-18T20:45:35.911080+0000","last_clean":"2023-08-18T20:45:35.911080+0000","last_became_active":"2023-08-18T20:45:35.905746+0000","last_became_peered":"2023-08-18T20:45:35.905746+0000","last_unstale":"2023-08-18T20:45:35.911080+0000","last_undegraded":"2023-08-18T20:45:35.911080+0000","last_fullsized":"2023-08-18T20:45:35.911080+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:34:10.039790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909956+0000","last_change":"2023-08-18T20:45:35.902831+0000","last_active":"2023-08-18T20:45:35.909956+0000","last_peered":"2023-08-18T20:45:35.909956+0000","last_clean":"2023-08-18T20:45:35.909956+0000","last_became_active":"2023-08-18T20:45:35.902583+0000","last_became_peered":"2023-08-18T20:45:35.902583+0000","last_unstale":"2023-08-18T20:45:35.909956+0000","last_undegraded":"2023-08-18T20:45:35.909956+0000","last_fullsized":"2023-08-18T20:45:35.909956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:15.501807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909657+0000","last_change":"2023-08-18T20:45:35.907509+0000","last_active":"2023-08-18T20:45:35.909657+0000","last_peered":"2023-08-18T20:45:35.909657+0000","last_clean":"2023-08-18T20:45:35.909657+0000","last_became_active":"2023-08-18T20:45:35.906991+0000","last_became_peered":"2023-08-18T20:45:35.906991+0000","last_unstale":"2023-08-18T20:45:35.909657+0000","last_undegraded":"2023-08-18T20:45:35.909657+0000","last_fullsized":"2023-08-18T20:45:35.909657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:55.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915338+0000","last_change":"2023-08-18T20:45:35.910037+0000","last_active":"2023-08-18T20:45:35.915338+0000","last_peered":"2023-08-18T20:45:35.915338+0000","last_clean":"2023-08-18T20:45:35.915338+0000","last_became_active":"2023-08-18T20:45:35.909760+0000","last_became_peered":"2023-08-18T20:45:35.909760+0000","last_unstale":"2023-08-18T20:45:35.915338+0000","last_undegraded":"2023-08-18T20:45:35.915338+0000","last_fullsized":"2023-08-18T20:45:35.915338+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:56:20.791349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.907282+0000","last_change":"2023-08-18T20:45:35.904459+0000","last_active":"2023-08-18T20:45:35.907282+0000","last_peered":"2023-08-18T20:45:35.907282+0000","last_clean":"2023-08-18T20:45:35.907282+0000","last_became_active":"2023-08-18T20:45:35.904153+0000","last_became_peered":"2023-08-18T20:45:35.904153+0000","last_unstale":"2023-08-18T20:45:35.907282+0000","last_undegraded":"2023-08-18T20:45:35.907282+0000","last_fullsized":"2023-08-18T20:45:35.907282+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:17:21.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914738+0000","last_change":"2023-08-18T20:45:35.910962+0000","last_active":"2023-08-18T20:45:35.914738+0000","last_peered":"2023-08-18T20:45:35.914738+0000","last_clean":"2023-08-18T20:45:35.914738+0000","last_became_active":"2023-08-18T20:45:35.910721+0000","last_became_peered":"2023-08-18T20:45:35.910721+0000","last_unstale":"2023-08-18T20:45:35.914738+0000","last_undegraded":"2023-08-18T20:45:35.914738+0000","last_fullsized":"2023-08-18T20:45:35.914738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:16:29.981471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914622+0000","last_change":"2023-08-18T20:45:35.910833+0000","last_active":"2023-08-18T20:45:35.914622+0000","last_peered":"2023-08-18T20:45:35.914622+0000","last_clean":"2023-08-18T20:45:35.914622+0000","last_became_active":"2023-08-18T20:45:35.909062+0000","last_became_peered":"2023-08-18T20:45:35.909062+0000","last_unstale":"2023-08-18T20:45:35.914622+0000","last_undegraded":"2023-08-18T20:45:35.914622+0000","last_fullsized":"2023-08-18T20:45:35.914622+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:54.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910955+0000","last_change":"2023-08-18T20:45:35.904022+0000","last_active":"2023-08-18T20:45:35.910955+0000","last_peered":"2023-08-18T20:45:35.910955+0000","last_clean":"2023-08-18T20:45:35.910955+0000","last_became_active":"2023-08-18T20:45:35.903760+0000","last_became_peered":"2023-08-18T20:45:35.903760+0000","last_unstale":"2023-08-18T20:45:35.910955+0000","last_undegraded":"2023-08-18T20:45:35.910955+0000","last_fullsized":"2023-08-18T20:45:35.910955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:42.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910453+0000","last_change":"2023-08-18T20:45:35.906448+0000","last_active":"2023-08-18T20:45:35.910453+0000","last_peered":"2023-08-18T20:45:35.910453+0000","last_clean":"2023-08-18T20:45:35.910453+0000","last_became_active":"2023-08-18T20:45:35.905021+0000","last_became_peered":"2023-08-18T20:45:35.905021+0000","last_unstale":"2023-08-18T20:45:35.910453+0000","last_undegraded":"2023-08-18T20:45:35.910453+0000","last_fullsized":"2023-08-18T20:45:35.910453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:55.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914737+0000","last_change":"2023-08-18T20:45:35.910585+0000","last_active":"2023-08-18T20:45:35.914737+0000","last_peered":"2023-08-18T20:45:35.914737+0000","last_clean":"2023-08-18T20:45:35.914737+0000","last_became_active":"2023-08-18T20:45:35.910306+0000","last_became_peered":"2023-08-18T20:45:35.910306+0000","last_unstale":"2023-08-18T20:45:35.914737+0000","last_undegraded":"2023-08-18T20:45:35.914737+0000","last_fullsized":"2023-08-18T20:45:35.914737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:19:06.612332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914691+0000","last_change":"2023-08-18T20:45:35.909011+0000","last_active":"2023-08-18T20:45:35.914691+0000","last_peered":"2023-08-18T20:45:35.914691+0000","last_clean":"2023-08-18T20:45:35.914691+0000","last_became_active":"2023-08-18T20:45:35.908728+0000","last_became_peered":"2023-08-18T20:45:35.908728+0000","last_unstale":"2023-08-18T20:45:35.914691+0000","last_undegraded":"2023-08-18T20:45:35.914691+0000","last_fullsized":"2023-08-18T20:45:35.914691+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:21.256398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911092+0000","last_change":"2023-08-18T20:45:35.906359+0000","last_active":"2023-08-18T20:45:35.911092+0000","last_peered":"2023-08-18T20:45:35.911092+0000","last_clean":"2023-08-18T20:45:35.911092+0000","last_became_active":"2023-08-18T20:45:35.906092+0000","last_became_peered":"2023-08-18T20:45:35.906092+0000","last_unstale":"2023-08-18T20:45:35.911092+0000","last_undegraded":"2023-08-18T20:45:35.911092+0000","last_fullsized":"2023-08-18T20:45:35.911092+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:40.882452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913280+0000","last_change":"2023-08-18T20:45:35.908516+0000","last_active":"2023-08-18T20:45:35.913280+0000","last_peered":"2023-08-18T20:45:35.913280+0000","last_clean":"2023-08-18T20:45:35.913280+0000","last_became_active":"2023-08-18T20:45:35.907957+0000","last_became_peered":"2023-08-18T20:45:35.907957+0000","last_unstale":"2023-08-18T20:45:35.913280+0000","last_undegraded":"2023-08-18T20:45:35.913280+0000","last_fullsized":"2023-08-18T20:45:35.913280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:35:01.215048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910184+0000","last_change":"2023-08-18T20:45:35.905110+0000","last_active":"2023-08-18T20:45:35.910184+0000","last_peered":"2023-08-18T20:45:35.910184+0000","last_clean":"2023-08-18T20:45:35.910184+0000","last_became_active":"2023-08-18T20:45:35.904860+0000","last_became_peered":"2023-08-18T20:45:35.904860+0000","last_unstale":"2023-08-18T20:45:35.910184+0000","last_undegraded":"2023-08-18T20:45:35.910184+0000","last_fullsized":"2023-08-18T20:45:35.910184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:17:18.038724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909880+0000","last_change":"2023-08-18T20:45:35.904684+0000","last_active":"2023-08-18T20:45:35.909880+0000","last_peered":"2023-08-18T20:45:35.909880+0000","last_clean":"2023-08-18T20:45:35.909880+0000","last_became_active":"2023-08-18T20:45:35.904415+0000","last_became_peered":"2023-08-18T20:45:35.904415+0000","last_unstale":"2023-08-18T20:45:35.909880+0000","last_undegraded":"2023-08-18T20:45:35.909880+0000","last_fullsized":"2023-08-18T20:45:35.909880+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909893+0000","last_change":"2023-08-18T20:45:35.903094+0000","last_active":"2023-08-18T20:45:35.909893+0000","last_peered":"2023-08-18T20:45:35.909893+0000","last_clean":"2023-08-18T20:45:35.909893+0000","last_became_active":"2023-08-18T20:45:35.902444+0000","last_became_peered":"2023-08-18T20:45:35.902444+0000","last_unstale":"2023-08-18T20:45:35.909893+0000","last_undegraded":"2023-08-18T20:45:35.909893+0000","last_fullsized":"2023-08-18T20:45:35.909893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904586+0000","last_change":"2023-08-18T20:45:35.901532+0000","last_active":"2023-08-18T20:45:35.904586+0000","last_peered":"2023-08-18T20:45:35.904586+0000","last_clean":"2023-08-18T20:45:35.904586+0000","last_became_active":"2023-08-18T20:45:35.901219+0000","last_became_peered":"2023-08-18T20:45:35.901219+0000","last_unstale":"2023-08-18T20:45:35.904586+0000","last_undegraded":"2023-08-18T20:45:35.904586+0000","last_fullsized":"2023-08-18T20:45:35.904586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905557+0000","last_change":"2023-08-18T20:45:35.898503+0000","last_active":"2023-08-18T20:45:35.905557+0000","last_peered":"2023-08-18T20:45:35.905557+0000","last_clean":"2023-08-18T20:45:35.905557+0000","last_became_active":"2023-08-18T20:45:35.898323+0000","last_became_peered":"2023-08-18T20:45:35.898323+0000","last_unstale":"2023-08-18T20:45:35.905557+0000","last_undegraded":"2023-08-18T20:45:35.905557+0000","last_fullsized":"2023-08-18T20:45:35.905557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:06:08.533749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.912053+0000","last_change":"2023-08-18T20:45:35.903465+0000","last_active":"2023-08-18T20:45:35.912053+0000","last_peered":"2023-08-18T20:45:35.912053+0000","last_clean":"2023-08-18T20:45:35.912053+0000","last_became_active":"2023-08-18T20:45:35.903146+0000","last_became_peered":"2023-08-18T20:45:35.903146+0000","last_unstale":"2023-08-18T20:45:35.912053+0000","last_undegraded":"2023-08-18T20:45:35.912053+0000","last_fullsized":"2023-08-18T20:45:35.912053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:19.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915265+0000","last_change":"2023-08-18T20:45:35.905931+0000","last_active":"2023-08-18T20:45:35.915265+0000","last_peered":"2023-08-18T20:45:35.915265+0000","last_clean":"2023-08-18T20:45:35.915265+0000","last_became_active":"2023-08-18T20:45:35.905676+0000","last_became_peered":"2023-08-18T20:45:35.905676+0000","last_unstale":"2023-08-18T20:45:35.915265+0000","last_undegraded":"2023-08-18T20:45:35.915265+0000","last_fullsized":"2023-08-18T20:45:35.915265+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:50.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915273+0000","last_change":"2023-08-18T20:45:35.906132+0000","last_active":"2023-08-18T20:45:35.915273+0000","last_peered":"2023-08-18T20:45:35.915273+0000","last_clean":"2023-08-18T20:45:35.915273+0000","last_became_active":"2023-08-18T20:45:35.905839+0000","last_became_peered":"2023-08-18T20:45:35.905839+0000","last_unstale":"2023-08-18T20:45:35.915273+0000","last_undegraded":"2023-08-18T20:45:35.915273+0000","last_fullsized":"2023-08-18T20:45:35.915273+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:01:35.907411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913319+0000","last_change":"2023-08-18T20:45:35.909007+0000","last_active":"2023-08-18T20:45:35.913319+0000","last_peered":"2023-08-18T20:45:35.913319+0000","last_clean":"2023-08-18T20:45:35.913319+0000","last_became_active":"2023-08-18T20:45:35.908647+0000","last_became_peered":"2023-08-18T20:45:35.908647+0000","last_unstale":"2023-08-18T20:45:35.913319+0000","last_undegraded":"2023-08-18T20:45:35.913319+0000","last_fullsized":"2023-08-18T20:45:35.913319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:43.638358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911859+0000","last_change":"2023-08-18T20:45:35.902924+0000","last_active":"2023-08-18T20:45:35.911859+0000","last_peered":"2023-08-18T20:45:35.911859+0000","last_clean":"2023-08-18T20:45:35.911859+0000","last_became_active":"2023-08-18T20:45:35.902559+0000","last_became_peered":"2023-08-18T20:45:35.902559+0000","last_unstale":"2023-08-18T20:45:35.911859+0000","last_undegraded":"2023-08-18T20:45:35.911859+0000","last_fullsized":"2023-08-18T20:45:35.911859+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:13:25.330501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911926+0000","last_change":"2023-08-18T20:45:35.902555+0000","last_active":"2023-08-18T20:45:35.911926+0000","last_peered":"2023-08-18T20:45:35.911926+0000","last_clean":"2023-08-18T20:45:35.911926+0000","last_became_active":"2023-08-18T20:45:35.902253+0000","last_became_peered":"2023-08-18T20:45:35.902253+0000","last_unstale":"2023-08-18T20:45:35.911926+0000","last_undegraded":"2023-08-18T20:45:35.911926+0000","last_fullsized":"2023-08-18T20:45:35.911926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:50:18.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909344+0000","last_change":"2023-08-18T20:45:35.902409+0000","last_active":"2023-08-18T20:45:35.909344+0000","last_peered":"2023-08-18T20:45:35.909344+0000","last_clean":"2023-08-18T20:45:35.909344+0000","last_became_active":"2023-08-18T20:45:35.902127+0000","last_became_peered":"2023-08-18T20:45:35.902127+0000","last_unstale":"2023-08-18T20:45:35.909344+0000","last_undegraded":"2023-08-18T20:45:35.909344+0000","last_fullsized":"2023-08-18T20:45:35.909344+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:06.984141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899539+0000","last_change":"2023-08-18T20:45:35.894279+0000","last_active":"2023-08-18T20:45:35.899539+0000","last_peered":"2023-08-18T20:45:35.899539+0000","last_clean":"2023-08-18T20:45:35.899539+0000","last_became_active":"2023-08-18T20:45:35.894004+0000","last_became_peered":"2023-08-18T20:45:35.894004+0000","last_unstale":"2023-08-18T20:45:35.899539+0000","last_undegraded":"2023-08-18T20:45:35.899539+0000","last_fullsized":"2023-08-18T20:45:35.899539+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:41.242570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911623+0000","last_change":"2023-08-18T20:45:35.907408+0000","last_active":"2023-08-18T20:45:35.911623+0000","last_peered":"2023-08-18T20:45:35.911623+0000","last_clean":"2023-08-18T20:45:35.911623+0000","last_became_active":"2023-08-18T20:45:35.907139+0000","last_became_peered":"2023-08-18T20:45:35.907139+0000","last_unstale":"2023-08-18T20:45:35.911623+0000","last_undegraded":"2023-08-18T20:45:35.911623+0000","last_fullsized":"2023-08-18T20:45:35.911623+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:51:06.857073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914709+0000","last_change":"2023-08-18T20:45:35.910266+0000","last_active":"2023-08-18T20:45:35.914709+0000","last_peered":"2023-08-18T20:45:35.914709+0000","last_clean":"2023-08-18T20:45:35.914709+0000","last_became_active":"2023-08-18T20:45:35.909890+0000","last_became_peered":"2023-08-18T20:45:35.909890+0000","last_unstale":"2023-08-18T20:45:35.914709+0000","last_undegraded":"2023-08-18T20:45:35.914709+0000","last_fullsized":"2023-08-18T20:45:35.914709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:54.793768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909981+0000","last_change":"2023-08-18T20:45:35.904760+0000","last_active":"2023-08-18T20:45:35.909981+0000","last_peered":"2023-08-18T20:45:35.909981+0000","last_clean":"2023-08-18T20:45:35.909981+0000","last_became_active":"2023-08-18T20:45:35.904451+0000","last_became_peered":"2023-08-18T20:45:35.904451+0000","last_unstale":"2023-08-18T20:45:35.909981+0000","last_undegraded":"2023-08-18T20:45:35.909981+0000","last_fullsized":"2023-08-18T20:45:35.909981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903200+0000","last_change":"2023-08-18T20:45:35.900863+0000","last_active":"2023-08-18T20:45:35.903200+0000","last_peered":"2023-08-18T20:45:35.903200+0000","last_clean":"2023-08-18T20:45:35.903200+0000","last_became_active":"2023-08-18T20:45:35.900630+0000","last_became_peered":"2023-08-18T20:45:35.900630+0000","last_unstale":"2023-08-18T20:45:35.903200+0000","last_undegraded":"2023-08-18T20:45:35.903200+0000","last_fullsized":"2023-08-18T20:45:35.903200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:22.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905219+0000","last_change":"2023-08-18T20:45:35.898466+0000","last_active":"2023-08-18T20:45:35.905219+0000","last_peered":"2023-08-18T20:45:35.905219+0000","last_clean":"2023-08-18T20:45:35.905219+0000","last_became_active":"2023-08-18T20:45:35.898171+0000","last_became_peered":"2023-08-18T20:45:35.898171+0000","last_unstale":"2023-08-18T20:45:35.905219+0000","last_undegraded":"2023-08-18T20:45:35.905219+0000","last_fullsized":"2023-08-18T20:45:35.905219+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:05.519951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"51'4","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977529+0000","last_change":"2023-08-18T20:45:34.973966+0000","last_active":"2023-08-18T20:45:35.977529+0000","last_peered":"2023-08-18T20:45:35.977529+0000","last_clean":"2023-08-18T20:45:35.977529+0000","last_became_active":"2023-08-18T20:45:34.973275+0000","last_became_peered":"2023-08-18T20:45:34.973275+0000","last_unstale":"2023-08-18T20:45:35.977529+0000","last_undegraded":"2023-08-18T20:45:35.977529+0000","last_fullsized":"2023-08-18T20:45:35.977529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:54.260109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910437+0000","last_change":"2023-08-18T20:45:35.905614+0000","last_active":"2023-08-18T20:45:35.910437+0000","last_peered":"2023-08-18T20:45:35.910437+0000","last_clean":"2023-08-18T20:45:35.910437+0000","last_became_active":"2023-08-18T20:45:35.905300+0000","last_became_peered":"2023-08-18T20:45:35.905300+0000","last_unstale":"2023-08-18T20:45:35.910437+0000","last_undegraded":"2023-08-18T20:45:35.910437+0000","last_fullsized":"2023-08-18T20:45:35.910437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974755+0000","last_change":"2023-08-18T20:45:34.974441+0000","last_active":"2023-08-18T20:45:35.974755+0000","last_peered":"2023-08-18T20:45:35.974755+0000","last_clean":"2023-08-18T20:45:35.974755+0000","last_became_active":"2023-08-18T20:45:34.974160+0000","last_became_peered":"2023-08-18T20:45:34.974160+0000","last_unstale":"2023-08-18T20:45:35.974755+0000","last_undegraded":"2023-08-18T20:45:35.974755+0000","last_fullsized":"2023-08-18T20:45:35.974755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:05:56.978902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903167+0000","last_change":"2023-08-18T20:45:35.901281+0000","last_active":"2023-08-18T20:45:35.903167+0000","last_peered":"2023-08-18T20:45:35.903167+0000","last_clean":"2023-08-18T20:45:35.903167+0000","last_became_active":"2023-08-18T20:45:35.900941+0000","last_became_peered":"2023-08-18T20:45:35.900941+0000","last_unstale":"2023-08-18T20:45:35.903167+0000","last_undegraded":"2023-08-18T20:45:35.903167+0000","last_fullsized":"2023-08-18T20:45:35.903167+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:45:19.004128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.975070+0000","last_change":"2023-08-18T20:45:34.972508+0000","last_active":"2023-08-18T20:45:35.975070+0000","last_peered":"2023-08-18T20:45:35.975070+0000","last_clean":"2023-08-18T20:45:35.975070+0000","last_became_active":"2023-08-18T20:45:34.972220+0000","last_became_peered":"2023-08-18T20:45:34.972220+0000","last_unstale":"2023-08-18T20:45:35.975070+0000","last_undegraded":"2023-08-18T20:45:35.975070+0000","last_fullsized":"2023-08-18T20:45:35.975070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:05:55.453372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910945+0000","last_change":"2023-08-18T20:45:35.904462+0000","last_active":"2023-08-18T20:45:35.910945+0000","last_peered":"2023-08-18T20:45:35.910945+0000","last_clean":"2023-08-18T20:45:35.910945+0000","last_became_active":"2023-08-18T20:45:35.904204+0000","last_became_peered":"2023-08-18T20:45:35.904204+0000","last_unstale":"2023-08-18T20:45:35.910945+0000","last_undegraded":"2023-08-18T20:45:35.910945+0000","last_fullsized":"2023-08-18T20:45:35.910945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:33:42.340682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977656+0000","last_change":"2023-08-18T20:45:34.963794+0000","last_active":"2023-08-18T20:45:35.977656+0000","last_peered":"2023-08-18T20:45:35.977656+0000","last_clean":"2023-08-18T20:45:35.977656+0000","last_became_active":"2023-08-18T20:45:34.963499+0000","last_became_peered":"2023-08-18T20:45:34.963499+0000","last_unstale":"2023-08-18T20:45:35.977656+0000","last_undegraded":"2023-08-18T20:45:35.977656+0000","last_fullsized":"2023-08-18T20:45:35.977656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:29.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893063+0000","last_change":"2023-08-18T20:45:35.891246+0000","last_active":"2023-08-18T20:45:35.893063+0000","last_peered":"2023-08-18T20:45:35.893063+0000","last_clean":"2023-08-18T20:45:35.893063+0000","last_became_active":"2023-08-18T20:45:35.890993+0000","last_became_peered":"2023-08-18T20:45:35.890993+0000","last_unstale":"2023-08-18T20:45:35.893063+0000","last_undegraded":"2023-08-18T20:45:35.893063+0000","last_fullsized":"2023-08-18T20:45:35.893063+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.615668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974615+0000","last_change":"2023-08-18T20:45:34.977145+0000","last_active":"2023-08-18T20:45:35.974615+0000","last_peered":"2023-08-18T20:45:35.974615+0000","last_clean":"2023-08-18T20:45:35.974615+0000","last_became_active":"2023-08-18T20:45:34.976889+0000","last_became_peered":"2023-08-18T20:45:34.976889+0000","last_unstale":"2023-08-18T20:45:35.974615+0000","last_undegraded":"2023-08-18T20:45:35.974615+0000","last_fullsized":"2023-08-18T20:45:35.974615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:39:15.689314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915225+0000","last_change":"2023-08-18T20:45:35.907867+0000","last_active":"2023-08-18T20:45:35.915225+0000","last_peered":"2023-08-18T20:45:35.915225+0000","last_clean":"2023-08-18T20:45:35.915225+0000","last_became_active":"2023-08-18T20:45:35.907577+0000","last_became_peered":"2023-08-18T20:45:35.907577+0000","last_unstale":"2023-08-18T20:45:35.915225+0000","last_undegraded":"2023-08-18T20:45:35.915225+0000","last_fullsized":"2023-08-18T20:45:35.915225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:51.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.973973+0000","last_change":"2023-08-18T20:45:34.976208+0000","last_active":"2023-08-18T20:45:35.973973+0000","last_peered":"2023-08-18T20:45:35.973973+0000","last_clean":"2023-08-18T20:45:35.973973+0000","last_became_active":"2023-08-18T20:45:34.975809+0000","last_became_peered":"2023-08-18T20:45:34.975809+0000","last_unstale":"2023-08-18T20:45:35.973973+0000","last_undegraded":"2023-08-18T20:45:35.973973+0000","last_fullsized":"2023-08-18T20:45:35.973973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:28:49.618123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904702+0000","last_change":"2023-08-18T20:45:35.901449+0000","last_active":"2023-08-18T20:45:35.904702+0000","last_peered":"2023-08-18T20:45:35.904702+0000","last_clean":"2023-08-18T20:45:35.904702+0000","last_became_active":"2023-08-18T20:45:35.901106+0000","last_became_peered":"2023-08-18T20:45:35.901106+0000","last_unstale":"2023-08-18T20:45:35.904702+0000","last_undegraded":"2023-08-18T20:45:35.904702+0000","last_fullsized":"2023-08-18T20:45:35.904702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891825+0000","last_change":"2023-08-18T20:45:34.977662+0000","last_active":"2023-08-18T20:45:35.891825+0000","last_peered":"2023-08-18T20:45:35.891825+0000","last_clean":"2023-08-18T20:45:35.891825+0000","last_became_active":"2023-08-18T20:45:34.977395+0000","last_became_peered":"2023-08-18T20:45:34.977395+0000","last_unstale":"2023-08-18T20:45:35.891825+0000","last_undegraded":"2023-08-18T20:45:35.891825+0000","last_fullsized":"2023-08-18T20:45:35.891825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:45:47.297736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911079+0000","last_change":"2023-08-18T20:45:35.902649+0000","last_active":"2023-08-18T20:45:35.911079+0000","last_peered":"2023-08-18T20:45:35.911079+0000","last_clean":"2023-08-18T20:45:35.911079+0000","last_became_active":"2023-08-18T20:45:35.902336+0000","last_became_peered":"2023-08-18T20:45:35.902336+0000","last_unstale":"2023-08-18T20:45:35.911079+0000","last_undegraded":"2023-08-18T20:45:35.911079+0000","last_fullsized":"2023-08-18T20:45:35.911079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:37:43.250449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.892936+0000","last_change":"2023-08-18T20:45:34.974043+0000","last_active":"2023-08-18T20:45:35.892936+0000","last_peered":"2023-08-18T20:45:35.892936+0000","last_clean":"2023-08-18T20:45:35.892936+0000","last_became_active":"2023-08-18T20:45:34.973763+0000","last_became_peered":"2023-08-18T20:45:34.973763+0000","last_unstale":"2023-08-18T20:45:35.892936+0000","last_undegraded":"2023-08-18T20:45:35.892936+0000","last_fullsized":"2023-08-18T20:45:35.892936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:48.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.892791+0000","last_change":"2023-08-18T20:45:35.888678+0000","last_active":"2023-08-18T20:45:35.892791+0000","last_peered":"2023-08-18T20:45:35.892791+0000","last_clean":"2023-08-18T20:45:35.892791+0000","last_became_active":"2023-08-18T20:45:35.888415+0000","last_became_peered":"2023-08-18T20:45:35.888415+0000","last_unstale":"2023-08-18T20:45:35.892791+0000","last_undegraded":"2023-08-18T20:45:35.892791+0000","last_fullsized":"2023-08-18T20:45:35.892791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899010+0000","last_change":"2023-08-18T20:45:34.977639+0000","last_active":"2023-08-18T20:45:35.899010+0000","last_peered":"2023-08-18T20:45:35.899010+0000","last_clean":"2023-08-18T20:45:35.899010+0000","last_became_active":"2023-08-18T20:45:34.977299+0000","last_became_peered":"2023-08-18T20:45:34.977299+0000","last_unstale":"2023-08-18T20:45:35.899010+0000","last_undegraded":"2023-08-18T20:45:35.899010+0000","last_fullsized":"2023-08-18T20:45:35.899010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:01:43.150340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911102+0000","last_change":"2023-08-18T20:45:35.903372+0000","last_active":"2023-08-18T20:45:35.911102+0000","last_peered":"2023-08-18T20:45:35.911102+0000","last_clean":"2023-08-18T20:45:35.911102+0000","last_became_active":"2023-08-18T20:45:35.903163+0000","last_became_peered":"2023-08-18T20:45:35.903163+0000","last_unstale":"2023-08-18T20:45:35.911102+0000","last_undegraded":"2023-08-18T20:45:35.911102+0000","last_fullsized":"2023-08-18T20:45:35.911102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:57:44.636960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899433+0000","last_change":"2023-08-18T20:45:34.965192+0000","last_active":"2023-08-18T20:45:35.899433+0000","last_peered":"2023-08-18T20:45:35.899433+0000","last_clean":"2023-08-18T20:45:35.899433+0000","last_became_active":"2023-08-18T20:45:34.964736+0000","last_became_peered":"2023-08-18T20:45:34.964736+0000","last_unstale":"2023-08-18T20:45:35.899433+0000","last_undegraded":"2023-08-18T20:45:35.899433+0000","last_fullsized":"2023-08-18T20:45:35.899433+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:04.513405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.908337+0000","last_change":"2023-08-18T20:45:35.905230+0000","last_active":"2023-08-18T20:45:35.908337+0000","last_peered":"2023-08-18T20:45:35.908337+0000","last_clean":"2023-08-18T20:45:35.908337+0000","last_became_active":"2023-08-18T20:45:35.904679+0000","last_became_peered":"2023-08-18T20:45:35.904679+0000","last_unstale":"2023-08-18T20:45:35.908337+0000","last_undegraded":"2023-08-18T20:45:35.908337+0000","last_fullsized":"2023-08-18T20:45:35.908337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:34.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"51'3","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977861+0000","last_change":"2023-08-18T20:45:34.977643+0000","last_active":"2023-08-18T20:45:35.977861+0000","last_peered":"2023-08-18T20:45:35.977861+0000","last_clean":"2023-08-18T20:45:35.977861+0000","last_became_active":"2023-08-18T20:45:34.977323+0000","last_became_peered":"2023-08-18T20:45:34.977323+0000","last_unstale":"2023-08-18T20:45:35.977861+0000","last_undegraded":"2023-08-18T20:45:35.977861+0000","last_fullsized":"2023-08-18T20:45:35.977861+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:28:49.618123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910881+0000","last_change":"2023-08-18T20:45:35.907868+0000","last_active":"2023-08-18T20:45:35.910881+0000","last_peered":"2023-08-18T20:45:35.910881+0000","last_clean":"2023-08-18T20:45:35.910881+0000","last_became_active":"2023-08-18T20:45:35.907562+0000","last_became_peered":"2023-08-18T20:45:35.907562+0000","last_unstale":"2023-08-18T20:45:35.910881+0000","last_undegraded":"2023-08-18T20:45:35.910881+0000","last_fullsized":"2023-08-18T20:45:35.910881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:50.900285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"51'5","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977716+0000","last_change":"2023-08-18T20:45:34.967721+0000","last_active":"2023-08-18T20:45:35.977716+0000","last_peered":"2023-08-18T20:45:35.977716+0000","last_clean":"2023-08-18T20:45:35.977716+0000","last_became_active":"2023-08-18T20:45:34.967000+0000","last_became_peered":"2023-08-18T20:45:34.967000+0000","last_unstale":"2023-08-18T20:45:35.977716+0000","last_undegraded":"2023-08-18T20:45:35.977716+0000","last_fullsized":"2023-08-18T20:45:35.977716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:33.422616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910365+0000","last_change":"2023-08-18T20:45:35.905432+0000","last_active":"2023-08-18T20:45:35.910365+0000","last_peered":"2023-08-18T20:45:35.910365+0000","last_clean":"2023-08-18T20:45:35.910365+0000","last_became_active":"2023-08-18T20:45:35.905124+0000","last_became_peered":"2023-08-18T20:45:35.905124+0000","last_unstale":"2023-08-18T20:45:35.910365+0000","last_undegraded":"2023-08-18T20:45:35.910365+0000","last_fullsized":"2023-08-18T20:45:35.910365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:34.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.980009+0000","last_change":"2023-08-18T20:45:34.979922+0000","last_active":"2023-08-18T20:45:35.980009+0000","last_peered":"2023-08-18T20:45:35.980009+0000","last_clean":"2023-08-18T20:45:35.980009+0000","last_became_active":"2023-08-18T20:45:34.979663+0000","last_became_peered":"2023-08-18T20:45:34.979663+0000","last_unstale":"2023-08-18T20:45:35.980009+0000","last_undegraded":"2023-08-18T20:45:35.980009+0000","last_fullsized":"2023-08-18T20:45:35.980009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:40.079115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911997+0000","last_change":"2023-08-18T20:45:35.905734+0000","last_active":"2023-08-18T20:45:35.911997+0000","last_peered":"2023-08-18T20:45:35.911997+0000","last_clean":"2023-08-18T20:45:35.911997+0000","last_became_active":"2023-08-18T20:45:35.903295+0000","last_became_peered":"2023-08-18T20:45:35.903295+0000","last_unstale":"2023-08-18T20:45:35.911997+0000","last_undegraded":"2023-08-18T20:45:35.911997+0000","last_fullsized":"2023-08-18T20:45:35.911997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:17.383811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899200+0000","last_change":"2023-08-18T20:45:34.976533+0000","last_active":"2023-08-18T20:45:35.899200+0000","last_peered":"2023-08-18T20:45:35.899200+0000","last_clean":"2023-08-18T20:45:35.899200+0000","last_became_active":"2023-08-18T20:45:34.975963+0000","last_became_peered":"2023-08-18T20:45:34.975963+0000","last_unstale":"2023-08-18T20:45:35.899200+0000","last_undegraded":"2023-08-18T20:45:35.899200+0000","last_fullsized":"2023-08-18T20:45:35.899200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:39:05.080213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904543+0000","last_change":"2023-08-18T20:45:35.901127+0000","last_active":"2023-08-18T20:45:35.904543+0000","last_peered":"2023-08-18T20:45:35.904543+0000","last_clean":"2023-08-18T20:45:35.904543+0000","last_became_active":"2023-08-18T20:45:35.900148+0000","last_became_peered":"2023-08-18T20:45:35.900148+0000","last_unstale":"2023-08-18T20:45:35.904543+0000","last_undegraded":"2023-08-18T20:45:35.904543+0000","last_fullsized":"2023-08-18T20:45:35.904543+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897846+0000","last_change":"2023-08-18T20:45:34.978720+0000","last_active":"2023-08-18T20:45:35.897846+0000","last_peered":"2023-08-18T20:45:35.897846+0000","last_clean":"2023-08-18T20:45:35.897846+0000","last_became_active":"2023-08-18T20:45:34.978408+0000","last_became_peered":"2023-08-18T20:45:34.978408+0000","last_unstale":"2023-08-18T20:45:35.897846+0000","last_undegraded":"2023-08-18T20:45:35.897846+0000","last_fullsized":"2023-08-18T20:45:35.897846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:20:46.939884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909906+0000","last_change":"2023-08-18T20:45:35.904813+0000","last_active":"2023-08-18T20:45:35.909906+0000","last_peered":"2023-08-18T20:45:35.909906+0000","last_clean":"2023-08-18T20:45:35.909906+0000","last_became_active":"2023-08-18T20:45:35.904395+0000","last_became_peered":"2023-08-18T20:45:35.904395+0000","last_unstale":"2023-08-18T20:45:35.909906+0000","last_undegraded":"2023-08-18T20:45:35.909906+0000","last_fullsized":"2023-08-18T20:45:35.909906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"51'8","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977634+0000","last_change":"2023-08-18T20:45:34.973681+0000","last_active":"2023-08-18T20:45:35.977634+0000","last_peered":"2023-08-18T20:45:35.977634+0000","last_clean":"2023-08-18T20:45:35.977634+0000","last_became_active":"2023-08-18T20:45:34.973398+0000","last_became_peered":"2023-08-18T20:45:34.973398+0000","last_unstale":"2023-08-18T20:45:35.977634+0000","last_undegraded":"2023-08-18T20:45:35.977634+0000","last_fullsized":"2023-08-18T20:45:35.977634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:25.772352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.908945+0000","last_change":"2023-08-18T20:45:35.907903+0000","last_active":"2023-08-18T20:45:35.908945+0000","last_peered":"2023-08-18T20:45:35.908945+0000","last_clean":"2023-08-18T20:45:35.908945+0000","last_became_active":"2023-08-18T20:45:35.907569+0000","last_became_peered":"2023-08-18T20:45:35.907569+0000","last_unstale":"2023-08-18T20:45:35.908945+0000","last_undegraded":"2023-08-18T20:45:35.908945+0000","last_fullsized":"2023-08-18T20:45:35.908945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:53:49.733333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.975026+0000","last_change":"2023-08-18T20:45:34.978323+0000","last_active":"2023-08-18T20:45:35.975026+0000","last_peered":"2023-08-18T20:45:35.975026+0000","last_clean":"2023-08-18T20:45:35.975026+0000","last_became_active":"2023-08-18T20:45:34.978045+0000","last_became_peered":"2023-08-18T20:45:34.978045+0000","last_unstale":"2023-08-18T20:45:35.975026+0000","last_undegraded":"2023-08-18T20:45:35.975026+0000","last_fullsized":"2023-08-18T20:45:35.975026+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:43:19.838514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904930+0000","last_change":"2023-08-18T20:45:35.900572+0000","last_active":"2023-08-18T20:45:35.904930+0000","last_peered":"2023-08-18T20:45:35.904930+0000","last_clean":"2023-08-18T20:45:35.904930+0000","last_became_active":"2023-08-18T20:45:35.900283+0000","last_became_peered":"2023-08-18T20:45:35.900283+0000","last_unstale":"2023-08-18T20:45:35.904930+0000","last_undegraded":"2023-08-18T20:45:35.904930+0000","last_fullsized":"2023-08-18T20:45:35.904930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:00:50.276806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895895+0000","last_change":"2023-08-18T20:45:34.976456+0000","last_active":"2023-08-18T20:45:35.895895+0000","last_peered":"2023-08-18T20:45:35.895895+0000","last_clean":"2023-08-18T20:45:35.895895+0000","last_became_active":"2023-08-18T20:45:34.976025+0000","last_became_peered":"2023-08-18T20:45:34.976025+0000","last_unstale":"2023-08-18T20:45:35.895895+0000","last_undegraded":"2023-08-18T20:45:35.895895+0000","last_fullsized":"2023-08-18T20:45:35.895895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:22:05.133522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911962+0000","last_change":"2023-08-18T20:45:35.903676+0000","last_active":"2023-08-18T20:45:35.911962+0000","last_peered":"2023-08-18T20:45:35.911962+0000","last_clean":"2023-08-18T20:45:35.911962+0000","last_became_active":"2023-08-18T20:45:35.902862+0000","last_became_peered":"2023-08-18T20:45:35.902862+0000","last_unstale":"2023-08-18T20:45:35.911962+0000","last_undegraded":"2023-08-18T20:45:35.911962+0000","last_fullsized":"2023-08-18T20:45:35.911962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:37:42.328822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895560+0000","last_change":"2023-08-18T20:45:34.972345+0000","last_active":"2023-08-18T20:45:35.895560+0000","last_peered":"2023-08-18T20:45:35.895560+0000","last_clean":"2023-08-18T20:45:35.895560+0000","last_became_active":"2023-08-18T20:45:34.971833+0000","last_became_peered":"2023-08-18T20:45:34.971833+0000","last_unstale":"2023-08-18T20:45:35.895560+0000","last_undegraded":"2023-08-18T20:45:35.895560+0000","last_fullsized":"2023-08-18T20:45:35.895560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:03:43.829951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.906509+0000","last_change":"2023-08-18T20:45:35.898724+0000","last_active":"2023-08-18T20:45:35.906509+0000","last_peered":"2023-08-18T20:45:35.906509+0000","last_clean":"2023-08-18T20:45:35.906509+0000","last_became_active":"2023-08-18T20:45:35.898443+0000","last_became_peered":"2023-08-18T20:45:35.898443+0000","last_unstale":"2023-08-18T20:45:35.906509+0000","last_undegraded":"2023-08-18T20:45:35.906509+0000","last_fullsized":"2023-08-18T20:45:35.906509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.884638+0000","last_change":"2023-08-18T20:45:34.967849+0000","last_active":"2023-08-18T20:45:35.884638+0000","last_peered":"2023-08-18T20:45:35.884638+0000","last_clean":"2023-08-18T20:45:35.884638+0000","last_became_active":"2023-08-18T20:45:34.967588+0000","last_became_peered":"2023-08-18T20:45:34.967588+0000","last_unstale":"2023-08-18T20:45:35.884638+0000","last_undegraded":"2023-08-18T20:45:35.884638+0000","last_fullsized":"2023-08-18T20:45:35.884638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:05.977594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903060+0000","last_change":"2023-08-18T20:45:35.897819+0000","last_active":"2023-08-18T20:45:35.903060+0000","last_peered":"2023-08-18T20:45:35.903060+0000","last_clean":"2023-08-18T20:45:35.903060+0000","last_became_active":"2023-08-18T20:45:35.897534+0000","last_became_peered":"2023-08-18T20:45:35.897534+0000","last_unstale":"2023-08-18T20:45:35.903060+0000","last_undegraded":"2023-08-18T20:45:35.903060+0000","last_fullsized":"2023-08-18T20:45:35.903060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897884+0000","last_change":"2023-08-18T20:45:34.979956+0000","last_active":"2023-08-18T20:45:35.897884+0000","last_peered":"2023-08-18T20:45:35.897884+0000","last_clean":"2023-08-18T20:45:35.897884+0000","last_became_active":"2023-08-18T20:45:34.979674+0000","last_became_peered":"2023-08-18T20:45:34.979674+0000","last_unstale":"2023-08-18T20:45:35.897884+0000","last_undegraded":"2023-08-18T20:45:35.897884+0000","last_fullsized":"2023-08-18T20:45:35.897884+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:39:15.689314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910415+0000","last_change":"2023-08-18T20:45:35.905583+0000","last_active":"2023-08-18T20:45:35.910415+0000","last_peered":"2023-08-18T20:45:35.910415+0000","last_clean":"2023-08-18T20:45:35.910415+0000","last_became_active":"2023-08-18T20:45:35.905306+0000","last_became_peered":"2023-08-18T20:45:35.905306+0000","last_unstale":"2023-08-18T20:45:35.910415+0000","last_undegraded":"2023-08-18T20:45:35.910415+0000","last_fullsized":"2023-08-18T20:45:35.910415+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891893+0000","last_change":"2023-08-18T20:45:34.976273+0000","last_active":"2023-08-18T20:45:35.891893+0000","last_peered":"2023-08-18T20:45:35.891893+0000","last_clean":"2023-08-18T20:45:35.891893+0000","last_became_active":"2023-08-18T20:45:34.975767+0000","last_became_peered":"2023-08-18T20:45:34.975767+0000","last_unstale":"2023-08-18T20:45:35.891893+0000","last_undegraded":"2023-08-18T20:45:35.891893+0000","last_fullsized":"2023-08-18T20:45:35.891893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:40.079115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905802+0000","last_change":"2023-08-18T20:45:35.902727+0000","last_active":"2023-08-18T20:45:35.905802+0000","last_peered":"2023-08-18T20:45:35.905802+0000","last_clean":"2023-08-18T20:45:35.905802+0000","last_became_active":"2023-08-18T20:45:35.902454+0000","last_became_peered":"2023-08-18T20:45:35.902454+0000","last_unstale":"2023-08-18T20:45:35.905802+0000","last_undegraded":"2023-08-18T20:45:35.905802+0000","last_fullsized":"2023-08-18T20:45:35.905802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891957+0000","last_change":"2023-08-18T20:45:34.977507+0000","last_active":"2023-08-18T20:45:35.891957+0000","last_peered":"2023-08-18T20:45:35.891957+0000","last_clean":"2023-08-18T20:45:35.891957+0000","last_became_active":"2023-08-18T20:45:34.977042+0000","last_became_peered":"2023-08-18T20:45:34.977042+0000","last_unstale":"2023-08-18T20:45:35.891957+0000","last_undegraded":"2023-08-18T20:45:35.891957+0000","last_fullsized":"2023-08-18T20:45:35.891957+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:20:46.939884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.907836+0000","last_change":"2023-08-18T20:45:35.904814+0000","last_active":"2023-08-18T20:45:35.907836+0000","last_peered":"2023-08-18T20:45:35.907836+0000","last_clean":"2023-08-18T20:45:35.907836+0000","last_became_active":"2023-08-18T20:45:35.904550+0000","last_became_peered":"2023-08-18T20:45:35.904550+0000","last_unstale":"2023-08-18T20:45:35.907836+0000","last_undegraded":"2023-08-18T20:45:35.907836+0000","last_fullsized":"2023-08-18T20:45:35.907836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:50:44.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.883949+0000","last_change":"2023-08-18T20:45:34.973010+0000","last_active":"2023-08-18T20:45:35.883949+0000","last_peered":"2023-08-18T20:45:35.883949+0000","last_clean":"2023-08-18T20:45:35.883949+0000","last_became_active":"2023-08-18T20:45:34.972735+0000","last_became_peered":"2023-08-18T20:45:34.972735+0000","last_unstale":"2023-08-18T20:45:35.883949+0000","last_undegraded":"2023-08-18T20:45:35.883949+0000","last_fullsized":"2023-08-18T20:45:35.883949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:56:36.508944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913344+0000","last_change":"2023-08-18T20:45:35.910372+0000","last_active":"2023-08-18T20:45:35.913344+0000","last_peered":"2023-08-18T20:45:35.913344+0000","last_clean":"2023-08-18T20:45:35.913344+0000","last_became_active":"2023-08-18T20:45:35.907965+0000","last_became_peered":"2023-08-18T20:45:35.907965+0000","last_unstale":"2023-08-18T20:45:35.913344+0000","last_undegraded":"2023-08-18T20:45:35.913344+0000","last_fullsized":"2023-08-18T20:45:35.913344+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:50.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977481+0000","last_change":"2023-08-18T20:45:34.976242+0000","last_active":"2023-08-18T20:45:35.977481+0000","last_peered":"2023-08-18T20:45:35.977481+0000","last_clean":"2023-08-18T20:45:35.977481+0000","last_became_active":"2023-08-18T20:45:34.975953+0000","last_became_peered":"2023-08-18T20:45:34.975953+0000","last_unstale":"2023-08-18T20:45:35.977481+0000","last_undegraded":"2023-08-18T20:45:35.977481+0000","last_fullsized":"2023-08-18T20:45:35.977481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:29:46.508475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893036+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:45:35.893036+0000","last_peered":"2023-08-18T20:45:35.893036+0000","last_clean":"2023-08-18T20:45:35.893036+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:45:35.893036+0000","last_undegraded":"2023-08-18T20:45:35.893036+0000","last_fullsized":"2023-08-18T20:45:35.893036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:15:37.305797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909555+0000","last_change":"2023-08-18T20:45:35.907483+0000","last_active":"2023-08-18T20:45:35.909555+0000","last_peered":"2023-08-18T20:45:35.909555+0000","last_clean":"2023-08-18T20:45:35.909555+0000","last_became_active":"2023-08-18T20:45:35.906686+0000","last_became_peered":"2023-08-18T20:45:35.906686+0000","last_unstale":"2023-08-18T20:45:35.909555+0000","last_undegraded":"2023-08-18T20:45:35.909555+0000","last_fullsized":"2023-08-18T20:45:35.909555+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:15.501807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.979587+0000","last_change":"2023-08-18T20:45:34.978091+0000","last_active":"2023-08-18T20:45:35.979587+0000","last_peered":"2023-08-18T20:45:35.979587+0000","last_clean":"2023-08-18T20:45:35.979587+0000","last_became_active":"2023-08-18T20:45:34.977812+0000","last_became_peered":"2023-08-18T20:45:34.977812+0000","last_unstale":"2023-08-18T20:45:35.979587+0000","last_undegraded":"2023-08-18T20:45:35.979587+0000","last_fullsized":"2023-08-18T20:45:35.979587+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:42:15.757056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893576+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:45:35.893576+0000","last_peered":"2023-08-18T20:45:35.893576+0000","last_clean":"2023-08-18T20:45:35.893576+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:45:35.893576+0000","last_undegraded":"2023-08-18T20:45:35.893576+0000","last_fullsized":"2023-08-18T20:45:35.893576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:28:45.899753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904681+0000","last_change":"2023-08-18T20:45:35.901362+0000","last_active":"2023-08-18T20:45:35.904681+0000","last_peered":"2023-08-18T20:45:35.904681+0000","last_clean":"2023-08-18T20:45:35.904681+0000","last_became_active":"2023-08-18T20:45:35.900540+0000","last_became_peered":"2023-08-18T20:45:35.900540+0000","last_unstale":"2023-08-18T20:45:35.904681+0000","last_undegraded":"2023-08-18T20:45:35.904681+0000","last_fullsized":"2023-08-18T20:45:35.904681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:50.900285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.894736+0000","last_change":"2023-08-18T20:45:34.974454+0000","last_active":"2023-08-18T20:45:35.894736+0000","last_peered":"2023-08-18T20:45:35.894736+0000","last_clean":"2023-08-18T20:45:35.894736+0000","last_became_active":"2023-08-18T20:45:34.974193+0000","last_became_peered":"2023-08-18T20:45:34.974193+0000","last_unstale":"2023-08-18T20:45:35.894736+0000","last_undegraded":"2023-08-18T20:45:35.894736+0000","last_fullsized":"2023-08-18T20:45:35.894736+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:16:13.024297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895126+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:45:35.895126+0000","last_peered":"2023-08-18T20:45:35.895126+0000","last_clean":"2023-08-18T20:45:35.895126+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:45:35.895126+0000","last_undegraded":"2023-08-18T20:45:35.895126+0000","last_fullsized":"2023-08-18T20:45:35.895126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:03:52.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905106+0000","last_change":"2023-08-18T20:45:35.900789+0000","last_active":"2023-08-18T20:45:35.905106+0000","last_peered":"2023-08-18T20:45:35.905106+0000","last_clean":"2023-08-18T20:45:35.905106+0000","last_became_active":"2023-08-18T20:45:35.900218+0000","last_became_peered":"2023-08-18T20:45:35.900218+0000","last_unstale":"2023-08-18T20:45:35.905106+0000","last_undegraded":"2023-08-18T20:45:35.905106+0000","last_fullsized":"2023-08-18T20:45:35.905106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:26.778899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891638+0000","last_change":"2023-08-18T20:45:34.976358+0000","last_active":"2023-08-18T20:45:35.891638+0000","last_peered":"2023-08-18T20:45:35.891638+0000","last_clean":"2023-08-18T20:45:35.891638+0000","last_became_active":"2023-08-18T20:45:34.976019+0000","last_became_peered":"2023-08-18T20:45:34.976019+0000","last_unstale":"2023-08-18T20:45:35.891638+0000","last_undegraded":"2023-08-18T20:45:35.891638+0000","last_fullsized":"2023-08-18T20:45:35.891638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:39.875905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.898259+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:45:35.898259+0000","last_peered":"2023-08-18T20:45:35.898259+0000","last_clean":"2023-08-18T20:45:35.898259+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:45:35.898259+0000","last_undegraded":"2023-08-18T20:45:35.898259+0000","last_fullsized":"2023-08-18T20:45:35.898259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:01:50.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911933+0000","last_change":"2023-08-18T20:45:35.903258+0000","last_active":"2023-08-18T20:45:35.911933+0000","last_peered":"2023-08-18T20:45:35.911933+0000","last_clean":"2023-08-18T20:45:35.911933+0000","last_became_active":"2023-08-18T20:45:35.902942+0000","last_became_peered":"2023-08-18T20:45:35.902942+0000","last_unstale":"2023-08-18T20:45:35.911933+0000","last_undegraded":"2023-08-18T20:45:35.911933+0000","last_fullsized":"2023-08-18T20:45:35.911933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:50:28.407948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899198+0000","last_change":"2023-08-18T20:45:34.975679+0000","last_active":"2023-08-18T20:45:35.899198+0000","last_peered":"2023-08-18T20:45:35.899198+0000","last_clean":"2023-08-18T20:45:35.899198+0000","last_became_active":"2023-08-18T20:45:34.975369+0000","last_became_peered":"2023-08-18T20:45:34.975369+0000","last_unstale":"2023-08-18T20:45:35.899198+0000","last_undegraded":"2023-08-18T20:45:35.899198+0000","last_fullsized":"2023-08-18T20:45:35.899198+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:00.385565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897525+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:45:35.897525+0000","last_peered":"2023-08-18T20:45:35.897525+0000","last_clean":"2023-08-18T20:45:35.897525+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:45:35.897525+0000","last_undegraded":"2023-08-18T20:45:35.897525+0000","last_fullsized":"2023-08-18T20:45:35.897525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:43:50.886216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903217+0000","last_change":"2023-08-18T20:45:35.901239+0000","last_active":"2023-08-18T20:45:35.903217+0000","last_peered":"2023-08-18T20:45:35.903217+0000","last_clean":"2023-08-18T20:45:35.903217+0000","last_became_active":"2023-08-18T20:45:35.900850+0000","last_became_peered":"2023-08-18T20:45:35.900850+0000","last_unstale":"2023-08-18T20:45:35.903217+0000","last_undegraded":"2023-08-18T20:45:35.903217+0000","last_fullsized":"2023-08-18T20:45:35.903217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:06:21.971943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974383+0000","last_change":"2023-08-18T20:45:34.970857+0000","last_active":"2023-08-18T20:45:35.974383+0000","last_peered":"2023-08-18T20:45:35.974383+0000","last_clean":"2023-08-18T20:45:35.974383+0000","last_became_active":"2023-08-18T20:45:34.970218+0000","last_became_peered":"2023-08-18T20:45:34.970218+0000","last_unstale":"2023-08-18T20:45:35.974383+0000","last_undegraded":"2023-08-18T20:45:35.974383+0000","last_fullsized":"2023-08-18T20:45:35.974383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:01:13.237995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":213,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897229+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:45:35.897229+0000","last_peered":"2023-08-18T20:45:35.897229+0000","last_clean":"2023-08-18T20:45:35.897229+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:45:35.897229+0000","last_undegraded":"2023-08-18T20:45:35.897229+0000","last_fullsized":"2023-08-18T20:45:35.897229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:05.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.884450+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:45:35.884450+0000","last_peered":"2023-08-18T20:45:35.884450+0000","last_clean":"2023-08-18T20:45:35.884450+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:45:35.884450+0000","last_undegraded":"2023-08-18T20:45:35.884450+0000","last_fullsized":"2023-08-18T20:45:35.884450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:51:18.083740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.906531+0000","last_change":"2023-08-18T20:45:35.898795+0000","last_active":"2023-08-18T20:45:35.906531+0000","last_peered":"2023-08-18T20:45:35.906531+0000","last_clean":"2023-08-18T20:45:35.906531+0000","last_became_active":"2023-08-18T20:45:35.898518+0000","last_became_peered":"2023-08-18T20:45:35.898518+0000","last_unstale":"2023-08-18T20:45:35.906531+0000","last_undegraded":"2023-08-18T20:45:35.906531+0000","last_fullsized":"2023-08-18T20:45:35.906531+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:06.984141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891787+0000","last_change":"2023-08-18T20:45:34.977122+0000","last_active":"2023-08-18T20:45:35.891787+0000","last_peered":"2023-08-18T20:45:35.891787+0000","last_clean":"2023-08-18T20:45:35.891787+0000","last_became_active":"2023-08-18T20:45:34.976575+0000","last_became_peered":"2023-08-18T20:45:34.976575+0000","last_unstale":"2023-08-18T20:45:35.891787+0000","last_undegraded":"2023-08-18T20:45:35.891787+0000","last_fullsized":"2023-08-18T20:45:35.891787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:11.982732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891879+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:45:35.891879+0000","last_peered":"2023-08-18T20:45:35.891879+0000","last_clean":"2023-08-18T20:45:35.891879+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:45:35.891879+0000","last_undegraded":"2023-08-18T20:45:35.891879+0000","last_fullsized":"2023-08-18T20:45:35.891879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:40:19.345536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910372+0000","last_change":"2023-08-18T20:45:35.905894+0000","last_active":"2023-08-18T20:45:35.910372+0000","last_peered":"2023-08-18T20:45:35.910372+0000","last_clean":"2023-08-18T20:45:35.910372+0000","last_became_active":"2023-08-18T20:45:35.905198+0000","last_became_peered":"2023-08-18T20:45:35.905198+0000","last_unstale":"2023-08-18T20:45:35.910372+0000","last_undegraded":"2023-08-18T20:45:35.910372+0000","last_fullsized":"2023-08-18T20:45:35.910372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977800+0000","last_change":"2023-08-18T20:45:34.978547+0000","last_active":"2023-08-18T20:45:35.977800+0000","last_peered":"2023-08-18T20:45:35.977800+0000","last_clean":"2023-08-18T20:45:35.977800+0000","last_became_active":"2023-08-18T20:45:34.977631+0000","last_became_peered":"2023-08-18T20:45:34.977631+0000","last_unstale":"2023-08-18T20:45:35.977800+0000","last_undegraded":"2023-08-18T20:45:35.977800+0000","last_fullsized":"2023-08-18T20:45:35.977800+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:11.982732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.900586+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:45:35.900586+0000","last_peered":"2023-08-18T20:45:35.900586+0000","last_clean":"2023-08-18T20:45:35.900586+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:45:35.900586+0000","last_undegraded":"2023-08-18T20:45:35.900586+0000","last_fullsized":"2023-08-18T20:45:35.900586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:56:51.640612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1187840,"data_stored":850620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.745}]},{"osd":1,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.628}]},{"osd":3,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68000000000000005,"5min":1.101,"15min":1.101},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":1.159,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79100000000000004,"5min":1.373,"15min":1.373},"last":0.54600000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.442},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":857748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":1.6930000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":2.8580000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":2.8959999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":1.7190000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":1.355},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":2.9340000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":2.9700000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":1.669}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.307},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39700000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":267380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.374}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66000000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.21199999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.251}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.40300000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.41599999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.47899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.505}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.624}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.622}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:45:40.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:45:40.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.231+0000 7f22d9bbe700 1 Processor -- start 2023-08-18T20:45:40.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.232+0000 7f22d9bbe700 1 -- start start 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d9bbe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22d4152250 0x7f22d40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d9bbe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d4155e00 0x7f22d4156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d9bbe700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d4155970 con 0x7f22d414fb90 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d9bbe700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d41567d0 con 0x7f22d4152250 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d9bbe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d414ff70 con 0x7f22d4155e00 2023-08-18T20:45:40.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22d4152250 0x7f22d40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d37fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f22d414fb90 0x7f22d406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50376/0 (socket says 172.21.15.121:50376) 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d37fe700 1 -- 172.21.15.121:0/4258235142 learned_addr learned my addr 172.21.15.121:0/4258235142 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d3fff700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d4155e00 0x7f22d4156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 -- 172.21.15.121:0/4258235142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d4155e00 msgr2=0x7f22d4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d4155e00 0x7f22d4156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 -- 172.21.15.121:0/4258235142 >> v1:172.21.15.121:6789/0 conn(0x7f22d414fb90 legacy=0x7f22d406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 -- 172.21.15.121:0/4258235142 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d406e830 con 0x7f22d4152250 2023-08-18T20:45:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d2ffd700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d40c5d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009840 tx=0x7f22c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8257563a61f635 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d27fc700 1 -- 172.21.15.121:0/4258235142 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011830 con 0x7f22d4152250 2023-08-18T20:45:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d27fc700 1 -- 172.21.15.121:0/4258235142 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8011990 con 0x7f22d4152250 2023-08-18T20:45:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.233+0000 7f22d27fc700 1 -- 172.21.15.121:0/4258235142 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011d20 con 0x7f22d4152250 2023-08-18T20:45:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 -- 172.21.15.121:0/4258235142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 msgr2=0x7f22d40c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d40c5d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009840 tx=0x7f22c8009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 -- 172.21.15.121:0/4258235142 shutdown_connections 2023-08-18T20:45:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d4155e00 0x7f22d4156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/4258235142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d40c5d10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 -- 172.21.15.121:0/4258235142 >> 172.21.15.121:0/4258235142 conn(0x7f22d40c6b10 msgr2=0x7f22d40c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:40.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 -- 172.21.15.121:0/4258235142 shutdown_connections 2023-08-18T20:45:40.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.234+0000 7f22d9bbe700 1 -- 172.21.15.121:0/4258235142 wait complete. 2023-08-18T20:45:40.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.235+0000 7f22d9bbe700 1 Processor -- start 2023-08-18T20:45:40.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.235+0000 7f22d9bbe700 1 -- start start 2023-08-18T20:45:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 0x7f22d4149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 0x7f22d41488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40ab660 con 0x7f22d4152250 2023-08-18T20:45:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40a9bb0 con 0x7f22d4155e00 2023-08-18T20:45:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d9bbe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d414ac00 con 0x7f22d414fb90 2023-08-18T20:45:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43802/0 (socket says 172.21.15.121:43802) 2023-08-18T20:45:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 -- 172.21.15.121:0/3072408673 learned_addr learned my addr 172.21.15.121:0/3072408673 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:40.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d37fe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 0x7f22d4149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 -- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 msgr2=0x7f22d4149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d3fff700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 0x7f22d41488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 0x7f22d4149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 -- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 msgr2=0x7f22d41488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 0x7f22d41488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d2ffd700 1 -- 172.21.15.121:0/3072408673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80094a0 con 0x7f22d4152250 2023-08-18T20:45:40.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d37fe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 0x7f22d4149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:40.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.236+0000 7f22d3fff700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 0x7f22d41488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:40.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22d2ffd700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c80038a0 con 0x7f22d4152250 2023-08-18T20:45:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c801f070 con 0x7f22d4152250 2023-08-18T20:45:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d414aee0 con 0x7f22d4152250 2023-08-18T20:45:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8003c40 con 0x7f22d4152250 2023-08-18T20:45:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.237+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d40ab2f0 con 0x7f22d4152250 2023-08-18T20:45:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.238+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d40ab480 con 0x7f22d4152250 2023-08-18T20:45:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.238+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22c801a430 con 0x7f22d4152250 2023-08-18T20:45:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.238+0000 7f22bbfff700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.239+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22c8021070 con 0x7f22d4152250 2023-08-18T20:45:40.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.239+0000 7f22d37fe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.239+0000 7f22d37fe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 0x7f22c006c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22c4005910 tx=0x7f22c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.243+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f22c80557b0 con 0x7f22d4152250 2023-08-18T20:45:40.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.428+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22d406e270 con 0x7f22c006a0e0 2023-08-18T20:45:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.436+0000 7f22bbfff700 1 -- 172.21.15.121:0/3072408673 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311471 (secure 0 0 0) 0x7f22c4005960 con 0x7f22c006a0e0 2023-08-18T20:45:40.439 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:40.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.439+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 msgr2=0x7f22c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.439+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 0x7f22c006c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22c4005910 tx=0x7f22c4009040 comp rx=0 tx=0).stop 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 msgr2=0x7f22d4151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8004750 comp rx=0 tx=0).stop 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 shutdown_connections 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22d4155e00 0x7f22d41488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22d414fb90 0x7f22d4149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 --2- 172.21.15.121:0/3072408673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4152250 0x7f22d4151300 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 >> 172.21.15.121:0/3072408673 conn(0x7f22d40c6b10 msgr2=0x7f22d41503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 shutdown_connections 2023-08-18T20:45:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.440+0000 7f22d9bbe700 1 -- 172.21.15.121:0/3072408673 wait complete. 2023-08-18T20:45:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:45:40.451 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-08-18T20:45:38.941026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226092,"kb_used_data":5824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754748628,"statfs":{"total":773094113280,"available":772862595072,"internally_reserved":0,"allocated":5963776,"data_stored":3277008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985321"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909754+0000","last_change":"2023-08-18T20:45:35.904053+0000","last_active":"2023-08-18T20:45:35.909754+0000","last_peered":"2023-08-18T20:45:35.909754+0000","last_clean":"2023-08-18T20:45:35.909754+0000","last_became_active":"2023-08-18T20:45:35.903735+0000","last_became_peered":"2023-08-18T20:45:35.903735+0000","last_unstale":"2023-08-18T20:45:35.909754+0000","last_undegraded":"2023-08-18T20:45:35.909754+0000","last_fullsized":"2023-08-18T20:45:35.909754+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.902649+0000","last_change":"2023-08-18T20:45:35.899964+0000","last_active":"2023-08-18T20:45:35.902649+0000","last_peered":"2023-08-18T20:45:35.902649+0000","last_clean":"2023-08-18T20:45:35.902649+0000","last_became_active":"2023-08-18T20:45:35.899670+0000","last_became_peered":"2023-08-18T20:45:35.899670+0000","last_unstale":"2023-08-18T20:45:35.902649+0000","last_undegraded":"2023-08-18T20:45:35.902649+0000","last_fullsized":"2023-08-18T20:45:35.902649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:14:01.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911080+0000","last_change":"2023-08-18T20:45:35.906068+0000","last_active":"2023-08-18T20:45:35.911080+0000","last_peered":"2023-08-18T20:45:35.911080+0000","last_clean":"2023-08-18T20:45:35.911080+0000","last_became_active":"2023-08-18T20:45:35.905746+0000","last_became_peered":"2023-08-18T20:45:35.905746+0000","last_unstale":"2023-08-18T20:45:35.911080+0000","last_undegraded":"2023-08-18T20:45:35.911080+0000","last_fullsized":"2023-08-18T20:45:35.911080+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:34:10.039790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909956+0000","last_change":"2023-08-18T20:45:35.902831+0000","last_active":"2023-08-18T20:45:35.909956+0000","last_peered":"2023-08-18T20:45:35.909956+0000","last_clean":"2023-08-18T20:45:35.909956+0000","last_became_active":"2023-08-18T20:45:35.902583+0000","last_became_peered":"2023-08-18T20:45:35.902583+0000","last_unstale":"2023-08-18T20:45:35.909956+0000","last_undegraded":"2023-08-18T20:45:35.909956+0000","last_fullsized":"2023-08-18T20:45:35.909956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:15.501807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909657+0000","last_change":"2023-08-18T20:45:35.907509+0000","last_active":"2023-08-18T20:45:35.909657+0000","last_peered":"2023-08-18T20:45:35.909657+0000","last_clean":"2023-08-18T20:45:35.909657+0000","last_became_active":"2023-08-18T20:45:35.906991+0000","last_became_peered":"2023-08-18T20:45:35.906991+0000","last_unstale":"2023-08-18T20:45:35.909657+0000","last_undegraded":"2023-08-18T20:45:35.909657+0000","last_fullsized":"2023-08-18T20:45:35.909657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:55.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915338+0000","last_change":"2023-08-18T20:45:35.910037+0000","last_active":"2023-08-18T20:45:35.915338+0000","last_peered":"2023-08-18T20:45:35.915338+0000","last_clean":"2023-08-18T20:45:35.915338+0000","last_became_active":"2023-08-18T20:45:35.909760+0000","last_became_peered":"2023-08-18T20:45:35.909760+0000","last_unstale":"2023-08-18T20:45:35.915338+0000","last_undegraded":"2023-08-18T20:45:35.915338+0000","last_fullsized":"2023-08-18T20:45:35.915338+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:56:20.791349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.907282+0000","last_change":"2023-08-18T20:45:35.904459+0000","last_active":"2023-08-18T20:45:35.907282+0000","last_peered":"2023-08-18T20:45:35.907282+0000","last_clean":"2023-08-18T20:45:35.907282+0000","last_became_active":"2023-08-18T20:45:35.904153+0000","last_became_peered":"2023-08-18T20:45:35.904153+0000","last_unstale":"2023-08-18T20:45:35.907282+0000","last_undegraded":"2023-08-18T20:45:35.907282+0000","last_fullsized":"2023-08-18T20:45:35.907282+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:17:21.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914738+0000","last_change":"2023-08-18T20:45:35.910962+0000","last_active":"2023-08-18T20:45:35.914738+0000","last_peered":"2023-08-18T20:45:35.914738+0000","last_clean":"2023-08-18T20:45:35.914738+0000","last_became_active":"2023-08-18T20:45:35.910721+0000","last_became_peered":"2023-08-18T20:45:35.910721+0000","last_unstale":"2023-08-18T20:45:35.914738+0000","last_undegraded":"2023-08-18T20:45:35.914738+0000","last_fullsized":"2023-08-18T20:45:35.914738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:16:29.981471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914622+0000","last_change":"2023-08-18T20:45:35.910833+0000","last_active":"2023-08-18T20:45:35.914622+0000","last_peered":"2023-08-18T20:45:35.914622+0000","last_clean":"2023-08-18T20:45:35.914622+0000","last_became_active":"2023-08-18T20:45:35.909062+0000","last_became_peered":"2023-08-18T20:45:35.909062+0000","last_unstale":"2023-08-18T20:45:35.914622+0000","last_undegraded":"2023-08-18T20:45:35.914622+0000","last_fullsized":"2023-08-18T20:45:35.914622+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:54.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910955+0000","last_change":"2023-08-18T20:45:35.904022+0000","last_active":"2023-08-18T20:45:35.910955+0000","last_peered":"2023-08-18T20:45:35.910955+0000","last_clean":"2023-08-18T20:45:35.910955+0000","last_became_active":"2023-08-18T20:45:35.903760+0000","last_became_peered":"2023-08-18T20:45:35.903760+0000","last_unstale":"2023-08-18T20:45:35.910955+0000","last_undegraded":"2023-08-18T20:45:35.910955+0000","last_fullsized":"2023-08-18T20:45:35.910955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:30:42.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910453+0000","last_change":"2023-08-18T20:45:35.906448+0000","last_active":"2023-08-18T20:45:35.910453+0000","last_peered":"2023-08-18T20:45:35.910453+0000","last_clean":"2023-08-18T20:45:35.910453+0000","last_became_active":"2023-08-18T20:45:35.905021+0000","last_became_peered":"2023-08-18T20:45:35.905021+0000","last_unstale":"2023-08-18T20:45:35.910453+0000","last_undegraded":"2023-08-18T20:45:35.910453+0000","last_fullsized":"2023-08-18T20:45:35.910453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:55.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914737+0000","last_change":"2023-08-18T20:45:35.910585+0000","last_active":"2023-08-18T20:45:35.914737+0000","last_peered":"2023-08-18T20:45:35.914737+0000","last_clean":"2023-08-18T20:45:35.914737+0000","last_became_active":"2023-08-18T20:45:35.910306+0000","last_became_peered":"2023-08-18T20:45:35.910306+0000","last_unstale":"2023-08-18T20:45:35.914737+0000","last_undegraded":"2023-08-18T20:45:35.914737+0000","last_fullsized":"2023-08-18T20:45:35.914737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:19:06.612332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914691+0000","last_change":"2023-08-18T20:45:35.909011+0000","last_active":"2023-08-18T20:45:35.914691+0000","last_peered":"2023-08-18T20:45:35.914691+0000","last_clean":"2023-08-18T20:45:35.914691+0000","last_became_active":"2023-08-18T20:45:35.908728+0000","last_became_peered":"2023-08-18T20:45:35.908728+0000","last_unstale":"2023-08-18T20:45:35.914691+0000","last_undegraded":"2023-08-18T20:45:35.914691+0000","last_fullsized":"2023-08-18T20:45:35.914691+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:21.256398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911092+0000","last_change":"2023-08-18T20:45:35.906359+0000","last_active":"2023-08-18T20:45:35.911092+0000","last_peered":"2023-08-18T20:45:35.911092+0000","last_clean":"2023-08-18T20:45:35.911092+0000","last_became_active":"2023-08-18T20:45:35.906092+0000","last_became_peered":"2023-08-18T20:45:35.906092+0000","last_unstale":"2023-08-18T20:45:35.911092+0000","last_undegraded":"2023-08-18T20:45:35.911092+0000","last_fullsized":"2023-08-18T20:45:35.911092+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:40.882452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913280+0000","last_change":"2023-08-18T20:45:35.908516+0000","last_active":"2023-08-18T20:45:35.913280+0000","last_peered":"2023-08-18T20:45:35.913280+0000","last_clean":"2023-08-18T20:45:35.913280+0000","last_became_active":"2023-08-18T20:45:35.907957+0000","last_became_peered":"2023-08-18T20:45:35.907957+0000","last_unstale":"2023-08-18T20:45:35.913280+0000","last_undegraded":"2023-08-18T20:45:35.913280+0000","last_fullsized":"2023-08-18T20:45:35.913280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:35:01.215048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910184+0000","last_change":"2023-08-18T20:45:35.905110+0000","last_active":"2023-08-18T20:45:35.910184+0000","last_peered":"2023-08-18T20:45:35.910184+0000","last_clean":"2023-08-18T20:45:35.910184+0000","last_became_active":"2023-08-18T20:45:35.904860+0000","last_became_peered":"2023-08-18T20:45:35.904860+0000","last_unstale":"2023-08-18T20:45:35.910184+0000","last_undegraded":"2023-08-18T20:45:35.910184+0000","last_fullsized":"2023-08-18T20:45:35.910184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:17:18.038724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909880+0000","last_change":"2023-08-18T20:45:35.904684+0000","last_active":"2023-08-18T20:45:35.909880+0000","last_peered":"2023-08-18T20:45:35.909880+0000","last_clean":"2023-08-18T20:45:35.909880+0000","last_became_active":"2023-08-18T20:45:35.904415+0000","last_became_peered":"2023-08-18T20:45:35.904415+0000","last_unstale":"2023-08-18T20:45:35.909880+0000","last_undegraded":"2023-08-18T20:45:35.909880+0000","last_fullsized":"2023-08-18T20:45:35.909880+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909893+0000","last_change":"2023-08-18T20:45:35.903094+0000","last_active":"2023-08-18T20:45:35.909893+0000","last_peered":"2023-08-18T20:45:35.909893+0000","last_clean":"2023-08-18T20:45:35.909893+0000","last_became_active":"2023-08-18T20:45:35.902444+0000","last_became_peered":"2023-08-18T20:45:35.902444+0000","last_unstale":"2023-08-18T20:45:35.909893+0000","last_undegraded":"2023-08-18T20:45:35.909893+0000","last_fullsized":"2023-08-18T20:45:35.909893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904586+0000","last_change":"2023-08-18T20:45:35.901532+0000","last_active":"2023-08-18T20:45:35.904586+0000","last_peered":"2023-08-18T20:45:35.904586+0000","last_clean":"2023-08-18T20:45:35.904586+0000","last_became_active":"2023-08-18T20:45:35.901219+0000","last_became_peered":"2023-08-18T20:45:35.901219+0000","last_unstale":"2023-08-18T20:45:35.904586+0000","last_undegraded":"2023-08-18T20:45:35.904586+0000","last_fullsized":"2023-08-18T20:45:35.904586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905557+0000","last_change":"2023-08-18T20:45:35.898503+0000","last_active":"2023-08-18T20:45:35.905557+0000","last_peered":"2023-08-18T20:45:35.905557+0000","last_clean":"2023-08-18T20:45:35.905557+0000","last_became_active":"2023-08-18T20:45:35.898323+0000","last_became_peered":"2023-08-18T20:45:35.898323+0000","last_unstale":"2023-08-18T20:45:35.905557+0000","last_undegraded":"2023-08-18T20:45:35.905557+0000","last_fullsized":"2023-08-18T20:45:35.905557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:06:08.533749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.912053+0000","last_change":"2023-08-18T20:45:35.903465+0000","last_active":"2023-08-18T20:45:35.912053+0000","last_peered":"2023-08-18T20:45:35.912053+0000","last_clean":"2023-08-18T20:45:35.912053+0000","last_became_active":"2023-08-18T20:45:35.903146+0000","last_became_peered":"2023-08-18T20:45:35.903146+0000","last_unstale":"2023-08-18T20:45:35.912053+0000","last_undegraded":"2023-08-18T20:45:35.912053+0000","last_fullsized":"2023-08-18T20:45:35.912053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:00:19.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915265+0000","last_change":"2023-08-18T20:45:35.905931+0000","last_active":"2023-08-18T20:45:35.915265+0000","last_peered":"2023-08-18T20:45:35.915265+0000","last_clean":"2023-08-18T20:45:35.915265+0000","last_became_active":"2023-08-18T20:45:35.905676+0000","last_became_peered":"2023-08-18T20:45:35.905676+0000","last_unstale":"2023-08-18T20:45:35.915265+0000","last_undegraded":"2023-08-18T20:45:35.915265+0000","last_fullsized":"2023-08-18T20:45:35.915265+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:50.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915273+0000","last_change":"2023-08-18T20:45:35.906132+0000","last_active":"2023-08-18T20:45:35.915273+0000","last_peered":"2023-08-18T20:45:35.915273+0000","last_clean":"2023-08-18T20:45:35.915273+0000","last_became_active":"2023-08-18T20:45:35.905839+0000","last_became_peered":"2023-08-18T20:45:35.905839+0000","last_unstale":"2023-08-18T20:45:35.915273+0000","last_undegraded":"2023-08-18T20:45:35.915273+0000","last_fullsized":"2023-08-18T20:45:35.915273+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:01:35.907411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913319+0000","last_change":"2023-08-18T20:45:35.909007+0000","last_active":"2023-08-18T20:45:35.913319+0000","last_peered":"2023-08-18T20:45:35.913319+0000","last_clean":"2023-08-18T20:45:35.913319+0000","last_became_active":"2023-08-18T20:45:35.908647+0000","last_became_peered":"2023-08-18T20:45:35.908647+0000","last_unstale":"2023-08-18T20:45:35.913319+0000","last_undegraded":"2023-08-18T20:45:35.913319+0000","last_fullsized":"2023-08-18T20:45:35.913319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:32:43.638358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911859+0000","last_change":"2023-08-18T20:45:35.902924+0000","last_active":"2023-08-18T20:45:35.911859+0000","last_peered":"2023-08-18T20:45:35.911859+0000","last_clean":"2023-08-18T20:45:35.911859+0000","last_became_active":"2023-08-18T20:45:35.902559+0000","last_became_peered":"2023-08-18T20:45:35.902559+0000","last_unstale":"2023-08-18T20:45:35.911859+0000","last_undegraded":"2023-08-18T20:45:35.911859+0000","last_fullsized":"2023-08-18T20:45:35.911859+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:13:25.330501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911926+0000","last_change":"2023-08-18T20:45:35.902555+0000","last_active":"2023-08-18T20:45:35.911926+0000","last_peered":"2023-08-18T20:45:35.911926+0000","last_clean":"2023-08-18T20:45:35.911926+0000","last_became_active":"2023-08-18T20:45:35.902253+0000","last_became_peered":"2023-08-18T20:45:35.902253+0000","last_unstale":"2023-08-18T20:45:35.911926+0000","last_undegraded":"2023-08-18T20:45:35.911926+0000","last_fullsized":"2023-08-18T20:45:35.911926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:50:18.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909344+0000","last_change":"2023-08-18T20:45:35.902409+0000","last_active":"2023-08-18T20:45:35.909344+0000","last_peered":"2023-08-18T20:45:35.909344+0000","last_clean":"2023-08-18T20:45:35.909344+0000","last_became_active":"2023-08-18T20:45:35.902127+0000","last_became_peered":"2023-08-18T20:45:35.902127+0000","last_unstale":"2023-08-18T20:45:35.909344+0000","last_undegraded":"2023-08-18T20:45:35.909344+0000","last_fullsized":"2023-08-18T20:45:35.909344+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:06.984141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899539+0000","last_change":"2023-08-18T20:45:35.894279+0000","last_active":"2023-08-18T20:45:35.899539+0000","last_peered":"2023-08-18T20:45:35.899539+0000","last_clean":"2023-08-18T20:45:35.899539+0000","last_became_active":"2023-08-18T20:45:35.894004+0000","last_became_peered":"2023-08-18T20:45:35.894004+0000","last_unstale":"2023-08-18T20:45:35.899539+0000","last_undegraded":"2023-08-18T20:45:35.899539+0000","last_fullsized":"2023-08-18T20:45:35.899539+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:58:41.242570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911623+0000","last_change":"2023-08-18T20:45:35.907408+0000","last_active":"2023-08-18T20:45:35.911623+0000","last_peered":"2023-08-18T20:45:35.911623+0000","last_clean":"2023-08-18T20:45:35.911623+0000","last_became_active":"2023-08-18T20:45:35.907139+0000","last_became_peered":"2023-08-18T20:45:35.907139+0000","last_unstale":"2023-08-18T20:45:35.911623+0000","last_undegraded":"2023-08-18T20:45:35.911623+0000","last_fullsized":"2023-08-18T20:45:35.911623+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:51:06.857073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.914709+0000","last_change":"2023-08-18T20:45:35.910266+0000","last_active":"2023-08-18T20:45:35.914709+0000","last_peered":"2023-08-18T20:45:35.914709+0000","last_clean":"2023-08-18T20:45:35.914709+0000","last_became_active":"2023-08-18T20:45:35.909890+0000","last_became_peered":"2023-08-18T20:45:35.909890+0000","last_unstale":"2023-08-18T20:45:35.914709+0000","last_undegraded":"2023-08-18T20:45:35.914709+0000","last_fullsized":"2023-08-18T20:45:35.914709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:37:54.793768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909981+0000","last_change":"2023-08-18T20:45:35.904760+0000","last_active":"2023-08-18T20:45:35.909981+0000","last_peered":"2023-08-18T20:45:35.909981+0000","last_clean":"2023-08-18T20:45:35.909981+0000","last_became_active":"2023-08-18T20:45:35.904451+0000","last_became_peered":"2023-08-18T20:45:35.904451+0000","last_unstale":"2023-08-18T20:45:35.909981+0000","last_undegraded":"2023-08-18T20:45:35.909981+0000","last_fullsized":"2023-08-18T20:45:35.909981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903200+0000","last_change":"2023-08-18T20:45:35.900863+0000","last_active":"2023-08-18T20:45:35.903200+0000","last_peered":"2023-08-18T20:45:35.903200+0000","last_clean":"2023-08-18T20:45:35.903200+0000","last_became_active":"2023-08-18T20:45:35.900630+0000","last_became_peered":"2023-08-18T20:45:35.900630+0000","last_unstale":"2023-08-18T20:45:35.903200+0000","last_undegraded":"2023-08-18T20:45:35.903200+0000","last_fullsized":"2023-08-18T20:45:35.903200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:51:22.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905219+0000","last_change":"2023-08-18T20:45:35.898466+0000","last_active":"2023-08-18T20:45:35.905219+0000","last_peered":"2023-08-18T20:45:35.905219+0000","last_clean":"2023-08-18T20:45:35.905219+0000","last_became_active":"2023-08-18T20:45:35.898171+0000","last_became_peered":"2023-08-18T20:45:35.898171+0000","last_unstale":"2023-08-18T20:45:35.905219+0000","last_undegraded":"2023-08-18T20:45:35.905219+0000","last_fullsized":"2023-08-18T20:45:35.905219+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:05.519951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"51'4","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977529+0000","last_change":"2023-08-18T20:45:34.973966+0000","last_active":"2023-08-18T20:45:35.977529+0000","last_peered":"2023-08-18T20:45:35.977529+0000","last_clean":"2023-08-18T20:45:35.977529+0000","last_became_active":"2023-08-18T20:45:34.973275+0000","last_became_peered":"2023-08-18T20:45:34.973275+0000","last_unstale":"2023-08-18T20:45:35.977529+0000","last_undegraded":"2023-08-18T20:45:35.977529+0000","last_fullsized":"2023-08-18T20:45:35.977529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:23:54.260109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910437+0000","last_change":"2023-08-18T20:45:35.905614+0000","last_active":"2023-08-18T20:45:35.910437+0000","last_peered":"2023-08-18T20:45:35.910437+0000","last_clean":"2023-08-18T20:45:35.910437+0000","last_became_active":"2023-08-18T20:45:35.905300+0000","last_became_peered":"2023-08-18T20:45:35.905300+0000","last_unstale":"2023-08-18T20:45:35.910437+0000","last_undegraded":"2023-08-18T20:45:35.910437+0000","last_fullsized":"2023-08-18T20:45:35.910437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:44:02.903372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974755+0000","last_change":"2023-08-18T20:45:34.974441+0000","last_active":"2023-08-18T20:45:35.974755+0000","last_peered":"2023-08-18T20:45:35.974755+0000","last_clean":"2023-08-18T20:45:35.974755+0000","last_became_active":"2023-08-18T20:45:34.974160+0000","last_became_peered":"2023-08-18T20:45:34.974160+0000","last_unstale":"2023-08-18T20:45:35.974755+0000","last_undegraded":"2023-08-18T20:45:35.974755+0000","last_fullsized":"2023-08-18T20:45:35.974755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:05:56.978902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903167+0000","last_change":"2023-08-18T20:45:35.901281+0000","last_active":"2023-08-18T20:45:35.903167+0000","last_peered":"2023-08-18T20:45:35.903167+0000","last_clean":"2023-08-18T20:45:35.903167+0000","last_became_active":"2023-08-18T20:45:35.900941+0000","last_became_peered":"2023-08-18T20:45:35.900941+0000","last_unstale":"2023-08-18T20:45:35.903167+0000","last_undegraded":"2023-08-18T20:45:35.903167+0000","last_fullsized":"2023-08-18T20:45:35.903167+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:45:19.004128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.975070+0000","last_change":"2023-08-18T20:45:34.972508+0000","last_active":"2023-08-18T20:45:35.975070+0000","last_peered":"2023-08-18T20:45:35.975070+0000","last_clean":"2023-08-18T20:45:35.975070+0000","last_became_active":"2023-08-18T20:45:34.972220+0000","last_became_peered":"2023-08-18T20:45:34.972220+0000","last_unstale":"2023-08-18T20:45:35.975070+0000","last_undegraded":"2023-08-18T20:45:35.975070+0000","last_fullsized":"2023-08-18T20:45:35.975070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:05:55.453372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910945+0000","last_change":"2023-08-18T20:45:35.904462+0000","last_active":"2023-08-18T20:45:35.910945+0000","last_peered":"2023-08-18T20:45:35.910945+0000","last_clean":"2023-08-18T20:45:35.910945+0000","last_became_active":"2023-08-18T20:45:35.904204+0000","last_became_peered":"2023-08-18T20:45:35.904204+0000","last_unstale":"2023-08-18T20:45:35.910945+0000","last_undegraded":"2023-08-18T20:45:35.910945+0000","last_fullsized":"2023-08-18T20:45:35.910945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:33:42.340682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977656+0000","last_change":"2023-08-18T20:45:34.963794+0000","last_active":"2023-08-18T20:45:35.977656+0000","last_peered":"2023-08-18T20:45:35.977656+0000","last_clean":"2023-08-18T20:45:35.977656+0000","last_became_active":"2023-08-18T20:45:34.963499+0000","last_became_peered":"2023-08-18T20:45:34.963499+0000","last_unstale":"2023-08-18T20:45:35.977656+0000","last_undegraded":"2023-08-18T20:45:35.977656+0000","last_fullsized":"2023-08-18T20:45:35.977656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:43:29.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893063+0000","last_change":"2023-08-18T20:45:35.891246+0000","last_active":"2023-08-18T20:45:35.893063+0000","last_peered":"2023-08-18T20:45:35.893063+0000","last_clean":"2023-08-18T20:45:35.893063+0000","last_became_active":"2023-08-18T20:45:35.890993+0000","last_became_peered":"2023-08-18T20:45:35.890993+0000","last_unstale":"2023-08-18T20:45:35.893063+0000","last_undegraded":"2023-08-18T20:45:35.893063+0000","last_fullsized":"2023-08-18T20:45:35.893063+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:07.615668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974615+0000","last_change":"2023-08-18T20:45:34.977145+0000","last_active":"2023-08-18T20:45:35.974615+0000","last_peered":"2023-08-18T20:45:35.974615+0000","last_clean":"2023-08-18T20:45:35.974615+0000","last_became_active":"2023-08-18T20:45:34.976889+0000","last_became_peered":"2023-08-18T20:45:34.976889+0000","last_unstale":"2023-08-18T20:45:35.974615+0000","last_undegraded":"2023-08-18T20:45:35.974615+0000","last_fullsized":"2023-08-18T20:45:35.974615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:39:15.689314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.915225+0000","last_change":"2023-08-18T20:45:35.907867+0000","last_active":"2023-08-18T20:45:35.915225+0000","last_peered":"2023-08-18T20:45:35.915225+0000","last_clean":"2023-08-18T20:45:35.915225+0000","last_became_active":"2023-08-18T20:45:35.907577+0000","last_became_peered":"2023-08-18T20:45:35.907577+0000","last_unstale":"2023-08-18T20:45:35.915225+0000","last_undegraded":"2023-08-18T20:45:35.915225+0000","last_fullsized":"2023-08-18T20:45:35.915225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:01:51.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.973973+0000","last_change":"2023-08-18T20:45:34.976208+0000","last_active":"2023-08-18T20:45:35.973973+0000","last_peered":"2023-08-18T20:45:35.973973+0000","last_clean":"2023-08-18T20:45:35.973973+0000","last_became_active":"2023-08-18T20:45:34.975809+0000","last_became_peered":"2023-08-18T20:45:34.975809+0000","last_unstale":"2023-08-18T20:45:35.973973+0000","last_undegraded":"2023-08-18T20:45:35.973973+0000","last_fullsized":"2023-08-18T20:45:35.973973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:28:49.618123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904702+0000","last_change":"2023-08-18T20:45:35.901449+0000","last_active":"2023-08-18T20:45:35.904702+0000","last_peered":"2023-08-18T20:45:35.904702+0000","last_clean":"2023-08-18T20:45:35.904702+0000","last_became_active":"2023-08-18T20:45:35.901106+0000","last_became_peered":"2023-08-18T20:45:35.901106+0000","last_unstale":"2023-08-18T20:45:35.904702+0000","last_undegraded":"2023-08-18T20:45:35.904702+0000","last_fullsized":"2023-08-18T20:45:35.904702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:32:47.561969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891825+0000","last_change":"2023-08-18T20:45:34.977662+0000","last_active":"2023-08-18T20:45:35.891825+0000","last_peered":"2023-08-18T20:45:35.891825+0000","last_clean":"2023-08-18T20:45:35.891825+0000","last_became_active":"2023-08-18T20:45:34.977395+0000","last_became_peered":"2023-08-18T20:45:34.977395+0000","last_unstale":"2023-08-18T20:45:35.891825+0000","last_undegraded":"2023-08-18T20:45:35.891825+0000","last_fullsized":"2023-08-18T20:45:35.891825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:45:47.297736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911079+0000","last_change":"2023-08-18T20:45:35.902649+0000","last_active":"2023-08-18T20:45:35.911079+0000","last_peered":"2023-08-18T20:45:35.911079+0000","last_clean":"2023-08-18T20:45:35.911079+0000","last_became_active":"2023-08-18T20:45:35.902336+0000","last_became_peered":"2023-08-18T20:45:35.902336+0000","last_unstale":"2023-08-18T20:45:35.911079+0000","last_undegraded":"2023-08-18T20:45:35.911079+0000","last_fullsized":"2023-08-18T20:45:35.911079+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:37:43.250449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.892936+0000","last_change":"2023-08-18T20:45:34.974043+0000","last_active":"2023-08-18T20:45:35.892936+0000","last_peered":"2023-08-18T20:45:35.892936+0000","last_clean":"2023-08-18T20:45:35.892936+0000","last_became_active":"2023-08-18T20:45:34.973763+0000","last_became_peered":"2023-08-18T20:45:34.973763+0000","last_unstale":"2023-08-18T20:45:35.892936+0000","last_undegraded":"2023-08-18T20:45:35.892936+0000","last_fullsized":"2023-08-18T20:45:35.892936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:58:48.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.892791+0000","last_change":"2023-08-18T20:45:35.888678+0000","last_active":"2023-08-18T20:45:35.892791+0000","last_peered":"2023-08-18T20:45:35.892791+0000","last_clean":"2023-08-18T20:45:35.892791+0000","last_became_active":"2023-08-18T20:45:35.888415+0000","last_became_peered":"2023-08-18T20:45:35.888415+0000","last_unstale":"2023-08-18T20:45:35.892791+0000","last_undegraded":"2023-08-18T20:45:35.892791+0000","last_fullsized":"2023-08-18T20:45:35.892791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899010+0000","last_change":"2023-08-18T20:45:34.977639+0000","last_active":"2023-08-18T20:45:35.899010+0000","last_peered":"2023-08-18T20:45:35.899010+0000","last_clean":"2023-08-18T20:45:35.899010+0000","last_became_active":"2023-08-18T20:45:34.977299+0000","last_became_peered":"2023-08-18T20:45:34.977299+0000","last_unstale":"2023-08-18T20:45:35.899010+0000","last_undegraded":"2023-08-18T20:45:35.899010+0000","last_fullsized":"2023-08-18T20:45:35.899010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:01:43.150340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911102+0000","last_change":"2023-08-18T20:45:35.903372+0000","last_active":"2023-08-18T20:45:35.911102+0000","last_peered":"2023-08-18T20:45:35.911102+0000","last_clean":"2023-08-18T20:45:35.911102+0000","last_became_active":"2023-08-18T20:45:35.903163+0000","last_became_peered":"2023-08-18T20:45:35.903163+0000","last_unstale":"2023-08-18T20:45:35.911102+0000","last_undegraded":"2023-08-18T20:45:35.911102+0000","last_fullsized":"2023-08-18T20:45:35.911102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:57:44.636960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899433+0000","last_change":"2023-08-18T20:45:34.965192+0000","last_active":"2023-08-18T20:45:35.899433+0000","last_peered":"2023-08-18T20:45:35.899433+0000","last_clean":"2023-08-18T20:45:35.899433+0000","last_became_active":"2023-08-18T20:45:34.964736+0000","last_became_peered":"2023-08-18T20:45:34.964736+0000","last_unstale":"2023-08-18T20:45:35.899433+0000","last_undegraded":"2023-08-18T20:45:35.899433+0000","last_fullsized":"2023-08-18T20:45:35.899433+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:08:04.513405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.908337+0000","last_change":"2023-08-18T20:45:35.905230+0000","last_active":"2023-08-18T20:45:35.908337+0000","last_peered":"2023-08-18T20:45:35.908337+0000","last_clean":"2023-08-18T20:45:35.908337+0000","last_became_active":"2023-08-18T20:45:35.904679+0000","last_became_peered":"2023-08-18T20:45:35.904679+0000","last_unstale":"2023-08-18T20:45:35.908337+0000","last_undegraded":"2023-08-18T20:45:35.908337+0000","last_fullsized":"2023-08-18T20:45:35.908337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:34.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"51'3","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977861+0000","last_change":"2023-08-18T20:45:34.977643+0000","last_active":"2023-08-18T20:45:35.977861+0000","last_peered":"2023-08-18T20:45:35.977861+0000","last_clean":"2023-08-18T20:45:35.977861+0000","last_became_active":"2023-08-18T20:45:34.977323+0000","last_became_peered":"2023-08-18T20:45:34.977323+0000","last_unstale":"2023-08-18T20:45:35.977861+0000","last_undegraded":"2023-08-18T20:45:35.977861+0000","last_fullsized":"2023-08-18T20:45:35.977861+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:28:49.618123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910881+0000","last_change":"2023-08-18T20:45:35.907868+0000","last_active":"2023-08-18T20:45:35.910881+0000","last_peered":"2023-08-18T20:45:35.910881+0000","last_clean":"2023-08-18T20:45:35.910881+0000","last_became_active":"2023-08-18T20:45:35.907562+0000","last_became_peered":"2023-08-18T20:45:35.907562+0000","last_unstale":"2023-08-18T20:45:35.910881+0000","last_undegraded":"2023-08-18T20:45:35.910881+0000","last_fullsized":"2023-08-18T20:45:35.910881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:50.900285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"51'5","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977716+0000","last_change":"2023-08-18T20:45:34.967721+0000","last_active":"2023-08-18T20:45:35.977716+0000","last_peered":"2023-08-18T20:45:35.977716+0000","last_clean":"2023-08-18T20:45:35.977716+0000","last_became_active":"2023-08-18T20:45:34.967000+0000","last_became_peered":"2023-08-18T20:45:34.967000+0000","last_unstale":"2023-08-18T20:45:35.977716+0000","last_undegraded":"2023-08-18T20:45:35.977716+0000","last_fullsized":"2023-08-18T20:45:35.977716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:33.422616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910365+0000","last_change":"2023-08-18T20:45:35.905432+0000","last_active":"2023-08-18T20:45:35.910365+0000","last_peered":"2023-08-18T20:45:35.910365+0000","last_clean":"2023-08-18T20:45:35.910365+0000","last_became_active":"2023-08-18T20:45:35.905124+0000","last_became_peered":"2023-08-18T20:45:35.905124+0000","last_unstale":"2023-08-18T20:45:35.910365+0000","last_undegraded":"2023-08-18T20:45:35.910365+0000","last_fullsized":"2023-08-18T20:45:35.910365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:05:34.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.980009+0000","last_change":"2023-08-18T20:45:34.979922+0000","last_active":"2023-08-18T20:45:35.980009+0000","last_peered":"2023-08-18T20:45:35.980009+0000","last_clean":"2023-08-18T20:45:35.980009+0000","last_became_active":"2023-08-18T20:45:34.979663+0000","last_became_peered":"2023-08-18T20:45:34.979663+0000","last_unstale":"2023-08-18T20:45:35.980009+0000","last_undegraded":"2023-08-18T20:45:35.980009+0000","last_fullsized":"2023-08-18T20:45:35.980009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:40.079115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911997+0000","last_change":"2023-08-18T20:45:35.905734+0000","last_active":"2023-08-18T20:45:35.911997+0000","last_peered":"2023-08-18T20:45:35.911997+0000","last_clean":"2023-08-18T20:45:35.911997+0000","last_became_active":"2023-08-18T20:45:35.903295+0000","last_became_peered":"2023-08-18T20:45:35.903295+0000","last_unstale":"2023-08-18T20:45:35.911997+0000","last_undegraded":"2023-08-18T20:45:35.911997+0000","last_fullsized":"2023-08-18T20:45:35.911997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:35:17.383811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899200+0000","last_change":"2023-08-18T20:45:34.976533+0000","last_active":"2023-08-18T20:45:35.899200+0000","last_peered":"2023-08-18T20:45:35.899200+0000","last_clean":"2023-08-18T20:45:35.899200+0000","last_became_active":"2023-08-18T20:45:34.975963+0000","last_became_peered":"2023-08-18T20:45:34.975963+0000","last_unstale":"2023-08-18T20:45:35.899200+0000","last_undegraded":"2023-08-18T20:45:35.899200+0000","last_fullsized":"2023-08-18T20:45:35.899200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:39:05.080213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904543+0000","last_change":"2023-08-18T20:45:35.901127+0000","last_active":"2023-08-18T20:45:35.904543+0000","last_peered":"2023-08-18T20:45:35.904543+0000","last_clean":"2023-08-18T20:45:35.904543+0000","last_became_active":"2023-08-18T20:45:35.900148+0000","last_became_peered":"2023-08-18T20:45:35.900148+0000","last_unstale":"2023-08-18T20:45:35.904543+0000","last_undegraded":"2023-08-18T20:45:35.904543+0000","last_fullsized":"2023-08-18T20:45:35.904543+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897846+0000","last_change":"2023-08-18T20:45:34.978720+0000","last_active":"2023-08-18T20:45:35.897846+0000","last_peered":"2023-08-18T20:45:35.897846+0000","last_clean":"2023-08-18T20:45:35.897846+0000","last_became_active":"2023-08-18T20:45:34.978408+0000","last_became_peered":"2023-08-18T20:45:34.978408+0000","last_unstale":"2023-08-18T20:45:35.897846+0000","last_undegraded":"2023-08-18T20:45:35.897846+0000","last_fullsized":"2023-08-18T20:45:35.897846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:20:46.939884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909906+0000","last_change":"2023-08-18T20:45:35.904813+0000","last_active":"2023-08-18T20:45:35.909906+0000","last_peered":"2023-08-18T20:45:35.909906+0000","last_clean":"2023-08-18T20:45:35.909906+0000","last_became_active":"2023-08-18T20:45:35.904395+0000","last_became_peered":"2023-08-18T20:45:35.904395+0000","last_unstale":"2023-08-18T20:45:35.909906+0000","last_undegraded":"2023-08-18T20:45:35.909906+0000","last_fullsized":"2023-08-18T20:45:35.909906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"51'8","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977634+0000","last_change":"2023-08-18T20:45:34.973681+0000","last_active":"2023-08-18T20:45:35.977634+0000","last_peered":"2023-08-18T20:45:35.977634+0000","last_clean":"2023-08-18T20:45:35.977634+0000","last_became_active":"2023-08-18T20:45:34.973398+0000","last_became_peered":"2023-08-18T20:45:34.973398+0000","last_unstale":"2023-08-18T20:45:35.977634+0000","last_undegraded":"2023-08-18T20:45:35.977634+0000","last_fullsized":"2023-08-18T20:45:35.977634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:25.772352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.908945+0000","last_change":"2023-08-18T20:45:35.907903+0000","last_active":"2023-08-18T20:45:35.908945+0000","last_peered":"2023-08-18T20:45:35.908945+0000","last_clean":"2023-08-18T20:45:35.908945+0000","last_became_active":"2023-08-18T20:45:35.907569+0000","last_became_peered":"2023-08-18T20:45:35.907569+0000","last_unstale":"2023-08-18T20:45:35.908945+0000","last_undegraded":"2023-08-18T20:45:35.908945+0000","last_fullsized":"2023-08-18T20:45:35.908945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:53:49.733333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.975026+0000","last_change":"2023-08-18T20:45:34.978323+0000","last_active":"2023-08-18T20:45:35.975026+0000","last_peered":"2023-08-18T20:45:35.975026+0000","last_clean":"2023-08-18T20:45:35.975026+0000","last_became_active":"2023-08-18T20:45:34.978045+0000","last_became_peered":"2023-08-18T20:45:34.978045+0000","last_unstale":"2023-08-18T20:45:35.975026+0000","last_undegraded":"2023-08-18T20:45:35.975026+0000","last_fullsized":"2023-08-18T20:45:35.975026+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:43:19.838514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904930+0000","last_change":"2023-08-18T20:45:35.900572+0000","last_active":"2023-08-18T20:45:35.904930+0000","last_peered":"2023-08-18T20:45:35.904930+0000","last_clean":"2023-08-18T20:45:35.904930+0000","last_became_active":"2023-08-18T20:45:35.900283+0000","last_became_peered":"2023-08-18T20:45:35.900283+0000","last_unstale":"2023-08-18T20:45:35.904930+0000","last_undegraded":"2023-08-18T20:45:35.904930+0000","last_fullsized":"2023-08-18T20:45:35.904930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:00:50.276806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895895+0000","last_change":"2023-08-18T20:45:34.976456+0000","last_active":"2023-08-18T20:45:35.895895+0000","last_peered":"2023-08-18T20:45:35.895895+0000","last_clean":"2023-08-18T20:45:35.895895+0000","last_became_active":"2023-08-18T20:45:34.976025+0000","last_became_peered":"2023-08-18T20:45:34.976025+0000","last_unstale":"2023-08-18T20:45:35.895895+0000","last_undegraded":"2023-08-18T20:45:35.895895+0000","last_fullsized":"2023-08-18T20:45:35.895895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:22:05.133522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911962+0000","last_change":"2023-08-18T20:45:35.903676+0000","last_active":"2023-08-18T20:45:35.911962+0000","last_peered":"2023-08-18T20:45:35.911962+0000","last_clean":"2023-08-18T20:45:35.911962+0000","last_became_active":"2023-08-18T20:45:35.902862+0000","last_became_peered":"2023-08-18T20:45:35.902862+0000","last_unstale":"2023-08-18T20:45:35.911962+0000","last_undegraded":"2023-08-18T20:45:35.911962+0000","last_fullsized":"2023-08-18T20:45:35.911962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:37:42.328822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895560+0000","last_change":"2023-08-18T20:45:34.972345+0000","last_active":"2023-08-18T20:45:35.895560+0000","last_peered":"2023-08-18T20:45:35.895560+0000","last_clean":"2023-08-18T20:45:35.895560+0000","last_became_active":"2023-08-18T20:45:34.971833+0000","last_became_peered":"2023-08-18T20:45:34.971833+0000","last_unstale":"2023-08-18T20:45:35.895560+0000","last_undegraded":"2023-08-18T20:45:35.895560+0000","last_fullsized":"2023-08-18T20:45:35.895560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:03:43.829951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.906509+0000","last_change":"2023-08-18T20:45:35.898724+0000","last_active":"2023-08-18T20:45:35.906509+0000","last_peered":"2023-08-18T20:45:35.906509+0000","last_clean":"2023-08-18T20:45:35.906509+0000","last_became_active":"2023-08-18T20:45:35.898443+0000","last_became_peered":"2023-08-18T20:45:35.898443+0000","last_unstale":"2023-08-18T20:45:35.906509+0000","last_undegraded":"2023-08-18T20:45:35.906509+0000","last_fullsized":"2023-08-18T20:45:35.906509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:42.233481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.884638+0000","last_change":"2023-08-18T20:45:34.967849+0000","last_active":"2023-08-18T20:45:35.884638+0000","last_peered":"2023-08-18T20:45:35.884638+0000","last_clean":"2023-08-18T20:45:35.884638+0000","last_became_active":"2023-08-18T20:45:34.967588+0000","last_became_peered":"2023-08-18T20:45:34.967588+0000","last_unstale":"2023-08-18T20:45:35.884638+0000","last_undegraded":"2023-08-18T20:45:35.884638+0000","last_fullsized":"2023-08-18T20:45:35.884638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:05.977594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903060+0000","last_change":"2023-08-18T20:45:35.897819+0000","last_active":"2023-08-18T20:45:35.903060+0000","last_peered":"2023-08-18T20:45:35.903060+0000","last_clean":"2023-08-18T20:45:35.903060+0000","last_became_active":"2023-08-18T20:45:35.897534+0000","last_became_peered":"2023-08-18T20:45:35.897534+0000","last_unstale":"2023-08-18T20:45:35.903060+0000","last_undegraded":"2023-08-18T20:45:35.903060+0000","last_fullsized":"2023-08-18T20:45:35.903060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897884+0000","last_change":"2023-08-18T20:45:34.979956+0000","last_active":"2023-08-18T20:45:35.897884+0000","last_peered":"2023-08-18T20:45:35.897884+0000","last_clean":"2023-08-18T20:45:35.897884+0000","last_became_active":"2023-08-18T20:45:34.979674+0000","last_became_peered":"2023-08-18T20:45:34.979674+0000","last_unstale":"2023-08-18T20:45:35.897884+0000","last_undegraded":"2023-08-18T20:45:35.897884+0000","last_fullsized":"2023-08-18T20:45:35.897884+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:39:15.689314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910415+0000","last_change":"2023-08-18T20:45:35.905583+0000","last_active":"2023-08-18T20:45:35.910415+0000","last_peered":"2023-08-18T20:45:35.910415+0000","last_clean":"2023-08-18T20:45:35.910415+0000","last_became_active":"2023-08-18T20:45:35.905306+0000","last_became_peered":"2023-08-18T20:45:35.905306+0000","last_unstale":"2023-08-18T20:45:35.910415+0000","last_undegraded":"2023-08-18T20:45:35.910415+0000","last_fullsized":"2023-08-18T20:45:35.910415+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891893+0000","last_change":"2023-08-18T20:45:34.976273+0000","last_active":"2023-08-18T20:45:35.891893+0000","last_peered":"2023-08-18T20:45:35.891893+0000","last_clean":"2023-08-18T20:45:35.891893+0000","last_became_active":"2023-08-18T20:45:34.975767+0000","last_became_peered":"2023-08-18T20:45:34.975767+0000","last_unstale":"2023-08-18T20:45:35.891893+0000","last_undegraded":"2023-08-18T20:45:35.891893+0000","last_fullsized":"2023-08-18T20:45:35.891893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:28:40.079115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905802+0000","last_change":"2023-08-18T20:45:35.902727+0000","last_active":"2023-08-18T20:45:35.905802+0000","last_peered":"2023-08-18T20:45:35.905802+0000","last_clean":"2023-08-18T20:45:35.905802+0000","last_became_active":"2023-08-18T20:45:35.902454+0000","last_became_peered":"2023-08-18T20:45:35.902454+0000","last_unstale":"2023-08-18T20:45:35.905802+0000","last_undegraded":"2023-08-18T20:45:35.905802+0000","last_fullsized":"2023-08-18T20:45:35.905802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:06:49.659728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891957+0000","last_change":"2023-08-18T20:45:34.977507+0000","last_active":"2023-08-18T20:45:35.891957+0000","last_peered":"2023-08-18T20:45:35.891957+0000","last_clean":"2023-08-18T20:45:35.891957+0000","last_became_active":"2023-08-18T20:45:34.977042+0000","last_became_peered":"2023-08-18T20:45:34.977042+0000","last_unstale":"2023-08-18T20:45:35.891957+0000","last_undegraded":"2023-08-18T20:45:35.891957+0000","last_fullsized":"2023-08-18T20:45:35.891957+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:20:46.939884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.907836+0000","last_change":"2023-08-18T20:45:35.904814+0000","last_active":"2023-08-18T20:45:35.907836+0000","last_peered":"2023-08-18T20:45:35.907836+0000","last_clean":"2023-08-18T20:45:35.907836+0000","last_became_active":"2023-08-18T20:45:35.904550+0000","last_became_peered":"2023-08-18T20:45:35.904550+0000","last_unstale":"2023-08-18T20:45:35.907836+0000","last_undegraded":"2023-08-18T20:45:35.907836+0000","last_fullsized":"2023-08-18T20:45:35.907836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:50:44.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.883949+0000","last_change":"2023-08-18T20:45:34.973010+0000","last_active":"2023-08-18T20:45:35.883949+0000","last_peered":"2023-08-18T20:45:35.883949+0000","last_clean":"2023-08-18T20:45:35.883949+0000","last_became_active":"2023-08-18T20:45:34.972735+0000","last_became_peered":"2023-08-18T20:45:34.972735+0000","last_unstale":"2023-08-18T20:45:35.883949+0000","last_undegraded":"2023-08-18T20:45:35.883949+0000","last_fullsized":"2023-08-18T20:45:35.883949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:56:36.508944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.913344+0000","last_change":"2023-08-18T20:45:35.910372+0000","last_active":"2023-08-18T20:45:35.913344+0000","last_peered":"2023-08-18T20:45:35.913344+0000","last_clean":"2023-08-18T20:45:35.913344+0000","last_became_active":"2023-08-18T20:45:35.907965+0000","last_became_peered":"2023-08-18T20:45:35.907965+0000","last_unstale":"2023-08-18T20:45:35.913344+0000","last_undegraded":"2023-08-18T20:45:35.913344+0000","last_fullsized":"2023-08-18T20:45:35.913344+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:50.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977481+0000","last_change":"2023-08-18T20:45:34.976242+0000","last_active":"2023-08-18T20:45:35.977481+0000","last_peered":"2023-08-18T20:45:35.977481+0000","last_clean":"2023-08-18T20:45:35.977481+0000","last_became_active":"2023-08-18T20:45:34.975953+0000","last_became_peered":"2023-08-18T20:45:34.975953+0000","last_unstale":"2023-08-18T20:45:35.977481+0000","last_undegraded":"2023-08-18T20:45:35.977481+0000","last_fullsized":"2023-08-18T20:45:35.977481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:29:46.508475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893036+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:45:35.893036+0000","last_peered":"2023-08-18T20:45:35.893036+0000","last_clean":"2023-08-18T20:45:35.893036+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:45:35.893036+0000","last_undegraded":"2023-08-18T20:45:35.893036+0000","last_fullsized":"2023-08-18T20:45:35.893036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:15:37.305797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.909555+0000","last_change":"2023-08-18T20:45:35.907483+0000","last_active":"2023-08-18T20:45:35.909555+0000","last_peered":"2023-08-18T20:45:35.909555+0000","last_clean":"2023-08-18T20:45:35.909555+0000","last_became_active":"2023-08-18T20:45:35.906686+0000","last_became_peered":"2023-08-18T20:45:35.906686+0000","last_unstale":"2023-08-18T20:45:35.909555+0000","last_undegraded":"2023-08-18T20:45:35.909555+0000","last_fullsized":"2023-08-18T20:45:35.909555+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:53:15.501807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.979587+0000","last_change":"2023-08-18T20:45:34.978091+0000","last_active":"2023-08-18T20:45:35.979587+0000","last_peered":"2023-08-18T20:45:35.979587+0000","last_clean":"2023-08-18T20:45:35.979587+0000","last_became_active":"2023-08-18T20:45:34.977812+0000","last_became_peered":"2023-08-18T20:45:34.977812+0000","last_unstale":"2023-08-18T20:45:35.979587+0000","last_undegraded":"2023-08-18T20:45:35.979587+0000","last_fullsized":"2023-08-18T20:45:35.979587+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:42:15.757056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.893576+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:45:35.893576+0000","last_peered":"2023-08-18T20:45:35.893576+0000","last_clean":"2023-08-18T20:45:35.893576+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:45:35.893576+0000","last_undegraded":"2023-08-18T20:45:35.893576+0000","last_fullsized":"2023-08-18T20:45:35.893576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:28:45.899753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.904681+0000","last_change":"2023-08-18T20:45:35.901362+0000","last_active":"2023-08-18T20:45:35.904681+0000","last_peered":"2023-08-18T20:45:35.904681+0000","last_clean":"2023-08-18T20:45:35.904681+0000","last_became_active":"2023-08-18T20:45:35.900540+0000","last_became_peered":"2023-08-18T20:45:35.900540+0000","last_unstale":"2023-08-18T20:45:35.904681+0000","last_undegraded":"2023-08-18T20:45:35.904681+0000","last_fullsized":"2023-08-18T20:45:35.904681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:50.900285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.894736+0000","last_change":"2023-08-18T20:45:34.974454+0000","last_active":"2023-08-18T20:45:35.894736+0000","last_peered":"2023-08-18T20:45:35.894736+0000","last_clean":"2023-08-18T20:45:35.894736+0000","last_became_active":"2023-08-18T20:45:34.974193+0000","last_became_peered":"2023-08-18T20:45:34.974193+0000","last_unstale":"2023-08-18T20:45:35.894736+0000","last_undegraded":"2023-08-18T20:45:35.894736+0000","last_fullsized":"2023-08-18T20:45:35.894736+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:16:13.024297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.895126+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:45:35.895126+0000","last_peered":"2023-08-18T20:45:35.895126+0000","last_clean":"2023-08-18T20:45:35.895126+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:45:35.895126+0000","last_undegraded":"2023-08-18T20:45:35.895126+0000","last_fullsized":"2023-08-18T20:45:35.895126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:03:52.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.905106+0000","last_change":"2023-08-18T20:45:35.900789+0000","last_active":"2023-08-18T20:45:35.905106+0000","last_peered":"2023-08-18T20:45:35.905106+0000","last_clean":"2023-08-18T20:45:35.905106+0000","last_became_active":"2023-08-18T20:45:35.900218+0000","last_became_peered":"2023-08-18T20:45:35.900218+0000","last_unstale":"2023-08-18T20:45:35.905106+0000","last_undegraded":"2023-08-18T20:45:35.905106+0000","last_fullsized":"2023-08-18T20:45:35.905106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:24:26.778899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891638+0000","last_change":"2023-08-18T20:45:34.976358+0000","last_active":"2023-08-18T20:45:35.891638+0000","last_peered":"2023-08-18T20:45:35.891638+0000","last_clean":"2023-08-18T20:45:35.891638+0000","last_became_active":"2023-08-18T20:45:34.976019+0000","last_became_peered":"2023-08-18T20:45:34.976019+0000","last_unstale":"2023-08-18T20:45:35.891638+0000","last_undegraded":"2023-08-18T20:45:35.891638+0000","last_fullsized":"2023-08-18T20:45:35.891638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:47:39.875905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.898259+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:45:35.898259+0000","last_peered":"2023-08-18T20:45:35.898259+0000","last_clean":"2023-08-18T20:45:35.898259+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:45:35.898259+0000","last_undegraded":"2023-08-18T20:45:35.898259+0000","last_fullsized":"2023-08-18T20:45:35.898259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:01:50.157817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.911933+0000","last_change":"2023-08-18T20:45:35.903258+0000","last_active":"2023-08-18T20:45:35.911933+0000","last_peered":"2023-08-18T20:45:35.911933+0000","last_clean":"2023-08-18T20:45:35.911933+0000","last_became_active":"2023-08-18T20:45:35.902942+0000","last_became_peered":"2023-08-18T20:45:35.902942+0000","last_unstale":"2023-08-18T20:45:35.911933+0000","last_undegraded":"2023-08-18T20:45:35.911933+0000","last_fullsized":"2023-08-18T20:45:35.911933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:50:28.407948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.899198+0000","last_change":"2023-08-18T20:45:34.975679+0000","last_active":"2023-08-18T20:45:35.899198+0000","last_peered":"2023-08-18T20:45:35.899198+0000","last_clean":"2023-08-18T20:45:35.899198+0000","last_became_active":"2023-08-18T20:45:34.975369+0000","last_became_peered":"2023-08-18T20:45:34.975369+0000","last_unstale":"2023-08-18T20:45:35.899198+0000","last_undegraded":"2023-08-18T20:45:35.899198+0000","last_fullsized":"2023-08-18T20:45:35.899198+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:00.385565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897525+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:45:35.897525+0000","last_peered":"2023-08-18T20:45:35.897525+0000","last_clean":"2023-08-18T20:45:35.897525+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:45:35.897525+0000","last_undegraded":"2023-08-18T20:45:35.897525+0000","last_fullsized":"2023-08-18T20:45:35.897525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:43:50.886216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.903217+0000","last_change":"2023-08-18T20:45:35.901239+0000","last_active":"2023-08-18T20:45:35.903217+0000","last_peered":"2023-08-18T20:45:35.903217+0000","last_clean":"2023-08-18T20:45:35.903217+0000","last_became_active":"2023-08-18T20:45:35.900850+0000","last_became_peered":"2023-08-18T20:45:35.900850+0000","last_unstale":"2023-08-18T20:45:35.903217+0000","last_undegraded":"2023-08-18T20:45:35.903217+0000","last_fullsized":"2023-08-18T20:45:35.903217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:06:21.971943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.974383+0000","last_change":"2023-08-18T20:45:34.970857+0000","last_active":"2023-08-18T20:45:35.974383+0000","last_peered":"2023-08-18T20:45:35.974383+0000","last_clean":"2023-08-18T20:45:35.974383+0000","last_became_active":"2023-08-18T20:45:34.970218+0000","last_became_peered":"2023-08-18T20:45:34.970218+0000","last_unstale":"2023-08-18T20:45:35.974383+0000","last_undegraded":"2023-08-18T20:45:35.974383+0000","last_fullsized":"2023-08-18T20:45:35.974383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:01:13.237995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":213,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.897229+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:45:35.897229+0000","last_peered":"2023-08-18T20:45:35.897229+0000","last_clean":"2023-08-18T20:45:35.897229+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:45:35.897229+0000","last_undegraded":"2023-08-18T20:45:35.897229+0000","last_fullsized":"2023-08-18T20:45:35.897229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:05.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.884450+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:45:35.884450+0000","last_peered":"2023-08-18T20:45:35.884450+0000","last_clean":"2023-08-18T20:45:35.884450+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:45:35.884450+0000","last_undegraded":"2023-08-18T20:45:35.884450+0000","last_fullsized":"2023-08-18T20:45:35.884450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:51:18.083740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.906531+0000","last_change":"2023-08-18T20:45:35.898795+0000","last_active":"2023-08-18T20:45:35.906531+0000","last_peered":"2023-08-18T20:45:35.906531+0000","last_clean":"2023-08-18T20:45:35.906531+0000","last_became_active":"2023-08-18T20:45:35.898518+0000","last_became_peered":"2023-08-18T20:45:35.898518+0000","last_unstale":"2023-08-18T20:45:35.906531+0000","last_undegraded":"2023-08-18T20:45:35.906531+0000","last_fullsized":"2023-08-18T20:45:35.906531+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:17:06.984141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891787+0000","last_change":"2023-08-18T20:45:34.977122+0000","last_active":"2023-08-18T20:45:35.891787+0000","last_peered":"2023-08-18T20:45:35.891787+0000","last_clean":"2023-08-18T20:45:35.891787+0000","last_became_active":"2023-08-18T20:45:34.976575+0000","last_became_peered":"2023-08-18T20:45:34.976575+0000","last_unstale":"2023-08-18T20:45:35.891787+0000","last_undegraded":"2023-08-18T20:45:35.891787+0000","last_fullsized":"2023-08-18T20:45:35.891787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:11.982732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.891879+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:45:35.891879+0000","last_peered":"2023-08-18T20:45:35.891879+0000","last_clean":"2023-08-18T20:45:35.891879+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:45:35.891879+0000","last_undegraded":"2023-08-18T20:45:35.891879+0000","last_fullsized":"2023-08-18T20:45:35.891879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:40:19.345536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.910372+0000","last_change":"2023-08-18T20:45:35.905894+0000","last_active":"2023-08-18T20:45:35.910372+0000","last_peered":"2023-08-18T20:45:35.910372+0000","last_clean":"2023-08-18T20:45:35.910372+0000","last_became_active":"2023-08-18T20:45:35.905198+0000","last_became_peered":"2023-08-18T20:45:35.905198+0000","last_unstale":"2023-08-18T20:45:35.910372+0000","last_undegraded":"2023-08-18T20:45:35.910372+0000","last_fullsized":"2023-08-18T20:45:35.910372+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:16.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.977800+0000","last_change":"2023-08-18T20:45:34.978547+0000","last_active":"2023-08-18T20:45:35.977800+0000","last_peered":"2023-08-18T20:45:35.977800+0000","last_clean":"2023-08-18T20:45:35.977800+0000","last_became_active":"2023-08-18T20:45:34.977631+0000","last_became_peered":"2023-08-18T20:45:34.977631+0000","last_unstale":"2023-08-18T20:45:35.977800+0000","last_undegraded":"2023-08-18T20:45:35.977800+0000","last_fullsized":"2023-08-18T20:45:35.977800+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:11.982732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-18T20:45:35.900586+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:45:35.900586+0000","last_peered":"2023-08-18T20:45:35.900586+0000","last_clean":"2023-08-18T20:45:35.900586+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:45:35.900586+0000","last_undegraded":"2023-08-18T20:45:35.900586+0000","last_fullsized":"2023-08-18T20:45:35.900586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:56:51.640612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1187840,"data_stored":850620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.745}]},{"osd":1,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.628}]},{"osd":3,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68000000000000005,"5min":1.101,"15min":1.101},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":1.159,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79100000000000004,"5min":1.373,"15min":1.373},"last":0.54600000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":7.6059999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":7.5739999999999998,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.6649999999999991,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.548,"5min":6.548,"15min":6.548},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.442},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Aug 18 20:44:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":857748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":12.057,"5min":12.057,"15min":12.057},"last":1.6930000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":2.8580000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":2.8959999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":1.7190000000000001}]},{"osd":4,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.967000000000001,"5min":11.967000000000001,"15min":11.967000000000001},"last":1.355},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":2.9340000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.029,"5min":12.029,"15min":12.029},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":2.9700000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.999000000000001,"5min":11.999000000000001,"15min":11.999000000000001},"last":1.669}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.307},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.39700000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":267380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.374}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66000000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.21199999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":21.048999999999999,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.94,"5min":13.94,"15min":13.94},"last":0.251}]},{"osd":2,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":10.375,"5min":10.375,"15min":10.375},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.313000000000001,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.875,"5min":1.875,"15min":1.875},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":21.018000000000001,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.40300000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.41599999999999998}]},{"osd":7,"last update":"Fri Aug 18 20:44:35 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.943000000000001,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":10.345000000000001,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.47899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.505}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.624}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":260252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.622}]},{"osd":7,"last update":"Fri Aug 18 20:44:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:45:40.459 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-18T20:45:40.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-18T20:45:40.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 Processor -- start 2023-08-18T20:45:40.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 -- start start 2023-08-18T20:45:40.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6c3c14e950 0x7f6c3c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c14ed30 0x7f6c3c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c0c2260 con 0x7f6c3c0c19d0 2023-08-18T20:45:40.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c0a6630 con 0x7f6c3c14e950 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.620+0000 7f6c42b6a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c151d90 con 0x7f6c3c14ed30 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6c3c14e950 0x7f6c3c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c41107700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6c3c0c19d0 0x7f6c3c0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50394/0 (socket says 172.21.15.121:50394) 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c41107700 1 -- 172.21.15.121:0/4232675898 learned_addr learned my addr 172.21.15.121:0/4232675898 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c3bfff700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c14ed30 0x7f6c3c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 -- 172.21.15.121:0/4232675898 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c14ed30 msgr2=0x7f6c3c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:40.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c14ed30 0x7f6c3c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 -- 172.21.15.121:0/4232675898 >> v1:172.21.15.121:6789/0 conn(0x7f6c3c0c19d0 legacy=0x7f6c3c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 -- 172.21.15.121:0/4232675898 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c152070 con 0x7f6c3c14e950 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c3b7fe700 1 -- 172.21.15.121:0/4232675898 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223269452 0 0) 0x7f6c3c0c2260 con 0x7f6c3c0c19d0 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c40906700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14e950 0x7f6c3c0c2ed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009840 tx=0x7f6c30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa1e367aa2a6172 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c3b7fe700 1 -- 172.21.15.121:0/4232675898 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011830 con 0x7f6c3c14e950 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c3b7fe700 1 -- 172.21.15.121:0/4232675898 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30011990 con 0x7f6c3c14e950 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.621+0000 7f6c3b7fe700 1 -- 172.21.15.121:0/4232675898 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011d20 con 0x7f6c3c14e950 2023-08-18T20:45:40.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 -- 172.21.15.121:0/4232675898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14e950 msgr2=0x7f6c3c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14e950 0x7f6c3c0c2ed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009840 tx=0x7f6c30009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 -- 172.21.15.121:0/4232675898 shutdown_connections 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14e950 0x7f6c3c0c2ed0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/4232675898 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c14ed30 0x7f6c3c0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 -- 172.21.15.121:0/4232675898 >> 172.21.15.121:0/4232675898 conn(0x7f6c3c0c6b10 msgr2=0x7f6c3c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 -- 172.21.15.121:0/4232675898 shutdown_connections 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.622+0000 7f6c42b6a700 1 -- 172.21.15.121:0/4232675898 wait complete. 2023-08-18T20:45:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.623+0000 7f6c42b6a700 1 Processor -- start 2023-08-18T20:45:40.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.623+0000 7f6c42b6a700 1 -- start start 2023-08-18T20:45:40.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c0c19d0 0x7f6c3c1d7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c3c14e950 0x7f6c3c06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c14b860 con 0x7f6c3c14ed30 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1d7530 con 0x7f6c3c14e950 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c0c0bd0 con 0x7f6c3c0c19d0 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43818/0 (socket says 172.21.15.121:43818) 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 -- 172.21.15.121:0/738268489 learned_addr learned my addr 172.21.15.121:0/738268489 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:40.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c40906700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c0c19d0 0x7f6c3c1d7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c3bfff700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c3c14e950 0x7f6c3c06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 -- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c0c19d0 msgr2=0x7f6c3c1d7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c0c19d0 0x7f6c3c1d7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 -- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c3c14e950 msgr2=0x7f6c3c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c3c14e950 0x7f6c3c06dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 -- 172.21.15.121:0/738268489 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300094a0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c41107700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c34002230 tx=0x7f6c3400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400aac0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400ac40 con 0x7f6c3c14ed30 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c0c0eb0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.624+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340070d0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.625+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c14bab0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.626+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c1d7a10 con 0x7f6c3c14ed30 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.626+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c34007250 con 0x7f6c3c14ed30 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.626+0000 7f6c397fa700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 0x7f6c2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.626+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c340882e0 con 0x7f6c3c14ed30 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.626+0000 7f6c40906700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 0x7f6c2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:40.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.627+0000 7f6c40906700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 0x7f6c2006c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c300090b0 tx=0x7f6c30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:40.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.631+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6c3c1d7a10 con 0x7f6c3c14ed30 2023-08-18T20:45:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.897+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6c3c1d7a10 con 0x7f6c3c14ed30 2023-08-18T20:45:40.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.901+0000 7f6c397fa700 1 -- 172.21.15.121:0/738268489 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6c3c1d7a10 con 0x7f6c3c14ed30 2023-08-18T20:45:40.901 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2023-08-18T20:45:40.901 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kivEHAhAA/urIo/gTWyUZSrLJ28OHBQ== 2023-08-18T20:45:40.901 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2023-08-18T20:45:40.901 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2023-08-18T20:45:40.901 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 msgr2=0x7f6c2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 0x7f6c2006c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c300090b0 tx=0x7f6c30008030 comp rx=0 tx=0).stop 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 msgr2=0x7f6c3c1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c34002230 tx=0x7f6c3400cf50 comp rx=0 tx=0).stop 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 shutdown_connections 2023-08-18T20:45:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f6c2006a0e0 0x7f6c2006c5a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c3c14ed30 0x7f6c3c1507e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c3c0c19d0 0x7f6c3c1d7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 --2- 172.21.15.121:0/738268489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c3c14e950 0x7f6c3c06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 >> 172.21.15.121:0/738268489 conn(0x7f6c3c0c6b10 msgr2=0x7f6c3c0c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 shutdown_connections 2023-08-18T20:45:40.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:40.903+0000 7f6c42b6a700 1 -- 172.21.15.121:0/738268489 wait complete. 2023-08-18T20:45:40.905 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2023-08-18T20:45:40.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:41.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.038+0000 7fa38f2a2700 1 Processor -- start 2023-08-18T20:45:41.037 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.038+0000 7fa38f2a2700 1 -- start start 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38f2a2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3880c0c50 0x7fa38806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38f2a2700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3880c4f40 con 0x7fa38806a7e0 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38f2a2700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3880c6120 con 0x7fa3880c5ae0 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38f2a2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3881551f0 con 0x7fa3880c0c50 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38d03e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3880c0c50 0x7fa38806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38c83d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa38806a7e0 0x7fa3880c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50404/0 (socket says 172.21.15.121:50404) 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38c83d700 1 -- 172.21.15.121:0/2427928197 learned_addr learned my addr 172.21.15.121:0/2427928197 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38d03e700 1 -- 172.21.15.121:0/2427928197 >> v1:172.21.15.122:6789/0 conn(0x7fa3880c5ae0 legacy=0x7fa388071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38d03e700 1 -- 172.21.15.121:0/2427928197 >> v1:172.21.15.121:6789/0 conn(0x7fa38806a7e0 legacy=0x7fa3880c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa37ffff700 1 -- 172.21.15.121:0/2427928197 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574499514 0 0) 0x7fa3880c4f40 con 0x7fa38806a7e0 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38d03e700 1 -- 172.21.15.121:0/2427928197 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880c63a0 con 0x7fa3880c0c50 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa38d03e700 1 --2- 172.21.15.121:0/2427928197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c0c50 0x7fa38806a2a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa384009840 tx=0x7fa384009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305c01df0f8e5c5d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa37ffff700 1 -- 172.21.15.121:0/2427928197 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384004230 con 0x7fa3880c0c50 2023-08-18T20:45:41.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa37ffff700 1 -- 172.21.15.121:0/2427928197 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384004390 con 0x7fa3880c0c50 2023-08-18T20:45:41.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.039+0000 7fa37ffff700 1 -- 172.21.15.121:0/2427928197 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840036a0 con 0x7fa3880c0c50 2023-08-18T20:45:41.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2427928197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c0c50 msgr2=0x7fa38806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2427928197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c0c50 0x7fa38806a2a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa384009840 tx=0x7fa384009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:41.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2427928197 shutdown_connections 2023-08-18T20:45:41.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2427928197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c0c50 0x7fa38806a2a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2427928197 >> 172.21.15.121:0/2427928197 conn(0x7fa3880c6b10 msgr2=0x7fa3880c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2427928197 shutdown_connections 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.040+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2427928197 wait complete. 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.041+0000 7fa38f2a2700 1 Processor -- start 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.041+0000 7fa38f2a2700 1 -- start start 2023-08-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa38806a7e0 0x7fa3881ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3880c0c50 0x7fa388099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388157340 con 0x7fa3880c5ae0 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881edd20 con 0x7fa38806a7e0 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881567c0 con 0x7fa3880c0c50 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43832/0 (socket says 172.21.15.121:43832) 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 -- 172.21.15.121:0/2633912908 learned_addr learned my addr 172.21.15.121:0/2633912908 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38c83d700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3880c0c50 0x7fa388099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d03e700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa38806a7e0 0x7fa3881ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 -- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3880c0c50 msgr2=0x7fa388099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3880c0c50 0x7fa388099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 -- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa38806a7e0 msgr2=0x7fa3881ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa38806a7e0 0x7fa3881ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 -- 172.21.15.121:0/2633912908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840094a0 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38d83f700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b970 tx=0x7fa38000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000d860 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38000d9c0 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa388156aa0 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.042+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000dd70 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.043+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa388157870 con 0x7fa3880c5ae0 2023-08-18T20:45:41.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.044+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa388074730 con 0x7fa3880c5ae0 2023-08-18T20:45:41.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.044+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa38000e430 con 0x7fa3880c5ae0 2023-08-18T20:45:41.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.044+0000 7fa37dffb700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 0x7fa36c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.044+0000 7fa38d03e700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 0x7fa36c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.044+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa380088630 con 0x7fa3880c5ae0 2023-08-18T20:45:41.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.045+0000 7fa38d03e700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 0x7fa36c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3840090b0 tx=0x7fa38401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.049+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa380053db0 con 0x7fa3880c5ae0 2023-08-18T20:45:41.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.283+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa388157a60 con 0x7fa3880c5ae0 2023-08-18T20:45:41.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.284+0000 7fa37dffb700 1 -- 172.21.15.121:0/2633912908 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4885 (secure 0 0 0) 0x7fa3800573d0 con 0x7fa3880c5ae0 2023-08-18T20:45:41.284 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:41.284 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1055475719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1055475719},{"type":"v1","addr":"172.21.15.122:6834","nonce":1055475719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1049001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":1049001574},{"type":"v1","addr":"172.21.15.122:6835","nonce":1049001574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5841,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2177141850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2177141850},{"type":"v1","addr":"172.21.15.121:6836","nonce":2177141850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:45:35.359510+0000","modified":"2023-08-18T20:45:38.985103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5844":{"gid":5844,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/891706193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":891706193},{"type":"v1","addr":"172.21.15.121:6837","nonce":891706193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 msgr2=0x7fa36c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 0x7fa36c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3840090b0 tx=0x7fa38401c040 comp rx=0 tx=0).stop 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 msgr2=0x7fa388150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b970 tx=0x7fa38000bc80 comp rx=0 tx=0).stop 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 shutdown_connections 2023-08-18T20:45:41.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa36c06a0e0 0x7fa36c06c5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3880c5ae0 0x7fa388150e50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa38806a7e0 0x7fa3881ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 --2- 172.21.15.121:0/2633912908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3880c0c50 0x7fa388099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.286+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 >> 172.21.15.121:0/2633912908 conn(0x7fa3880c6b10 msgr2=0x7fa388154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.287+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 shutdown_connections 2023-08-18T20:45:41.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.287+0000 7fa38f2a2700 1 -- 172.21.15.121:0/2633912908 wait complete. 2023-08-18T20:45:41.288 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2023-08-18T20:45:41.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-18T20:45:35.359510+0000', 'modified': '2023-08-18T20:45:38.985103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5844}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5844': {'gid': 5844, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6837/891706193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 891706193}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 891706193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-18T20:45:41.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-18T20:45:41.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-18T20:45:41.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.827+0000 7f8f028a5700 1 Processor -- start 2023-08-18T20:45:41.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.827+0000 7f8f028a5700 1 -- start start 2023-08-18T20:45:41.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f028a5700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8efc14ed30 0x7f8efc0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f028a5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc0c2260 con 0x7f8efc070950 2023-08-18T20:45:41.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f028a5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc151d90 con 0x7f8efc14e950 2023-08-18T20:45:41.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f028a5700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc0a6630 con 0x7f8efc14ed30 2023-08-18T20:45:41.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f00e42700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8efc070950 0x7f8efc0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50422/0 (socket says 172.21.15.121:50422) 2023-08-18T20:45:41.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.828+0000 7f8f00e42700 1 -- 172.21.15.121:0/2810727296 learned_addr learned my addr 172.21.15.121:0/2810727296 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:41.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/2810727296 >> v2:172.21.15.122:3300/0 conn(0x7f8efc14ed30 0x7f8efc0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620987521 0 0) 0x7f8efc0c2260 con 0x7f8efc070950 2023-08-18T20:45:41.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee40035b0 con 0x7f8efc070950 2023-08-18T20:45:41.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1276459032 0 0) 0x7f8ee40035b0 con 0x7f8efc070950 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efb7fe700 1 -- 172.21.15.121:0/2810727296 >> v1:172.21.15.122:6789/0 conn(0x7f8efc14e950 legacy=0x7f8efc0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efb7fe700 1 -- 172.21.15.121:0/2810727296 >> v1:172.21.15.121:6789/0 conn(0x7f8efc070950 legacy=0x7f8efc0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efb7fe700 1 -- 172.21.15.121:0/2810727296 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc152070 con 0x7f8efc14ed30 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/2810727296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc0c2ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009840 tx=0x7f8ef0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e1123c1f67b747 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40019f0 con 0x7f8efc14ed30 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0004030 con 0x7f8efc14ed30 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.829+0000 7f8efaffd700 1 -- 172.21.15.121:0/2810727296 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00043c0 con 0x7f8efc14ed30 2023-08-18T20:45:41.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 -- 172.21.15.121:0/2810727296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 msgr2=0x7f8efc0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 --2- 172.21.15.121:0/2810727296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc0c2ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009840 tx=0x7f8ef0009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 -- 172.21.15.121:0/2810727296 shutdown_connections 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 --2- 172.21.15.121:0/2810727296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc0c2ed0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 -- 172.21.15.121:0/2810727296 >> 172.21.15.121:0/2810727296 conn(0x7f8efc0c6b10 msgr2=0x7f8efc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 -- 172.21.15.121:0/2810727296 shutdown_connections 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.830+0000 7f8f028a5700 1 -- 172.21.15.121:0/2810727296 wait complete. 2023-08-18T20:45:41.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.831+0000 7f8f028a5700 1 Processor -- start 2023-08-18T20:45:41.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.831+0000 7f8f028a5700 1 -- start start 2023-08-18T20:45:41.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8efc14e950 0x7f8efc0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc1e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1dc780 con 0x7f8efc070950 2023-08-18T20:45:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1e74f0 con 0x7f8efc14ed30 2023-08-18T20:45:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f028a5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1dc4a0 con 0x7f8efc14e950 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43842/0 (socket says 172.21.15.121:43842) 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 -- 172.21.15.121:0/3754782439 learned_addr learned my addr 172.21.15.121:0/3754782439 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8efc14e950 0x7f8efc0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8f00e42700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc1e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 -- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8efc14e950 msgr2=0x7f8efc0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8efc14e950 0x7f8efc0abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 -- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 msgr2=0x7f8efc1e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc1e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.832+0000 7f8efbfff700 1 -- 172.21.15.121:0/3754782439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00094a0 con 0x7f8efc070950 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8efbfff700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c4e0 tx=0x7f8eec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8ef8ff9700 1 -- 172.21.15.121:0/3754782439 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0052d0 con 0x7f8efc070950 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8ef8ff9700 1 -- 172.21.15.121:0/3754782439 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec005430 con 0x7f8efc070950 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc150bb0 con 0x7f8efc070950 2023-08-18T20:45:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8ef8ff9700 1 -- 172.21.15.121:0/3754782439 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0038c0 con 0x7f8efc070950 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.833+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc0ac4c0 con 0x7f8efc070950 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.834+0000 7f8ef8ff9700 1 -- 172.21.15.121:0/3754782439 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8eec003a20 con 0x7f8efc070950 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.835+0000 7f8ef8ff9700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 0x7f8ee806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.835+0000 7f8ef8ff9700 1 -- 172.21.15.121:0/3754782439 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8eec087a30 con 0x7f8efc070950 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.835+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 0x7f8ee806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.835+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 0x7f8ee806c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00090b0 tx=0x7f8ef0013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 Processor -- start 2023-08-18T20:45:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 -- start start 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b929ced0 0x55c8b92a5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92608b0 0x55c8b92a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b91b85e0 con 0x55c8b92604d0 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b91b5f00 con 0x55c8b92608b0 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8b91b17f0 con 0x55c8b929ced0 2023-08-18T20:45:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43850/0 (socket says 172.21.15.121:43850) 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.837+0000 7f8efbfff700 1 -- 172.21.15.121:0/2642668304 learned_addr learned my addr 172.21.15.121:0/2642668304 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 -- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b929ced0 msgr2=0x55c8b92a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b929ced0 0x55c8b92a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 -- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92608b0 msgr2=0x55c8b92a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8f00e42700 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92608b0 0x55c8b92a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92608b0 0x55c8b92a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 -- 172.21.15.121:0/2642668304 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b90315e0 con 0x55c8b92604d0 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8efbfff700 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8eec085eb0 tx=0x7f8eec0569b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b9575adf48924e server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8ee1ffb700 1 -- 172.21.15.121:0/2642668304 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec057480 con 0x55c8b92604d0 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8ee1ffb700 1 -- 172.21.15.121:0/2642668304 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec05abb0 con 0x55c8b92604d0 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.838+0000 7f8ee1ffb700 1 -- 172.21.15.121:0/2642668304 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec05eb00 con 0x55c8b92604d0 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/2642668304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 msgr2=0x55c8b92928b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8eec085eb0 tx=0x7f8eec0569b0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/2642668304 shutdown_connections 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92608b0 0x55c8b92a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92928b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/2642668304 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b929ced0 0x55c8b92a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/2642668304 >> 172.21.15.121:0/2642668304 conn(0x55c8b918c900 msgr2=0x55c8b925e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/2642668304 shutdown_connections 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/2642668304 wait complete. 2023-08-18T20:45:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 -- start start 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.839+0000 7f8f0ea40b80 1 Processor -- start 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b9294f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b914fa70 con 0x55c8b92604d0 2023-08-18T20:45:41.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b914f770 con 0x55c8b929ced0 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8b90338d0 con 0x55c8b92608b0 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8f0ea40b80 10 client.0 _ll_register_callbacks cb 0x55c8b9099a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43856/0 (socket says 172.21.15.121:43856) 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 -- 172.21.15.121:0/1402839640 learned_addr learned my addr 172.21.15.121:0/1402839640 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 -- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 msgr2=0x55c8b92981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 -- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 msgr2=0x55c8b9294f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b9294f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.840+0000 7f8efbfff700 1 -- 172.21.15.121:0/1402839640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc0ac4c0 con 0x55c8b92604d0 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8efbfff700 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8eec01e040 tx=0x7f8eec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d29b90ce7c2dcfa server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:45:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec075270 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8eec05e670 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8b9252cb0 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eec05e830 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 10 client.5991 fetch_fsmap learned FSMap version 30 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55c8b8fddd90 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec079080 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8eec052be0 con 0x55c8b92604d0 2023-08-18T20:45:41.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 10 client.5991 fetch_fsmap finished waiting for FSMap version 30 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 10 client.5991 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 20 client.5991 populate_metadata read hostname 'smithi121' 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b92796d0 0x55c8b92aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 4 client.5991 mds_command: new command op to 5844 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 --> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8b91aa7d0 con 0x55c8b92796d0 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.841+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b92796d0 0x55c8b92aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8edaffd700 10 client.5991 ms_handle_connect on v2:172.21.15.121:6835/891706193 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b92796d0 0x55c8b92aeed0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e91a7675ec6c89d server_cookie=3b9026e1fb91a3b9 in_seq=0 out_seq=0 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8edaffd700 1 -- 172.21.15.121:0/1402839640 <== mds.0 v2:172.21.15.121:6835/891706193 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8b91aa7d0 con 0x55c8b92796d0 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8edaffd700 10 client.5991 handle_command_reply: tid=0 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 client.5991 shutdown 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 msgr2=0x55c8b92ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8eec01e040 tx=0x7f8eec001120 comp rx=0 tx=0).stop 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 shutdown_connections 2023-08-18T20:45:41.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b92796d0 0x55c8b92aeed0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b9294f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92604d0 0x55c8b92ac3b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8edaffd700 0 client.5991 ms_handle_reset on v2:172.21.15.121:6835/891706193 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/1402839640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 >> 172.21.15.121:0/1402839640 conn(0x55c8b918c900 msgr2=0x55c8b9295e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 shutdown_connections 2023-08-18T20:45:41.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.842+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/1402839640 wait complete. 2023-08-18T20:45:41.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.843+0000 7f8f0ea40b80 20 client.5991 trim_cache size 0 max 16384 2023-08-18T20:45:41.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.860+0000 7f8f0ea40b80 1 Processor -- start 2023-08-18T20:45:41.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.860+0000 7f8f0ea40b80 1 -- start start 2023-08-18T20:45:41.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92604d0 0x55c8b9261430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b925af70 con 0x55c8b929ced0 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b9294d50 con 0x55c8b92604d0 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8b929c630 con 0x55c8b92608b0 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43868/0 (socket says 172.21.15.121:43868) 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 -- 172.21.15.121:0/3466277418 learned_addr learned my addr 172.21.15.121:0/3466277418 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8efbfff700 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92604d0 0x55c8b9261430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 -- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 msgr2=0x55c8b92981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 -- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92604d0 msgr2=0x55c8b9261430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92604d0 0x55c8b9261430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 -- 172.21.15.121:0/3466277418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b8fc6c10 con 0x55c8b929ced0 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8f00e42700 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001970 tx=0x7f8ef4007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638ad7565254ef35 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8ee27fc700 1 -- 172.21.15.121:0/3466277418 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400d070 con 0x55c8b929ced0 2023-08-18T20:45:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.861+0000 7f8ee27fc700 1 -- 172.21.15.121:0/3466277418 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4007a90 con 0x55c8b929ced0 2023-08-18T20:45:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8ee27fc700 1 -- 172.21.15.121:0/3466277418 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014610 con 0x55c8b929ced0 2023-08-18T20:45:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/3466277418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 msgr2=0x55c8b927d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001970 tx=0x7f8ef4007330 comp rx=0 tx=0).stop 2023-08-18T20:45:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/3466277418 shutdown_connections 2023-08-18T20:45:41.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b929ced0 0x55c8b927d5b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b92604d0 0x55c8b9261430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/3466277418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92608b0 0x55c8b92981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/3466277418 >> 172.21.15.121:0/3466277418 conn(0x55c8b918c900 msgr2=0x55c8b92569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/3466277418 shutdown_connections 2023-08-18T20:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.862+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/3466277418 wait complete. 2023-08-18T20:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.863+0000 7f8f0ea40b80 1 -- start start 2023-08-18T20:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.863+0000 7f8f0ea40b80 1 Processor -- start 2023-08-18T20:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.863+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92604d0 0x55c8b92a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.863+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.863+0000 7f8f0ea40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b92b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b9306760 con 0x55c8b92608b0 2023-08-18T20:45:41.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b92abc60 con 0x55c8b929ced0 2023-08-18T20:45:41.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8b9296330 con 0x55c8b92604d0 2023-08-18T20:45:41.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 10 client.0 _ll_register_callbacks cb 0x7f8eec056c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-18T20:45:41.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43872/0 (socket says 172.21.15.121:43872) 2023-08-18T20:45:41.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 -- 172.21.15.121:0/4152372937 learned_addr learned my addr 172.21.15.121:0/4152372937 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:41.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efbfff700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92604d0 0x55c8b92a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f00e42700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b92b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 -- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92604d0 msgr2=0x55c8b92a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92604d0 0x55c8b92a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 -- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 msgr2=0x55c8b92b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b92b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 -- 172.21.15.121:0/4152372937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40015f0 con 0x55c8b92608b0 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f00e42700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b92b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8efb7fe700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0004000 tx=0x7f8ef00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190ffff66e9b7c1d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef002ae40 con 0x55c8b92608b0 2023-08-18T20:45:41.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ef002a040 con 0x55c8b92608b0 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8eec05abb0 con 0x55c8b92608b0 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ef0003e90 con 0x55c8b92608b0 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 10 client.5997 fetch_fsmap learned FSMap version 30 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55c8b9004200 con 0x55c8b92608b0 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec05abb0 con 0x55c8b92608b0 2023-08-18T20:45:41.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.864+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ef0030020 con 0x55c8b92608b0 2023-08-18T20:45:41.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 10 client.5997 fetch_fsmap finished waiting for FSMap version 30 2023-08-18T20:45:41.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 10 client.5997 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-18T20:45:41.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 20 client.5997 populate_metadata read hostname 'smithi121' 2023-08-18T20:45:41.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b9300090 0x55c8b927c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:41.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 4 client.5997 mds_command: new command op to 5844 tid=0[{"prefix": "status"}] 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 --> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c8b916b000 con 0x55c8b9300090 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8efbfff700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b9300090 0x55c8b927c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8edaffd700 10 client.5997 ms_handle_connect on v2:172.21.15.121:6835/891706193 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8efbfff700 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b9300090 0x55c8b927c0a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c335663ac2500f server_cookie=682ebb7f0775e2d2 in_seq=0 out_seq=0 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8edaffd700 1 -- 172.21.15.121:0/4152372937 <== mds.0 v2:172.21.15.121:6835/891706193 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55c8b916b000 con 0x55c8b9300090 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8edaffd700 10 client.5997 handle_command_reply: tid=0 2023-08-18T20:45:41.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 client.5997 shutdown 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 msgr2=0x55c8b9281450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0004000 tx=0x7f8ef00047c0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 shutdown_connections 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:6835/891706193,v1:172.21.15.121:6837/891706193] conn(0x55c8b9300090 0x55c8b927c0a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8b929ced0 0x55c8b92b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8edaffd700 0 client.5997 ms_handle_reset on v2:172.21.15.121:6835/891706193 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c8b92604d0 0x55c8b92a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 --2- 172.21.15.121:0/4152372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c8b92608b0 0x55c8b9281450 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 >> 172.21.15.121:0/4152372937 conn(0x55c8b918c900 msgr2=0x55c8b9295810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 shutdown_connections 2023-08-18T20:45:41.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.865+0000 7f8f0ea40b80 1 -- 172.21.15.121:0/4152372937 wait complete. 2023-08-18T20:45:41.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f0ea40b80 20 client.5997 trim_cache size 0 max 16384 2023-08-18T20:45:41.883 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "4755cd5f-6734-4b3f-8f96-cd10dcf8d04c", 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5844, 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2023-08-18T20:45:41.884 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 5.899698441, 2023-08-18T20:45:41.885 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 30, 2023-08-18T20:45:41.885 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 52, 2023-08-18T20:45:41.885 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 52, 2023-08-18T20:45:41.885 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 12.892421524 2023-08-18T20:45:41.885 INFO:teuthology.orchestra.run.smithi121.stdout:} 2023-08-18T20:45:41.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 msgr2=0x7f8ee806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 0x7f8ee806c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00090b0 tx=0x7f8ef0013040 comp rx=0 tx=0).stop 2023-08-18T20:45:41.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 msgr2=0x7f8efc0ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:41.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c4e0 tx=0x7f8eec00c8a0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 shutdown_connections 2023-08-18T20:45:41.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8efc14ed30 0x7f8efc1e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f8ee806a0e0 0x7f8ee806c5a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8efc070950 0x7f8efc0ac7d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 --2- 172.21.15.121:0/3754782439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8efc14e950 0x7f8efc0abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:41.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 >> 172.21.15.121:0/3754782439 conn(0x7f8efc0c6b10 msgr2=0x7f8efc1dd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:41.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 shutdown_connections 2023-08-18T20:45:41.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:41.866+0000 7f8f028a5700 1 -- 172.21.15.121:0/3754782439 wait complete. 2023-08-18T20:45:41.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:45:42.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.012+0000 7f8209250700 1 Processor -- start 2023-08-18T20:45:42.012 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.012+0000 7f8209250700 1 -- start start 2023-08-18T20:45:42.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82040c7380 0x7f82041585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f820406feb0 0x7f82040c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8204158ae0 con 0x7f820406feb0 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8204155370 con 0x7f82040c7380 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f8209250700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c7760 con 0x7f82040a6ed0 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f820359e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f820406feb0 0x7f82040c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f820359e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f820406feb0 0x7f82040c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43882/0 (socket says 172.21.15.121:43882) 2023-08-18T20:45:42.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f820359e700 1 -- 172.21.15.121:0/1594759274 learned_addr learned my addr 172.21.15.121:0/1594759274 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.013+0000 7f820259c700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8202d9d700 1 --2- 172.21.15.121:0/1594759274 >> v2:172.21.15.122:3300/0 conn(0x7f82040c7380 0x7f82041585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 -- 172.21.15.121:0/1594759274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 msgr2=0x7f820406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820406f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 -- 172.21.15.121:0/1594759274 >> v2:172.21.15.122:3300/0 conn(0x7f82040c7380 msgr2=0x7f82041585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 --2- 172.21.15.121:0/1594759274 >> v2:172.21.15.122:3300/0 conn(0x7f82040c7380 0x7f82041585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 -- 172.21.15.121:0/1594759274 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204154760 con 0x7f820406feb0 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f820359e700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f820406feb0 0x7f82040c3740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82040c89c0 tx=0x7f81fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef197e072902690 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8201d9b700 1 -- 172.21.15.121:0/1594759274 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00e070 con 0x7f820406feb0 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8201d9b700 1 -- 172.21.15.121:0/1594759274 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc00b9c0 con 0x7f820406feb0 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8201d9b700 1 -- 172.21.15.121:0/1594759274 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00bd70 con 0x7f820406feb0 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 -- 172.21.15.121:0/1594759274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f820406feb0 msgr2=0x7f82040c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f820406feb0 0x7f82040c3740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82040c89c0 tx=0x7f81fc00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:42.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 -- 172.21.15.121:0/1594759274 shutdown_connections 2023-08-18T20:45:42.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 --2- 172.21.15.121:0/1594759274 >> v2:172.21.15.122:3300/0 conn(0x7f82040c7380 0x7f82041585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f820406feb0 0x7f82040c3740 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 --2- 172.21.15.121:0/1594759274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 -- 172.21.15.121:0/1594759274 >> 172.21.15.121:0/1594759274 conn(0x7f82040c7bf0 msgr2=0x7f82040c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:42.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 -- 172.21.15.121:0/1594759274 shutdown_connections 2023-08-18T20:45:42.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.014+0000 7f8209250700 1 -- 172.21.15.121:0/1594759274 wait complete. 2023-08-18T20:45:42.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 Processor -- start 2023-08-18T20:45:42.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 -- start start 2023-08-18T20:45:42.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f820406feb0 0x7f82040bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204157ac0 con 0x7f82040c7380 2023-08-18T20:45:42.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c1100 con 0x7f820406feb0 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.016+0000 7f8209250700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8204157350 con 0x7f82040a6ed0 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43888/0 (socket says 172.21.15.121:43888) 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 -- 172.21.15.121:0/3313731835 learned_addr learned my addr 172.21.15.121:0/3313731835 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820259c700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f8202d9d700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f820406feb0 0x7f82040bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 -- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 msgr2=0x7f820414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 -- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f820406feb0 msgr2=0x7f82040bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f820406feb0 0x7f82040bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 -- 172.21.15.121:0/3313731835 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009b30 con 0x7f82040c7380 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f820359e700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8204072b90 tx=0x7f81fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0099b0 con 0x7f82040c7380 2023-08-18T20:45:42.025 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc004250 con 0x7f82040c7380 2023-08-18T20:45:42.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8204157630 con 0x7f82040c7380 2023-08-18T20:45:42.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004600 con 0x7f82040c7380 2023-08-18T20:45:42.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.017+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82041ea140 con 0x7f82040c7380 2023-08-18T20:45:42.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.018+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82041577c0 con 0x7f82040c7380 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.019+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81fc004760 con 0x7f82040c7380 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.019+0000 7f81fb7fe700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 0x7f81e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.019+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81fc089550 con 0x7f82040c7380 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.019+0000 7f8202d9d700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 0x7f81e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.019+0000 7f8202d9d700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 0x7f81e406c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f81f4006fd0 tx=0x7f81f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:42.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.023+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f81fc054cd0 con 0x7f82040c7380 2023-08-18T20:45:42.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.255+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8204074730 con 0x7f82040c7380 2023-08-18T20:45:42.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.255+0000 7f81fb7fe700 1 -- 172.21.15.121:0/3313731835 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f81fc0582f0 con 0x7f82040c7380 2023-08-18T20:45:42.256 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:45:42.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 msgr2=0x7f81e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:42.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 0x7f81e406c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f81f4006fd0 tx=0x7f81f4008040 comp rx=0 tx=0).stop 2023-08-18T20:45:42.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 msgr2=0x7f820406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:42.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8204072b90 tx=0x7f81fc004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 shutdown_connections 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f81e406a0e0 0x7f81e406c5a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82040c7380 0x7f820406c670 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f820406feb0 0x7f82040bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 --2- 172.21.15.121:0/3313731835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82040a6ed0 0x7f820414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 >> 172.21.15.121:0/3313731835 conn(0x7f82040c7bf0 msgr2=0x7f82040a7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:42.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 shutdown_connections 2023-08-18T20:45:42.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:42.257+0000 7f8209250700 1 -- 172.21.15.121:0/3313731835 wait complete. 2023-08-18T20:45:42.269 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-18T20:45:42.269 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:45:42.269 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2023-08-18T20:45:42.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-18T20:45:42.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:42.270 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-18T20:45:42.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:45:42.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:45:42.271 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:45:42.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.272 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2023-08-18T20:45:42.289 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:42.290 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:45:42.291 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 41703sec preferred_lft 41703sec 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::163e:4bc7:1f2c:54ec/64 scope link noprefixroute 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::1003:76ff:feee:6c32/64 scope link 2023-08-18T20:45:42.292 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.293 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:45:42.293 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:0b:53:ca:cd:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-18T20:45:42.293 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::a40b:53ff:feca:cd68/64 scope link 2023-08-18T20:45:42.293 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:42.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.294 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:45:42.354 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-08-18T20:45:42.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.355 DEBUG:teuthology.orchestra.run.smithi121:> route 2023-08-18T20:45:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2023-08-18T20:45:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:45:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:45:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:45:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:45:42.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.417 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2023-08-18T20:45:42.418 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2023-08-18T20:45:42.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:45:42.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:45:42.420 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:45:42.420 DEBUG:teuthology.orchestra.run.smithi121:> ') 2023-08-18T20:45:42.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.519 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2023-08-18T20:45:42.537 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-18T20:45:42.537 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-18T20:45:42.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2023-08-18T20:45:42.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:42.604 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:42.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:42.661 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:42.718 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-18T20:45:42.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:42.804 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:42.804 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:42.830 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:42.830 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:42.830 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:42.830 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:45:42.830 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:42.831 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:42.831 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:42.831 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:42.859 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:42.859 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 0@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:42.860 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:45:42.861 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:45:42.861 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:45:42.863 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:45:42.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.864 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-18T20:45:42.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:42.894 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:45:42.976 INFO:teuthology.orchestra.run.smithi121.stdout:client6006 2023-08-18T20:45:42.977 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:42.977 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:43.034 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:45:43.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.195+0000 7f2789f16700 1 Processor -- start 2023-08-18T20:45:43.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.195+0000 7f2789f16700 1 -- start start 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f2784066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f27840c1030 0x7f278406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f278406b7f0 0x7f27840bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278406cc30 con 0x7f278406b7f0 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27840c0b80 con 0x7f27840c1030 2023-08-18T20:45:43.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2789f16700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784155260 con 0x7f27841518e0 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f278406b7f0 0x7f27840bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f278406b7f0 0x7f27840bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43900/0 (socket says 172.21.15.121:43900) 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 -- 172.21.15.121:0/3099797002 learned_addr learned my addr 172.21.15.121:0/3099797002 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f27837fe700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f2784066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2782ffd700 1 --2- 172.21.15.121:0/3099797002 >> v2:172.21.15.122:3300/0 conn(0x7f27840c1030 0x7f278406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 -- 172.21.15.121:0/3099797002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 msgr2=0x7f2784066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f2784066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 -- 172.21.15.121:0/3099797002 >> v2:172.21.15.122:3300/0 conn(0x7f27840c1030 msgr2=0x7f278406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 --2- 172.21.15.121:0/3099797002 >> v2:172.21.15.122:3300/0 conn(0x7f27840c1030 0x7f278406b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 -- 172.21.15.121:0/3099797002 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278406ce80 con 0x7f278406b7f0 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.196+0000 7f2783fff700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f278406b7f0 0x7f27840bf550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f27840ac450 tx=0x7f277c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6ee2c9001e3f32 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f27827fc700 1 -- 172.21.15.121:0/3099797002 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00e070 con 0x7f278406b7f0 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f27827fc700 1 -- 172.21.15.121:0/3099797002 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00b9c0 con 0x7f278406b7f0 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f27827fc700 1 -- 172.21.15.121:0/3099797002 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00bd70 con 0x7f278406b7f0 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 -- 172.21.15.121:0/3099797002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f278406b7f0 msgr2=0x7f27840bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:43.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f278406b7f0 0x7f27840bf550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f27840ac450 tx=0x7f277c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 -- 172.21.15.121:0/3099797002 shutdown_connections 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f278406b7f0 0x7f27840bf550 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 --2- 172.21.15.121:0/3099797002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f2784066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 --2- 172.21.15.121:0/3099797002 >> v2:172.21.15.122:3300/0 conn(0x7f27840c1030 0x7f278406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 -- 172.21.15.121:0/3099797002 >> 172.21.15.121:0/3099797002 conn(0x7f27840c2ca0 msgr2=0x7f27840c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 -- 172.21.15.121:0/3099797002 shutdown_connections 2023-08-18T20:45:43.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.197+0000 7f2789f16700 1 -- 172.21.15.121:0/3099797002 wait complete. 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.198+0000 7f2789f16700 1 Processor -- start 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 -- start start 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 0x7f27840a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f278414e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784156e30 con 0x7f27840c1030 2023-08-18T20:45:43.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ab140 con 0x7f278406b7f0 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2789f16700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ab3e0 con 0x7f27841518e0 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2782ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2782ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43904/0 (socket says 172.21.15.121:43904) 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2782ffd700 1 -- 172.21.15.121:0/217600709 learned_addr learned my addr 172.21.15.121:0/217600709 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f2783fff700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f278414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.199+0000 7f27837fe700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 0x7f27840a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 -- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 msgr2=0x7f278414e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f278414e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 -- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 msgr2=0x7f27840a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 0x7f27840a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 -- 172.21.15.121:0/217600709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009b30 con 0x7f27840c1030 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2783fff700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f278414e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f27837fe700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 0x7f27840a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2782ffd700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7f0 tx=0x7f277400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:43.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774011800 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774011960 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784158590 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774011d10 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.200+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784158220 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.201+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278406e460 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.201+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2774018360 con 0x7f27840c1030 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.202+0000 7f277bfff700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.202+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27740884d0 con 0x7f27840c1030 2023-08-18T20:45:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.202+0000 7f27837fe700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.202+0000 7f27837fe700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 0x7f276406c5a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f276c006fd0 tx=0x7f276c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.206+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2774053bd0 con 0x7f27840c1030 2023-08-18T20:45:43.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.434+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f278414e130 con 0x7f27840c1030 2023-08-18T20:45:43.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.435+0000 7f277bfff700 1 -- 172.21.15.121:0/217600709 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f278414e130 con 0x7f27840c1030 2023-08-18T20:45:43.435 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:45:43.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.436+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 msgr2=0x7f276406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:43.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.436+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 0x7f276406c5a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f276c006fd0 tx=0x7f276c008040 comp rx=0 tx=0).stop 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.436+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 msgr2=0x7f2784155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.436+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7f0 tx=0x7f277400cbb0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 shutdown_connections 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f27841518e0 0x7f278414e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278406b7f0 0x7f27840a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 --2- 172.21.15.121:0/217600709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27840c1030 0x7f2784155a80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:43.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 >> 172.21.15.121:0/217600709 conn(0x7f27840c2ca0 msgr2=0x7f27840c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:43.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 shutdown_connections 2023-08-18T20:45:43.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:43.437+0000 7f2789f16700 1 -- 172.21.15.121:0/217600709 wait complete. 2023-08-18T20:45:43.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-18T20:45:43.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:45:43.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-08-18T20:45:43.449 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-18T20:45:43.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:43.450 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-18T20:45:43.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:45:43.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:45:43.450 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:43.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.451 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-08-18T20:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.473 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:43.474 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42109sec preferred_lft 42109sec 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc56:1d53:8eb3:4926/64 scope link noprefixroute 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.475 INFO:teuthology.orchestra.run.smithi122.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c41:ffff:fe33:4b6a/64 scope link 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:45:43.476 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-18T20:45:43.477 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::e4bf:e4ff:fe4b:8325/64 scope link 2023-08-18T20:45:43.477 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:43.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.477 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:45:43.544 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:45:43.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.546 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-08-18T20:45:43.606 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-08-18T20:45:43.606 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:45:43.607 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:45:43.607 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:45:43.607 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:45:43.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.608 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:45:43.609 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:45:43.609 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:45:43.609 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:45:43.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:45:43.610 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:45:43.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.719 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:45:43.736 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-18T20:45:43.737 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:43.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-08-18T20:45:43.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:43.805 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:43.861 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:43.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:43.861 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:43.917 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-18T20:45:43.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:43.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:44.002 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:44.002 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:44.025 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:44.025 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:44.025 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:44.025 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:45:44.026 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:44.026 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:44.026 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:44.026 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:44.060 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs=/ 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:45:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:45:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:45:44.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:45:44.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:44.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:44.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:44.099 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:45:44.169 INFO:teuthology.orchestra.run.smithi122.stdout:client5617 2023-08-18T20:45:44.169 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:44.169 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:44.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-08-18T20:45:44.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.359+0000 7f4ed8b94700 1 Processor -- start 2023-08-18T20:45:44.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.359+0000 7f4ed8b94700 1 -- start start 2023-08-18T20:45:44.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed8b94700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ed4155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed8b94700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed40c4110 con 0x7f4ed40c3580 2023-08-18T20:45:44.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed8b94700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed4157cf0 con 0x7f4ed41513d0 2023-08-18T20:45:44.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed8b94700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4158ab0 con 0x7f4ed40c4ca0 2023-08-18T20:45:44.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed1d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4ed40c3580 0x7f4ed40c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50492/0 (socket says 172.21.15.121:50492) 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.360+0000 7f4ed1d9b700 1 -- 172.21.15.121:0/1070669884 learned_addr learned my addr 172.21.15.121:0/1070669884 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ed4155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595116465 0 0) 0x7f4ed40c4110 con 0x7f4ed40c3580 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ebc0035b0 con 0x7f4ed40c3580 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585375994 0 0) 0x7f4ebc0035b0 con 0x7f4ed40c3580 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 msgr2=0x7f4ed4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:44.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ed4155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 >> v1:172.21.15.122:6789/0 conn(0x7f4ed41513d0 legacy=0x7f4ed4151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4157fd0 con 0x7f4ed40c3580 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f4ec4001670 con 0x7f4ed40c3580 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 >> v1:172.21.15.121:6789/0 conn(0x7f4ed40c3580 legacy=0x7f4ed40c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ebc003aa0 0x7f4ebc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ebc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ebc004d90 0x7f4ebc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4158ab0 con 0x7f4ebc004d90 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc00bac0 con 0x7f4ebc003aa0 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc00bc30 con 0x7f4ed40c4ca0 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ebc004d90 0x7f4ebc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ebc003aa0 0x7f4ebc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed1d9b700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ebc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 msgr2=0x7f4ebc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ed40c4ca0 0x7f4ebc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ebc003aa0 msgr2=0x7f4ebc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ebc003aa0 0x7f4ebc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1070669884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0035b0 con 0x7f4ebc004d90 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.361+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ebc003aa0 0x7f4ebc003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ebc004d90 0x7f4ebc005210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c290 tx=0x7f4ebc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653ff5f3ff5aa4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc001e70 con 0x7f4ebc004d90 2023-08-18T20:45:44.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00ce50 con 0x7f4ebc004d90 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed159a700 1 -- 172.21.15.121:0/1070669884 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc012660 con 0x7f4ebc004d90 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1070669884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ebc004d90 msgr2=0x7f4ebc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1070669884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ebc004d90 0x7f4ebc005210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c290 tx=0x7f4ebc005880 comp rx=0 tx=0).stop 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1070669884 reap_dead start 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1070669884 shutdown_connections 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1070669884 >> 172.21.15.121:0/1070669884 conn(0x7f4ed40c7bf0 msgr2=0x7f4ed40c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1070669884 shutdown_connections 2023-08-18T20:45:44.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.362+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1070669884 wait complete. 2023-08-18T20:45:44.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.364+0000 7f4ed8b94700 1 Processor -- start 2023-08-18T20:45:44.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.364+0000 7f4ed8b94700 1 -- start start 2023-08-18T20:45:44.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ebc004d90 0x7f4ed4153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed41506c0 0x7f4ed40bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40bc1f0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40bb8c0 con 0x7f4ed41506c0 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed8b94700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40bbba0 con 0x7f4ebc004d90 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43926/0 (socket says 172.21.15.121:43926) 2023-08-18T20:45:44.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1461976747 learned_addr learned my addr 172.21.15.121:0/1461976747 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed1d9b700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed41506c0 0x7f4ed40bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ebc004d90 0x7f4ed4153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ebc004d90 msgr2=0x7f4ed4153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ebc004d90 0x7f4ed4153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed41506c0 msgr2=0x7f4ed40bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed41506c0 0x7f4ed40bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.365+0000 7f4ed2d9d700 1 -- 172.21.15.121:0/1461976747 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40bbe80 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ed2d9d700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005830 tx=0x7f4ecc0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc003e10 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc0050c0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41547f0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc005430 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.366+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed4153bc0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.367+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed40bc010 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.367+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ecc023070 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.367+0000 7f4ec2ffd700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 0x7f4eb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.368+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ecc089b00 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.368+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 0x7f4eb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.368+0000 7f4ed259c700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 0x7f4eb406c5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009c60 tx=0x7f4ec8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.372+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4ecc0553a0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.637+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f4ed4074730 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.638+0000 7f4ec2ffd700 1 -- 172.21.15.121:0/1461976747 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f4ecc0589c0 con 0x7f4ed40bd2c0 2023-08-18T20:45:44.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 msgr2=0x7f4eb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 0x7f4eb406c5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009c60 tx=0x7f4ec8009210 comp rx=0 tx=0).stop 2023-08-18T20:45:44.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 msgr2=0x7f4ed40bdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005830 tx=0x7f4ecc0015b0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 shutdown_connections 2023-08-18T20:45:44.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.639+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f4eb406a0e0 0x7f4eb406c5a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ed40bd2c0 0x7f4ed40bdfc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ebc004d90 0x7f4ed4153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 --2- 172.21.15.121:0/1461976747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed41506c0 0x7f4ed40bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 >> 172.21.15.121:0/1461976747 conn(0x7f4ed40c7bf0 msgr2=0x7f4ed406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:44.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 shutdown_connections 2023-08-18T20:45:44.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.640+0000 7f4ed8b94700 1 -- 172.21.15.121:0/1461976747 wait complete. 2023-08-18T20:45:44.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.772+0000 7fafc073a700 1 Processor -- start 2023-08-18T20:45:44.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.772+0000 7fafc073a700 1 -- start start 2023-08-18T20:45:44.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafc073a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fafb814ed30 0x7fafb80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafc073a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafb8070950 0x7fafb80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafc073a700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80c2260 con 0x7fafb814e950 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafc073a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb80a6630 con 0x7fafb8070950 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafc073a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb8151d90 con 0x7fafb814ed30 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafb8070950 0x7fafb80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafb8070950 0x7fafb80c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43934/0 (socket says 172.21.15.121:43934) 2023-08-18T20:45:44.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 -- 172.21.15.121:0/2249922185 learned_addr learned my addr 172.21.15.121:0/2249922185 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:44.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbdcd5700 1 --2- 172.21.15.121:0/2249922185 >> v2:172.21.15.122:3300/0 conn(0x7fafb814ed30 0x7fafb80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 -- 172.21.15.121:0/2249922185 >> v2:172.21.15.122:3300/0 conn(0x7fafb814ed30 msgr2=0x7fafb80c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:44.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 --2- 172.21.15.121:0/2249922185 >> v2:172.21.15.122:3300/0 conn(0x7fafb814ed30 0x7fafb80c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 -- 172.21.15.121:0/2249922185 >> v1:172.21.15.122:6789/0 conn(0x7fafb814e950 legacy=0x7fafb80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:44.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 -- 172.21.15.121:0/2249922185 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8152070 con 0x7fafb8070950 2023-08-18T20:45:44.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbecd7700 1 --2- 172.21.15.121:0/2249922185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb8070950 0x7fafb80c4b10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fafb80c7ba0 tx=0x7fafb000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6d50b9e7eb523c server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbd4d4700 1 -- 172.21.15.121:0/2249922185 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000dcf0 con 0x7fafb8070950 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbd4d4700 1 -- 172.21.15.121:0/2249922185 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000de50 con 0x7fafb8070950 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.773+0000 7fafbd4d4700 1 -- 172.21.15.121:0/2249922185 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0004250 con 0x7fafb8070950 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 -- 172.21.15.121:0/2249922185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb8070950 msgr2=0x7fafb80c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 --2- 172.21.15.121:0/2249922185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb8070950 0x7fafb80c4b10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fafb80c7ba0 tx=0x7fafb000be70 comp rx=0 tx=0).stop 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 -- 172.21.15.121:0/2249922185 shutdown_connections 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 --2- 172.21.15.121:0/2249922185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb8070950 0x7fafb80c4b10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 --2- 172.21.15.121:0/2249922185 >> v2:172.21.15.122:3300/0 conn(0x7fafb814ed30 0x7fafb80c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 -- 172.21.15.121:0/2249922185 >> 172.21.15.121:0/2249922185 conn(0x7fafb80c6b10 msgr2=0x7fafb80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:44.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 -- 172.21.15.121:0/2249922185 shutdown_connections 2023-08-18T20:45:44.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.774+0000 7fafc073a700 1 -- 172.21.15.121:0/2249922185 wait complete. 2023-08-18T20:45:44.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.775+0000 7fafc073a700 1 Processor -- start 2023-08-18T20:45:44.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.775+0000 7fafc073a700 1 -- start start 2023-08-18T20:45:44.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 0x7fafb806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 0x7fafb81e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80ac810 con 0x7fafb814ed30 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80aa790 con 0x7fafb814e950 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80ac1c0 con 0x7fafb8070950 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43940/0 (socket says 172.21.15.121:43940) 2023-08-18T20:45:44.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 -- 172.21.15.121:0/4149375732 learned_addr learned my addr 172.21.15.121:0/4149375732 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbdcd5700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 0x7fafb81e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbe4d6700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 0x7fafb806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 -- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 msgr2=0x7fafb806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 0x7fafb806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 -- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 msgr2=0x7fafb81e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 0x7fafb81e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 -- 172.21.15.121:0/4149375732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb000b7f0 con 0x7fafb814ed30 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbdcd5700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 0x7fafb81e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbe4d6700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 0x7fafb806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafbecd7700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fafb000beb0 tx=0x7fafb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0020070 con 0x7fafb814ed30 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0004030 con 0x7fafb814ed30 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb80ac4a0 con 0x7fafb814ed30 2023-08-18T20:45:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.776+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0010470 con 0x7fafb814ed30 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.777+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80abe50 con 0x7fafb814ed30 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.777+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb8074730 con 0x7fafb814ed30 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.778+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fafb00193f0 con 0x7fafb814ed30 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.778+0000 7fafb6ffd700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 0x7fafa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.778+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafb008ba60 con 0x7fafb814ed30 2023-08-18T20:45:44.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.778+0000 7fafbe4d6700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 0x7fafa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:44.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.779+0000 7fafbe4d6700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 0x7fafa406c5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fafa8004a00 tx=0x7fafa8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:44.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.782+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fafb00571e0 con 0x7fafb814ed30 2023-08-18T20:45:44.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.975+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb80ac950 con 0x7fafb814ed30 2023-08-18T20:45:44.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.976+0000 7fafb6ffd700 1 -- 172.21.15.121:0/4149375732 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18283 (secure 0 0 0) 0x7fafb005a800 con 0x7fafb814ed30 2023-08-18T20:45:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:44.977 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:36.882005+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:44.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 msgr2=0x7fafa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 0x7fafa406c5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fafa8004a00 tx=0x7fafa8009040 comp rx=0 tx=0).stop 2023-08-18T20:45:44.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 msgr2=0x7fafb81e53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:44.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fafb000beb0 tx=0x7fafb0004750 comp rx=0 tx=0).stop 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 shutdown_connections 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fafa406a0e0 0x7fafa406c5a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafb814ed30 0x7fafb81e53e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fafb8070950 0x7fafb806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 --2- 172.21.15.121:0/4149375732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafb814e950 0x7fafb81e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:44.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.978+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 >> 172.21.15.121:0/4149375732 conn(0x7fafb80c6b10 msgr2=0x7fafb814df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:44.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.979+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 shutdown_connections 2023-08-18T20:45:44.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:44.979+0000 7fafc073a700 1 -- 172.21.15.121:0/4149375732 wait complete. 2023-08-18T20:45:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:45:33.488863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:45:34.322674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:44.992 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.115+0000 7febd0d9f700 1 Processor -- start 2023-08-18T20:45:45.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.115+0000 7febd0d9f700 1 -- start start 2023-08-18T20:45:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febd0d9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc06a510 0x7febcc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febd0d9f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7febcc157c10 0x7febcc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febd0d9f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0c21f0 con 0x7febcc0c1cf0 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febd0d9f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0c2ba0 con 0x7febcc157c10 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febd0d9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0c6300 con 0x7febcc06a510 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febc9d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7febcc0c1cf0 0x7febcc151980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50526/0 (socket says 172.21.15.121:50526) 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febc9d9b700 1 -- 172.21.15.121:0/1299435785 learned_addr learned my addr 172.21.15.121:0/1299435785 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:45.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.116+0000 7febcad9d700 1 --2- 172.21.15.121:0/1299435785 >> v2:172.21.15.121:3300/0 conn(0x7febcc157c10 0x7febcc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febca59c700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc06a510 0x7febcc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febc959a700 1 -- 172.21.15.121:0/1299435785 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010469301 0 0) 0x7febcc0c21f0 con 0x7febcc0c1cf0 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febc959a700 1 -- 172.21.15.121:0/1299435785 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb40035b0 con 0x7febcc0c1cf0 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febcad9d700 1 -- 172.21.15.121:0/1299435785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc06a510 msgr2=0x7febcc0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febcad9d700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc06a510 0x7febcc0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febcad9d700 1 -- 172.21.15.121:0/1299435785 >> v1:172.21.15.121:6789/0 conn(0x7febcc0c1cf0 legacy=0x7febcc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febcad9d700 1 -- 172.21.15.121:0/1299435785 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0c5b20 con 0x7febcc157c10 2023-08-18T20:45:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febcad9d700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc157c10 0x7febcc1580a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7febc4009d90 tx=0x7febc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6880cb981d6b5560 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febc959a700 1 -- 172.21.15.121:0/1299435785 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400e070 con 0x7febcc157c10 2023-08-18T20:45:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febc959a700 1 -- 172.21.15.121:0/1299435785 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400bb20 con 0x7febcc157c10 2023-08-18T20:45:45.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febc959a700 1 -- 172.21.15.121:0/1299435785 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4012430 con 0x7febcc157c10 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febd0d9f700 1 -- 172.21.15.121:0/1299435785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc157c10 msgr2=0x7febcc1580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.117+0000 7febd0d9f700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc157c10 0x7febcc1580a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7febc4009d90 tx=0x7febc400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 -- 172.21.15.121:0/1299435785 shutdown_connections 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc157c10 0x7febcc1580a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 --2- 172.21.15.121:0/1299435785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc06a510 0x7febcc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 -- 172.21.15.121:0/1299435785 >> 172.21.15.121:0/1299435785 conn(0x7febcc0c6b10 msgr2=0x7febcc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 -- 172.21.15.121:0/1299435785 shutdown_connections 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.118+0000 7febd0d9f700 1 -- 172.21.15.121:0/1299435785 wait complete. 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.119+0000 7febd0d9f700 1 Processor -- start 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.119+0000 7febd0d9f700 1 -- start start 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febcc0c1cf0 0x7febcc1ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc157c10 0x7febcc1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc154d90 con 0x7febcc06a510 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1ed860 con 0x7febcc0c1cf0 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc155030 con 0x7febcc157c10 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43950/0 (socket says 172.21.15.121:43950) 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 -- 172.21.15.121:0/898091441 learned_addr learned my addr 172.21.15.121:0/898091441 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:45.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febc9d9b700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febcc0c1cf0 0x7febcc1ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febcad9d700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc157c10 0x7febcc1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 -- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc157c10 msgr2=0x7febcc1ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc157c10 0x7febcc1ed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 -- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febcc0c1cf0 msgr2=0x7febcc1ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febcc0c1cf0 0x7febcc1ecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 -- 172.21.15.121:0/898091441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009a70 con 0x7febcc06a510 2023-08-18T20:45:45.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febca59c700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7febc000e810 tx=0x7febc000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000c070 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0013610 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc155310 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00139c0 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.120+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc0aa3d0 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.121+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc06eb60 con 0x7febcc06a510 2023-08-18T20:45:45.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.122+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7febc0013b20 con 0x7febcc06a510 2023-08-18T20:45:45.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.122+0000 7febbaffd700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 0x7febac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.123+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febc0088980 con 0x7febcc06a510 2023-08-18T20:45:45.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.123+0000 7febc9d9b700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 0x7febac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.123+0000 7febc9d9b700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 0x7febac06c5a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7febcc0a6130 tx=0x7febbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.126+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7febc0057af0 con 0x7febcc06a510 2023-08-18T20:45:45.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.315+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febcc0c67c0 con 0x7febcc06a510 2023-08-18T20:45:45.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.316+0000 7febbaffd700 1 -- 172.21.15.121:0/898091441 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7febc0057680 con 0x7febcc06a510 2023-08-18T20:45:45.316 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:45.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.317+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 msgr2=0x7febac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.317+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 0x7febac06c5a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7febcc0a6130 tx=0x7febbc009040 comp rx=0 tx=0).stop 2023-08-18T20:45:45.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.317+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 msgr2=0x7febcc0a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.317+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7febc000e810 tx=0x7febc000eb20 comp rx=0 tx=0).stop 2023-08-18T20:45:45.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 shutdown_connections 2023-08-18T20:45:45.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7febcc157c10 0x7febcc1ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7febac06a0e0 0x7febac06c5a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febcc06a510 0x7febcc0a9b00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 --2- 172.21.15.121:0/898091441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febcc0c1cf0 0x7febcc1ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 >> 172.21.15.121:0/898091441 conn(0x7febcc0c6b10 msgr2=0x7febcc156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 shutdown_connections 2023-08-18T20:45:45.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.318+0000 7febd0d9f700 1 -- 172.21.15.121:0/898091441 wait complete. 2023-08-18T20:45:45.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:45.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.452+0000 7fa7048e5700 1 Processor -- start 2023-08-18T20:45:45.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.452+0000 7fa7048e5700 1 -- start start 2023-08-18T20:45:45.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa7048e5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa70014e790 0x7fa70006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa7048e5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70006b7f0 0x7fa70015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa7048e5700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70014eb70 con 0x7fa700072200 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa7048e5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa700070790 con 0x7fa70014e790 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa7048e5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa700154830 con 0x7fa70006b7f0 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa70014e790 0x7fa70006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa70014e790 0x7fa70006b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43958/0 (socket says 172.21.15.121:43958) 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 -- 172.21.15.121:0/4255528045 learned_addr learned my addr 172.21.15.121:0/4255528045 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fed9d700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70006b7f0 0x7fa70015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 -- 172.21.15.121:0/4255528045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70006b7f0 msgr2=0x7fa70015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:45.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70006b7f0 0x7fa70015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 -- 172.21.15.121:0/4255528045 >> v1:172.21.15.122:6789/0 conn(0x7fa700072200 legacy=0x7fa7001525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.453+0000 7fa6fe59c700 1 -- 172.21.15.121:0/4255528045 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700154b10 con 0x7fa70014e790 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa70014e790 0x7fa70006b2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400bb90 tx=0x7fa6f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57853deb7b34c8f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa6fd59a700 1 -- 172.21.15.121:0/4255528045 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400dd50 con 0x7fa70014e790 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa6fd59a700 1 -- 172.21.15.121:0/4255528045 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4010470 con 0x7fa70014e790 2023-08-18T20:45:45.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa6fd59a700 1 -- 172.21.15.121:0/4255528045 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4010800 con 0x7fa70014e790 2023-08-18T20:45:45.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 -- 172.21.15.121:0/4255528045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa70014e790 msgr2=0x7fa70006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa70014e790 0x7fa70006b2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400bb90 tx=0x7fa6f400bea0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 -- 172.21.15.121:0/4255528045 shutdown_connections 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70006b7f0 0x7fa70015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 --2- 172.21.15.121:0/4255528045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa70014e790 0x7fa70006b2b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 -- 172.21.15.121:0/4255528045 >> 172.21.15.121:0/4255528045 conn(0x7fa7000c2ca0 msgr2=0x7fa7000c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 -- 172.21.15.121:0/4255528045 shutdown_connections 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.454+0000 7fa7048e5700 1 -- 172.21.15.121:0/4255528045 wait complete. 2023-08-18T20:45:45.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 Processor -- start 2023-08-18T20:45:45.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 -- start start 2023-08-18T20:45:45.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 0x7fa7000aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70014e790 0x7fa700147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70014b100 con 0x7fa700072200 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70014a510 con 0x7fa70006b7f0 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.456+0000 7fa7048e5700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70014a760 con 0x7fa70014e790 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43966/0 (socket says 172.21.15.121:43966) 2023-08-18T20:45:45.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 -- 172.21.15.121:0/1089595152 learned_addr learned my addr 172.21.15.121:0/1089595152 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 0x7fa7000aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fed9d700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70014e790 0x7fa700147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 -- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70014e790 msgr2=0x7fa700147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70014e790 0x7fa700147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 -- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 msgr2=0x7fa7000aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 0x7fa7000aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 -- 172.21.15.121:0/1089595152 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f400b7f0 con 0x7fa700072200 2023-08-18T20:45:45.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 0x7fa7000aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6fdd9b700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c500 tx=0x7fa6f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00052d0 con 0x7fa700072200 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0005450 con 0x7fa700072200 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa700152e40 con 0x7fa700072200 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003910 con 0x7fa700072200 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.457+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70014ad20 con 0x7fa700072200 2023-08-18T20:45:45.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.458+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7001e8950 con 0x7fa700072200 2023-08-18T20:45:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.459+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6f0003a70 con 0x7fa700072200 2023-08-18T20:45:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.459+0000 7fa6eeffd700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.459+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6f00879c0 con 0x7fa700072200 2023-08-18T20:45:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.459+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.459+0000 7fa6fe59c700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400bee0 tx=0x7fa6f4013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.463+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa6f0053140 con 0x7fa700072200 2023-08-18T20:45:45.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.650+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa70006b530 con 0x7fa700072200 2023-08-18T20:45:45.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.650+0000 7fa6eeffd700 1 -- 172.21.15.121:0/1089595152 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6f0017020 con 0x7fa700072200 2023-08-18T20:45:45.651 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 msgr2=0x7fa6e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400bee0 tx=0x7fa6f4013000 comp rx=0 tx=0).stop 2023-08-18T20:45:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 msgr2=0x7fa7001479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c500 tx=0x7fa6f000c8c0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 shutdown_connections 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa70014e790 0x7fa700147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa70006b7f0 0x7fa7000aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 --2- 172.21.15.121:0/1089595152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa700072200 0x7fa7001479b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 >> 172.21.15.121:0/1089595152 conn(0x7fa7000c2ca0 msgr2=0x7fa70014dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 shutdown_connections 2023-08-18T20:45:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.652+0000 7fa7048e5700 1 -- 172.21.15.121:0/1089595152 wait complete. 2023-08-18T20:45:45.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:45:45.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.787+0000 7f5b33c58700 1 Processor -- start 2023-08-18T20:45:45.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.787+0000 7f5b33c58700 1 -- start start 2023-08-18T20:45:45.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b33c58700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b33c58700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5b2c0c7c50 0x7f5b2c158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b33c58700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0ac1f0 con 0x7f5b2c158680 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b33c58700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c155450 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b33c58700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0bd600 con 0x7f5b2c0af520 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b311f3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5b2c0c7c50 0x7f5b2c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b311f3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5b2c0c7c50 0x7f5b2c158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43972/0 (socket says 172.21.15.121:43972) 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b311f3700 1 -- 172.21.15.121:0/264439119 learned_addr learned my addr 172.21.15.121:0/264439119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:45.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.788+0000 7f5b319f4700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b311f3700 1 -- 172.21.15.121:0/264439119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 msgr2=0x7f5b2c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b311f3700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b311f3700 1 -- 172.21.15.121:0/264439119 >> v1:172.21.15.122:6789/0 conn(0x7f5b2c158680 legacy=0x7f5b2c0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b311f3700 1 -- 172.21.15.121:0/264439119 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0ab950 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b319f4700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b311f3700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c158140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5b280098f0 tx=0x7f5b28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35860e35123d58a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b309f2700 1 -- 172.21.15.121:0/264439119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800b8a0 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b309f2700 1 -- 172.21.15.121:0/264439119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2800ba00 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b309f2700 1 -- 172.21.15.121:0/264439119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800bd90 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b33c58700 1 -- 172.21.15.121:0/264439119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 msgr2=0x7f5b2c158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.789+0000 7f5b33c58700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c158140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5b280098f0 tx=0x7f5b28009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:45.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 -- 172.21.15.121:0/264439119 shutdown_connections 2023-08-18T20:45:45.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 --2- 172.21.15.121:0/264439119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c158140 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 -- 172.21.15.121:0/264439119 >> 172.21.15.121:0/264439119 conn(0x7f5b2c0c9d50 msgr2=0x7f5b2c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 -- 172.21.15.121:0/264439119 shutdown_connections 2023-08-18T20:45:45.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.790+0000 7f5b33c58700 1 -- 172.21.15.121:0/264439119 wait complete. 2023-08-18T20:45:45.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 Processor -- start 2023-08-18T20:45:45.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 -- start start 2023-08-18T20:45:45.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b2c158680 0x7f5b2c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0bef30 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c3530 con 0x7f5b2c158680 2023-08-18T20:45:45.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.791+0000 7f5b33c58700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c0d90 con 0x7f5b2c0af520 2023-08-18T20:45:45.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43980/0 (socket says 172.21.15.121:43980) 2023-08-18T20:45:45.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 -- 172.21.15.121:0/4203399477 learned_addr learned my addr 172.21.15.121:0/4203399477 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:45.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b319f4700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b321f5700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b2c158680 0x7f5b2c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 -- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 msgr2=0x7f5b2c0c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c0c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 -- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b2c158680 msgr2=0x7f5b2c1513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b2c158680 0x7f5b2c1513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 -- 172.21.15.121:0/4203399477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009550 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b311f3700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009c40 tx=0x7f5b28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28004590 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2801e070 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0c1d20 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280038e0 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.792+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0c3a60 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.793+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c157be0 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.794+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b28003a40 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.794+0000 7f5b227fc700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 0x7f5b1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:45.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.794+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b28020070 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.794+0000 7f5b319f4700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 0x7f5b1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:45.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.794+0000 7f5b319f4700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 0x7f5b1006c5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c940 tx=0x7f5b1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:45.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.798+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5b28055100 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.988+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b2c074730 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.988+0000 7f5b227fc700 1 -- 172.21.15.121:0/4203399477 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b280890a0 con 0x7f5b2c0c7c50 2023-08-18T20:45:45.989 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:45.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.990+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 msgr2=0x7f5b1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.990+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 0x7f5b1006c5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c940 tx=0x7f5b1c008040 comp rx=0 tx=0).stop 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.990+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 msgr2=0x7f5b2c0bd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.990+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009c40 tx=0x7f5b28004750 comp rx=0 tx=0).stop 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 shutdown_connections 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b2c158680 0x7f5b2c1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b2c0af520 0x7f5b2c0c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b1006a0e0 0x7f5b1006c5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 --2- 172.21.15.121:0/4203399477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2c0c7c50 0x7f5b2c0bd7d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:45.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 >> 172.21.15.121:0/4203399477 conn(0x7f5b2c0c9d50 msgr2=0x7f5b2c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:45.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 shutdown_connections 2023-08-18T20:45:45.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:45.991+0000 7f5b33c58700 1 -- 172.21.15.121:0/4203399477 wait complete. 2023-08-18T20:45:46.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:45:46.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.126+0000 7fdb5b717700 1 Processor -- start 2023-08-18T20:45:46.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.126+0000 7fdb5b717700 1 -- start start 2023-08-18T20:45:46.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb5b717700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdb5414fb90 0x7fdb540c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb5b717700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb54155970 con 0x7fdb54155e00 2023-08-18T20:45:46.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb5b717700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5406e830 con 0x7fdb54152250 2023-08-18T20:45:46.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb5b717700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5414ff70 con 0x7fdb5414fb90 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdb5414fb90 0x7fdb540c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdb5414fb90 0x7fdb540c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43986/0 (socket says 172.21.15.121:43986) 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb59cb4700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdb54155e00 0x7fdb5415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50572/0 (socket says 172.21.15.121:50572) 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 -- 172.21.15.121:0/3941935390 learned_addr learned my addr 172.21.15.121:0/3941935390 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 -- 172.21.15.121:0/3941935390 >> v1:172.21.15.122:6789/0 conn(0x7fdb54152250 legacy=0x7fdb5406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:46.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 -- 172.21.15.121:0/3941935390 >> v1:172.21.15.121:6789/0 conn(0x7fdb54155e00 legacy=0x7fdb5415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.127+0000 7fdb594b3700 1 -- 172.21.15.121:0/3941935390 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5406df90 con 0x7fdb5414fb90 2023-08-18T20:45:46.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb594b3700 1 --2- 172.21.15.121:0/3941935390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb540c5d10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098f0 tx=0x7fdb50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea945b5f39a7c937 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb4bfff700 1 -- 172.21.15.121:0/3941935390 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004230 con 0x7fdb5414fb90 2023-08-18T20:45:46.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb4bfff700 1 -- 172.21.15.121:0/3941935390 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50004390 con 0x7fdb5414fb90 2023-08-18T20:45:46.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb4bfff700 1 -- 172.21.15.121:0/3941935390 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500036a0 con 0x7fdb5414fb90 2023-08-18T20:45:46.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 -- 172.21.15.121:0/3941935390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 msgr2=0x7fdb540c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 --2- 172.21.15.121:0/3941935390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb540c5d10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdb500098f0 tx=0x7fdb50009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 -- 172.21.15.121:0/3941935390 shutdown_connections 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 --2- 172.21.15.121:0/3941935390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb540c5d10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 -- 172.21.15.121:0/3941935390 >> 172.21.15.121:0/3941935390 conn(0x7fdb540c6b10 msgr2=0x7fdb540c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 -- 172.21.15.121:0/3941935390 shutdown_connections 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.128+0000 7fdb5b717700 1 -- 172.21.15.121:0/3941935390 wait complete. 2023-08-18T20:45:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.129+0000 7fdb5b717700 1 Processor -- start 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.129+0000 7fdb5b717700 1 -- start start 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb54152250 0x7fdb54149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb54155e00 0x7fdb54149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54153d00 con 0x7fdb5414fb90 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54150c00 con 0x7fdb54155e00 2023-08-18T20:45:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb5b717700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54154860 con 0x7fdb54152250 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43992/0 (socket says 172.21.15.121:43992) 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 -- 172.21.15.121:0/2932797155 learned_addr learned my addr 172.21.15.121:0/2932797155 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb59cb4700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb54155e00 0x7fdb54149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb58cb2700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb54152250 0x7fdb54149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 -- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb54152250 msgr2=0x7fdb54149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb54152250 0x7fdb54149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 -- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb54155e00 msgr2=0x7fdb54149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb54155e00 0x7fdb54149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.130+0000 7fdb594b3700 1 -- 172.21.15.121:0/2932797155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009550 con 0x7fdb5414fb90 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb594b3700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000c00 tx=0x7fdb50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000b660 con 0x7fdb5414fb90 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000b7e0 con 0x7fdb5414fb90 2023-08-18T20:45:46.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb54153f30 con 0x7fdb5414fb90 2023-08-18T20:45:46.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000bb90 con 0x7fdb5414fb90 2023-08-18T20:45:46.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.131+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb541544f0 con 0x7fdb5414fb90 2023-08-18T20:45:46.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.132+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb54154680 con 0x7fdb5414fb90 2023-08-18T20:45:46.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.132+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb5000bcf0 con 0x7fdb5414fb90 2023-08-18T20:45:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.133+0000 7fdb49ffb700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 0x7fdb3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.133+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb5008a0e0 con 0x7fdb5414fb90 2023-08-18T20:45:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.133+0000 7fdb58cb2700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 0x7fdb3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.133+0000 7fdb58cb2700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 0x7fdb3806c5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb54153a80 tx=0x7fdb44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.137+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdb500558e0 con 0x7fdb5414fb90 2023-08-18T20:45:46.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.325+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb5406e520 con 0x7fdb5414fb90 2023-08-18T20:45:46.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.325+0000 7fdb49ffb700 1 -- 172.21.15.121:0/2932797155 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb50058f00 con 0x7fdb5414fb90 2023-08-18T20:45:46.326 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:46.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 msgr2=0x7fdb3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 0x7fdb3806c5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb54153a80 tx=0x7fdb44009040 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 msgr2=0x7fdb5414d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000c00 tx=0x7fdb50004750 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 shutdown_connections 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb54155e00 0x7fdb54149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdb3806a0e0 0x7fdb3806c5a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5414fb90 0x7fdb5414d1d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 --2- 172.21.15.121:0/2932797155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdb54152250 0x7fdb54149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 >> 172.21.15.121:0/2932797155 conn(0x7fdb540c6b10 msgr2=0x7fdb54156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:46.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 shutdown_connections 2023-08-18T20:45:46.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.328+0000 7fdb5b717700 1 -- 172.21.15.121:0/2932797155 wait complete. 2023-08-18T20:45:46.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-18T20:45:46.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.459+0000 7f5b8bf28700 1 Processor -- start 2023-08-18T20:45:46.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.459+0000 7f5b8bf28700 1 -- start start 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8bf28700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5b84151b10 0x7f5b840c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8bf28700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b840c4c60 0x7f5b84154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8bf28700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b840ca4a0 con 0x7f5b840c7ca0 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8bf28700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8406c0f0 con 0x7f5b84151b10 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8bf28700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b84158540 con 0x7f5b840c4c60 2023-08-18T20:45:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5b84151b10 0x7f5b840c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b894c3700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5b840c7ca0 0x7f5b841543c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50582/0 (socket says 172.21.15.121:50582) 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b894c3700 1 -- 172.21.15.121:0/205874174 learned_addr learned my addr 172.21.15.121:0/205874174 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b8a4c5700 1 --2- 172.21.15.121:0/205874174 >> v2:172.21.15.122:3300/0 conn(0x7f5b840c4c60 0x7f5b84154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 -- 172.21.15.121:0/205874174 >> v2:172.21.15.122:3300/0 conn(0x7f5b840c4c60 msgr2=0x7f5b84154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 --2- 172.21.15.121:0/205874174 >> v2:172.21.15.122:3300/0 conn(0x7f5b840c4c60 0x7f5b84154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 -- 172.21.15.121:0/205874174 >> v1:172.21.15.121:6789/0 conn(0x7f5b840c7ca0 legacy=0x7f5b841543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 -- 172.21.15.121:0/205874174 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84158820 con 0x7f5b84151b10 2023-08-18T20:45:46.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b88cc2700 1 -- 172.21.15.121:0/205874174 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536815841 0 0) 0x7f5b840ca4a0 con 0x7f5b840c7ca0 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.460+0000 7f5b89cc4700 1 --2- 172.21.15.121:0/205874174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840c4720 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5b840c66b0 tx=0x7f5b74009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b15af656d0707de server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b88cc2700 1 -- 172.21.15.121:0/205874174 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74011830 con 0x7f5b84151b10 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b88cc2700 1 -- 172.21.15.121:0/205874174 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74011990 con 0x7f5b84151b10 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b88cc2700 1 -- 172.21.15.121:0/205874174 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74011d20 con 0x7f5b84151b10 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 -- 172.21.15.121:0/205874174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 msgr2=0x7f5b840c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/205874174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840c4720 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5b840c66b0 tx=0x7f5b74009b20 comp rx=0 tx=0).stop 2023-08-18T20:45:46.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 -- 172.21.15.121:0/205874174 shutdown_connections 2023-08-18T20:45:46.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/205874174 >> v2:172.21.15.122:3300/0 conn(0x7f5b840c4c60 0x7f5b84154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/205874174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840c4720 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 -- 172.21.15.121:0/205874174 >> 172.21.15.121:0/205874174 conn(0x7f5b84071bb0 msgr2=0x7f5b84071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:46.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 -- 172.21.15.121:0/205874174 shutdown_connections 2023-08-18T20:45:46.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.461+0000 7f5b8bf28700 1 -- 172.21.15.121:0/205874174 wait complete. 2023-08-18T20:45:46.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.462+0000 7f5b8bf28700 1 Processor -- start 2023-08-18T20:45:46.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.462+0000 7f5b8bf28700 1 -- start start 2023-08-18T20:45:46.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b840c4c60 0x7f5b840c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b840c7ca0 0x7f5b840c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840bf9e0 con 0x7f5b84151b10 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c3dd0 con 0x7f5b840c4c60 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8bf28700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840ab900 con 0x7f5b840c7ca0 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44010/0 (socket says 172.21.15.121:44010) 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 -- 172.21.15.121:0/2765248292 learned_addr learned my addr 172.21.15.121:0/2765248292 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b89cc4700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b840c4c60 0x7f5b840c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b894c3700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b840c7ca0 0x7f5b840c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 -- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b840c7ca0 msgr2=0x7f5b840c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b840c7ca0 0x7f5b840c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 -- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b840c4c60 msgr2=0x7f5b840c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b840c4c60 0x7f5b840c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.463+0000 7f5b8a4c5700 1 -- 172.21.15.121:0/2765248292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740094a0 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b8a4c5700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009fd0 tx=0x7f5b7c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007ea0 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00ed30 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b840abbe0 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00eea0 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.464+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b840bd7d0 con 0x7f5b84151b10 2023-08-18T20:45:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.465+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840ca910 con 0x7f5b84151b10 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.465+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b7c014660 con 0x7f5b84151b10 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.465+0000 7f5b7a7fc700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 0x7f5b6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.466+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b7c088b40 con 0x7f5b84151b10 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.466+0000 7f5b89cc4700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 0x7f5b6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.466+0000 7f5b89cc4700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 0x7f5b6806c5a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b740090b0 tx=0x7f5b74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.470+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5b840ca910 con 0x7f5b84151b10 2023-08-18T20:45:46.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.660+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b840ca910 con 0x7f5b84151b10 2023-08-18T20:45:46.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.661+0000 7f5b7a7fc700 1 -- 172.21.15.121:0/2765248292 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+269 (secure 0 0 0) 0x7f5b840ca910 con 0x7f5b84151b10 2023-08-18T20:45:46.661 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:46.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 9, 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_metadata" 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2023-08-18T20:45:46.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2023-08-18T20:45:46.664 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 10, 2023-08-18T20:45:46.664 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_data" 2023-08-18T20:45:46.664 INFO:teuthology.orchestra.run.smithi121.stdout: } 2023-08-18T20:45:46.664 INFO:teuthology.orchestra.run.smithi121.stdout:] 2023-08-18T20:45:46.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 msgr2=0x7f5b6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 0x7f5b6806c5a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b740090b0 tx=0x7f5b74008030 comp rx=0 tx=0).stop 2023-08-18T20:45:46.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 msgr2=0x7f5b840bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009fd0 tx=0x7f5b7c00e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 shutdown_connections 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b6806a0e0 0x7f5b6806c5a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b84151b10 0x7f5b840bdfd0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b840c4c60 0x7f5b840c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.662+0000 7f5b8bf28700 1 --2- 172.21.15.121:0/2765248292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b840c7ca0 0x7f5b840c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.663+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 >> 172.21.15.121:0/2765248292 conn(0x7f5b84071bb0 msgr2=0x7f5b84150750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.663+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 shutdown_connections 2023-08-18T20:45:46.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.663+0000 7f5b8bf28700 1 -- 172.21.15.121:0/2765248292 wait complete. 2023-08-18T20:45:46.675 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-08-18T20:45:46.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-08-18T20:45:46.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.799+0000 7fd28e670700 1 Processor -- start 2023-08-18T20:45:46.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.799+0000 7fd28e670700 1 -- start start 2023-08-18T20:45:46.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd28814dfd0 0x7fd288151490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a2a0 0x7fd288070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd28806a750 0x7fd288070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2880c2500 con 0x7fd28814dfd0 2023-08-18T20:45:46.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2881509b0 con 0x7fd28806a750 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28e670700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd288150c90 con 0x7fd28806a2a0 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd28814dfd0 0x7fd288151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd28814dfd0 0x7fd288151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44014/0 (socket says 172.21.15.121:44014) 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 -- 172.21.15.121:0/1331997874 learned_addr learned my addr 172.21.15.121:0/1331997874 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd28cc0d700 1 --2- 172.21.15.121:0/1331997874 >> v2:172.21.15.122:3300/0 conn(0x7fd28806a750 0x7fd288070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd2877fe700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a2a0 0x7fd288070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 -- 172.21.15.121:0/1331997874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a2a0 msgr2=0x7fd288070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:46.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a2a0 0x7fd288070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 -- 172.21.15.121:0/1331997874 >> v2:172.21.15.122:3300/0 conn(0x7fd28806a750 msgr2=0x7fd288070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 --2- 172.21.15.121:0/1331997874 >> v2:172.21.15.122:3300/0 conn(0x7fd28806a750 0x7fd288070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 -- 172.21.15.121:0/1331997874 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288150f70 con 0x7fd28814dfd0 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd287fff700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28814dfd0 0x7fd288151490 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd288072a90 tx=0x7fd27c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9484c626dfc9a029 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd286ffd700 1 -- 172.21.15.121:0/1331997874 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00b870 con 0x7fd28814dfd0 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd286ffd700 1 -- 172.21.15.121:0/1331997874 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00b9d0 con 0x7fd28814dfd0 2023-08-18T20:45:46.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.800+0000 7fd286ffd700 1 -- 172.21.15.121:0/1331997874 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00bd60 con 0x7fd28814dfd0 2023-08-18T20:45:46.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 -- 172.21.15.121:0/1331997874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28814dfd0 msgr2=0x7fd288151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28814dfd0 0x7fd288151490 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd288072a90 tx=0x7fd27c009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 -- 172.21.15.121:0/1331997874 shutdown_connections 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 --2- 172.21.15.121:0/1331997874 >> v2:172.21.15.122:3300/0 conn(0x7fd28806a750 0x7fd288070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28814dfd0 0x7fd288151490 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 --2- 172.21.15.121:0/1331997874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a2a0 0x7fd288070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 -- 172.21.15.121:0/1331997874 >> 172.21.15.121:0/1331997874 conn(0x7fd28806bdc0 msgr2=0x7fd28806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:46.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 -- 172.21.15.121:0/1331997874 shutdown_connections 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.801+0000 7fd28e670700 1 -- 172.21.15.121:0/1331997874 wait complete. 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.802+0000 7fd28e670700 1 Processor -- start 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.802+0000 7fd28e670700 1 -- start start 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a750 0x7fd28813d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28814dfd0 0x7fd28813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28813fb80 con 0x7fd28806a2a0 2023-08-18T20:45:46.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288147260 con 0x7fd28814dfd0 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd28e670700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28813fdb0 con 0x7fd28806a750 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44020/0 (socket says 172.21.15.121:44020) 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 -- 172.21.15.121:0/2557258008 learned_addr learned my addr 172.21.15.121:0/2557258008 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 -- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a750 msgr2=0x7fd28813d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a750 0x7fd28813d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 -- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28814dfd0 msgr2=0x7fd28813d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28814dfd0 0x7fd28813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 -- 172.21.15.121:0/2557258008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009550 con 0x7fd28806a2a0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.803+0000 7fd287fff700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd27c014040 tx=0x7fd27c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.804+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c004520 con 0x7fd28806a2a0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.804+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c01e070 con 0x7fd28806a2a0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.804+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd288146ef0 con 0x7fd28806a2a0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.804+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0038e0 con 0x7fd28806a2a0 2023-08-18T20:45:46.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.804+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28815b940 con 0x7fd28806a2a0 2023-08-18T20:45:46.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.805+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288074730 con 0x7fd28806a2a0 2023-08-18T20:45:46.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.805+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd27c003a40 con 0x7fd28806a2a0 2023-08-18T20:45:46.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.806+0000 7fd284ff9700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:46.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.806+0000 7fd2877fe700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:46.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.806+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd27c020070 con 0x7fd28806a2a0 2023-08-18T20:45:46.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.806+0000 7fd2877fe700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 0x7fd27406c5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd278006ba0 tx=0x7fd278008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:46.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:46.810+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd27c0554b0 con 0x7fd28806a2a0 2023-08-18T20:45:47.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.000+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd2880c07f0 con 0x7fd28806a2a0 2023-08-18T20:45:47.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.076+0000 7fd284ff9700 1 -- 172.21.15.121:0/2557258008 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v53) v1 ==== 140+0+0 (secure 0 0 0) 0x7fd27c015020 con 0x7fd28806a2a0 2023-08-18T20:45:47.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 msgr2=0x7fd27406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 0x7fd27406c5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd278006ba0 tx=0x7fd278008040 comp rx=0 tx=0).stop 2023-08-18T20:45:47.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 msgr2=0x7fd28815b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd27c014040 tx=0x7fd27c004750 comp rx=0 tx=0).stop 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 shutdown_connections 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28814dfd0 0x7fd28813d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28806a2a0 0x7fd28815b400 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 --2- 172.21.15.121:0/2557258008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd28806a750 0x7fd28813d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.079+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 >> 172.21.15.121:0/2557258008 conn(0x7fd28806bdc0 msgr2=0x7fd28806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:47.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.080+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 shutdown_connections 2023-08-18T20:45:47.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.080+0000 7fd28e670700 1 -- 172.21.15.121:0/2557258008 wait complete. 2023-08-18T20:45:47.082 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_metadata' created 2023-08-18T20:45:47.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-18T20:45:47.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.221+0000 7f0162e37700 1 Processor -- start 2023-08-18T20:45:47.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.221+0000 7f0162e37700 1 -- start start 2023-08-18T20:45:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f0162e37700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f015c14ed30 0x7f015c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f0162e37700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c0c2260 con 0x7f015c070950 2023-08-18T20:45:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f0162e37700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c151d90 con 0x7f015c14e950 2023-08-18T20:45:47.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f0162e37700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c0a6630 con 0x7f015c14ed30 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015bfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f015c14ed30 0x7f015c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f01613d4700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f015c070950 0x7f015c0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50614/0 (socket says 172.21.15.121:50614) 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015bfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f015c14ed30 0x7f015c0c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44028/0 (socket says 172.21.15.121:44028) 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f01613d4700 1 -- 172.21.15.121:0/2447381765 learned_addr learned my addr 172.21.15.121:0/2447381765 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015bfff700 1 -- 172.21.15.121:0/2447381765 >> v1:172.21.15.122:6789/0 conn(0x7f015c14e950 legacy=0x7f015c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015bfff700 1 -- 172.21.15.121:0/2447381765 >> v1:172.21.15.121:6789/0 conn(0x7f015c070950 legacy=0x7f015c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015bfff700 1 -- 172.21.15.121:0/2447381765 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c152070 con 0x7f015c14ed30 2023-08-18T20:45:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.222+0000 7f015b7fe700 1 -- 172.21.15.121:0/2447381765 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147430590 0 0) 0x7f015c0c2260 con 0x7f015c070950 2023-08-18T20:45:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f015bfff700 1 --2- 172.21.15.121:0/2447381765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c0c2ed0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0148009840 tx=0x7f0148009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f0f313c40bf58a server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f015b7fe700 1 -- 172.21.15.121:0/2447381765 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011830 con 0x7f015c14ed30 2023-08-18T20:45:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f015b7fe700 1 -- 172.21.15.121:0/2447381765 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148011990 con 0x7f015c14ed30 2023-08-18T20:45:47.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f015b7fe700 1 -- 172.21.15.121:0/2447381765 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011d20 con 0x7f015c14ed30 2023-08-18T20:45:47.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 -- 172.21.15.121:0/2447381765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 msgr2=0x7f015c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 --2- 172.21.15.121:0/2447381765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c0c2ed0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0148009840 tx=0x7f0148009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:47.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 -- 172.21.15.121:0/2447381765 shutdown_connections 2023-08-18T20:45:47.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 --2- 172.21.15.121:0/2447381765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c0c2ed0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 -- 172.21.15.121:0/2447381765 >> 172.21.15.121:0/2447381765 conn(0x7f015c0c6b10 msgr2=0x7f015c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 -- 172.21.15.121:0/2447381765 shutdown_connections 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.223+0000 7f0162e37700 1 -- 172.21.15.121:0/2447381765 wait complete. 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.224+0000 7f0162e37700 1 Processor -- start 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.224+0000 7f0162e37700 1 -- start start 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 0x7f015c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:47.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 0x7f015c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c06b080 con 0x7f015c14ed30 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c14c760 con 0x7f015c070950 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f0162e37700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c06a700 con 0x7f015c14e950 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f01613d4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:47.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f01613d4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44038/0 (socket says 172.21.15.121:44038) 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.225+0000 7f01613d4700 1 -- 172.21.15.121:0/3887499740 learned_addr learned my addr 172.21.15.121:0/3887499740 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f0160bd3700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 0x7f015c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f015bfff700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 0x7f015c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 -- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 msgr2=0x7f015c14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 0x7f015c14bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 -- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 msgr2=0x7f015c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 0x7f015c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:47.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 -- 172.21.15.121:0/3887499740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480094a0 con 0x7f015c14ed30 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f0160bd3700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 0x7f015c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f015bfff700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 0x7f015c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01613d4700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0154002230 tx=0x7f015400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400ac20 con 0x7f015c14ed30 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015400ada0 con 0x7f015c14ed30 2023-08-18T20:45:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c06da10 con 0x7f015c14ed30 2023-08-18T20:45:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154007310 con 0x7f015c14ed30 2023-08-18T20:45:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.226+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c06aca0 con 0x7f015c14ed30 2023-08-18T20:45:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.227+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c074730 con 0x7f015c14ed30 2023-08-18T20:45:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.228+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0154007470 con 0x7f015c14ed30 2023-08-18T20:45:47.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.228+0000 7f01597fa700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 0x7f014006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:47.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.228+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f0154088510 con 0x7f015c14ed30 2023-08-18T20:45:47.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.228+0000 7f0160bd3700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 0x7f014006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:47.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.228+0000 7f0160bd3700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 0x7f014006c5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f015c0acd10 tx=0x7f0150009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.232+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0154053b10 con 0x7f015c14ed30 2023-08-18T20:45:47.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:47.424+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f015c1dc3e0 con 0x7f015c14ed30 2023-08-18T20:45:48.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.080+0000 7f01597fa700 1 -- 172.21.15.121:0/3887499740 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v54) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0154057130 con 0x7f015c14ed30 2023-08-18T20:45:48.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.086+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 msgr2=0x7f014006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:48.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.086+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 0x7f014006c5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f015c0acd10 tx=0x7f0150009040 comp rx=0 tx=0).stop 2023-08-18T20:45:48.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.086+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 msgr2=0x7f015c14c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:48.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.086+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0154002230 tx=0x7f015400a060 comp rx=0 tx=0).stop 2023-08-18T20:45:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 shutdown_connections 2023-08-18T20:45:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f014006a0e0 0x7f014006c5a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f015c14ed30 0x7f015c14c220 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f015c070950 0x7f015c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 --2- 172.21.15.121:0/3887499740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f015c14e950 0x7f015c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 >> 172.21.15.121:0/3887499740 conn(0x7f015c0c6b10 msgr2=0x7f015c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.087+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 shutdown_connections 2023-08-18T20:45:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.088+0000 7f0162e37700 1 -- 172.21.15.121:0/3887499740 wait complete. 2023-08-18T20:45:48.090 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs2_data' created 2023-08-18T20:45:48.110 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-08-18T20:45:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.236+0000 7f1cd3fec700 1 Processor -- start 2023-08-18T20:45:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.236+0000 7f1cd3fec700 1 -- start start 2023-08-18T20:45:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd3fec700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd3fec700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ccc157c10 0x7f1ccc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd3fec700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc0c21f0 con 0x7f1ccc06a510 2023-08-18T20:45:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd3fec700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0c2ba0 con 0x7f1ccc157c10 2023-08-18T20:45:48.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd3fec700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0c6300 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ccc157c10 0x7f1ccc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ccc157c10 0x7f1ccc1580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44044/0 (socket says 172.21.15.121:44044) 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 -- 172.21.15.121:0/1807911028 learned_addr learned my addr 172.21.15.121:0/1807911028 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd1587700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 -- 172.21.15.121:0/1807911028 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 msgr2=0x7f1ccc0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 -- 172.21.15.121:0/1807911028 >> v1:172.21.15.122:6789/0 conn(0x7f1ccc06a510 legacy=0x7f1ccc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 -- 172.21.15.121:0/1807911028 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0c5b20 con 0x7f1ccc157c10 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd1587700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd2589700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc157c10 0x7f1ccc1580a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009e50 tx=0x7f1cc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7cb018a029cb34 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd0d86700 1 -- 172.21.15.121:0/1807911028 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400e070 con 0x7f1ccc157c10 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd0d86700 1 -- 172.21.15.121:0/1807911028 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4003a20 con 0x7f1ccc157c10 2023-08-18T20:45:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.237+0000 7f1cd0d86700 1 -- 172.21.15.121:0/1807911028 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4003dd0 con 0x7f1ccc157c10 2023-08-18T20:45:48.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 -- 172.21.15.121:0/1807911028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc157c10 msgr2=0x7f1ccc1580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:48.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc157c10 0x7f1ccc1580a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009e50 tx=0x7f1cc400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:48.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 -- 172.21.15.121:0/1807911028 shutdown_connections 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc157c10 0x7f1ccc1580a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/1807911028 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 -- 172.21.15.121:0/1807911028 >> 172.21.15.121:0/1807911028 conn(0x7f1ccc0c6b10 msgr2=0x7f1ccc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 -- 172.21.15.121:0/1807911028 shutdown_connections 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.238+0000 7f1cd3fec700 1 -- 172.21.15.121:0/1807911028 wait complete. 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.239+0000 7f1cd3fec700 1 Processor -- start 2023-08-18T20:45:48.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.239+0000 7f1cd3fec700 1 -- start start 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 0x7f1ccc154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 0x7f1ccc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc154130 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1e9f60 con 0x7f1ccc06a510 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1ea240 con 0x7f1ccc157c10 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44050/0 (socket says 172.21.15.121:44050) 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 -- 172.21.15.121:0/3221730556 learned_addr learned my addr 172.21.15.121:0/3221730556 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1d88700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 0x7f1ccc154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd2589700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 0x7f1ccc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 -- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 msgr2=0x7f1ccc06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 0x7f1ccc06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 -- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 msgr2=0x7f1ccc154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 0x7f1ccc154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:48.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 -- 172.21.15.121:0/3221730556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009b30 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1d88700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 0x7f1ccc154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd2589700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 0x7f1ccc06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd1587700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c750 tx=0x7f1cbc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc011800 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc011960 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.240+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc1543f0 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.241+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc011cd0 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.241+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc0ab9e0 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.241+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc074730 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.242+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1cbc021350 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.242+0000 7f1cc27fc700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 0x7f1cb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.242+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f1cbc0887b0 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.242+0000 7f1cd1d88700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 0x7f1cb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:48.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.243+0000 7f1cd1d88700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 0x7f1cb006c5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:48.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.247+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1cbc057640 con 0x7f1ccc0c1cf0 2023-08-18T20:45:48.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:48.479+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f1ccc1ea400 con 0x7f1ccc0c1cf0 2023-08-18T20:45:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.094+0000 7f1cc27fc700 1 -- 172.21.15.121:0/3221730556 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 11 and data pool 12 v31) v1 ==== 177+0+0 (secure 0 0 0) 0x7f1ccc1ea400 con 0x7f1ccc0c1cf0 2023-08-18T20:45:49.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.111+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 msgr2=0x7f1cb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 0x7f1cb006c5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2023-08-18T20:45:49.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 msgr2=0x7f1ccc0ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c750 tx=0x7f1cbc00cb10 comp rx=0 tx=0).stop 2023-08-18T20:45:49.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 shutdown_connections 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ccc157c10 0x7f1ccc06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ccc06a510 0x7f1ccc154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1cb006a0e0 0x7f1cb006c5a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 --2- 172.21.15.121:0/3221730556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ccc0c1cf0 0x7f1ccc0ab4a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 >> 172.21.15.121:0/3221730556 conn(0x7f1ccc0c6b10 msgr2=0x7f1ccc0a8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 shutdown_connections 2023-08-18T20:45:49.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.112+0000 7f1cd3fec700 1 -- 172.21.15.121:0/3221730556 wait complete. 2023-08-18T20:45:49.115 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 11 and data pool 12 2023-08-18T20:45:49.128 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:49.201 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:45:49.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:45:49.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.251+0000 7fea29914700 1 Processor -- start 2023-08-18T20:45:49.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.251+0000 7fea29914700 1 -- start start 2023-08-18T20:45:49.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.252+0000 7fea29914700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fea2406b520 0x7fea24072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea29914700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea24152d30 0x7fea2414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea29914700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea2414fa00 0x7fea24155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea29914700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea24066380 con 0x7fea2406b520 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea29914700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea241531b0 con 0x7fea2414fa00 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea29914700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea24066080 con 0x7fea24152d30 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fea2406b520 0x7fea24072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fea2406b520 0x7fea24072360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44070/0 (socket says 172.21.15.121:44070) 2023-08-18T20:45:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 -- 172.21.15.121:0/3782733088 learned_addr learned my addr 172.21.15.121:0/3782733088 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea237fe700 1 --2- 172.21.15.121:0/3782733088 >> v2:172.21.15.122:3300/0 conn(0x7fea2414fa00 0x7fea24155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea227fc700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea24152d30 0x7fea2414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 -- 172.21.15.121:0/3782733088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea24152d30 msgr2=0x7fea2414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea24152d30 0x7fea2414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 -- 172.21.15.121:0/3782733088 >> v2:172.21.15.122:3300/0 conn(0x7fea2414fa00 msgr2=0x7fea24155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 --2- 172.21.15.121:0/3782733088 >> v2:172.21.15.122:3300/0 conn(0x7fea2414fa00 0x7fea24155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 -- 172.21.15.121:0/3782733088 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2406d0f0 con 0x7fea2406b520 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea22ffd700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2406b520 0x7fea24072360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea240c2c70 tx=0x7fea180134c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be91b14ba3d9f4a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea21ffb700 1 -- 172.21.15.121:0/3782733088 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18016070 con 0x7fea2406b520 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea21ffb700 1 -- 172.21.15.121:0/3782733088 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18013e00 con 0x7fea2406b520 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.253+0000 7fea21ffb700 1 -- 172.21.15.121:0/3782733088 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180112f0 con 0x7fea2406b520 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 -- 172.21.15.121:0/3782733088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2406b520 msgr2=0x7fea24072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2406b520 0x7fea24072360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea240c2c70 tx=0x7fea180134c0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 -- 172.21.15.121:0/3782733088 shutdown_connections 2023-08-18T20:45:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 --2- 172.21.15.121:0/3782733088 >> v2:172.21.15.122:3300/0 conn(0x7fea2414fa00 0x7fea24155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2406b520 0x7fea24072360 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 --2- 172.21.15.121:0/3782733088 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea24152d30 0x7fea2414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 -- 172.21.15.121:0/3782733088 >> 172.21.15.121:0/3782733088 conn(0x7fea240c2ca0 msgr2=0x7fea240c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 -- 172.21.15.121:0/3782733088 shutdown_connections 2023-08-18T20:45:49.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.254+0000 7fea29914700 1 -- 172.21.15.121:0/3782733088 wait complete. 2023-08-18T20:45:49.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.255+0000 7fea29914700 1 Processor -- start 2023-08-18T20:45:49.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.255+0000 7fea29914700 1 -- start start 2023-08-18T20:45:49.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea2406b520 0x7fea240c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea2414fa00 0x7fea24146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea24071030 con 0x7fea24152d30 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea24070b40 con 0x7fea2414fa00 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea29914700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241e9c20 con 0x7fea2406b520 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44080/0 (socket says 172.21.15.121:44080) 2023-08-18T20:45:49.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 -- 172.21.15.121:0/959529470 learned_addr learned my addr 172.21.15.121:0/959529470 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea22ffd700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea2406b520 0x7fea240c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea227fc700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea2414fa00 0x7fea24146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 -- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea2406b520 msgr2=0x7fea240c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea2406b520 0x7fea240c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 -- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea2414fa00 msgr2=0x7fea24146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea2414fa00 0x7fea24146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.256+0000 7fea237fe700 1 -- 172.21.15.121:0/959529470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18011df0 con 0x7fea24152d30 2023-08-18T20:45:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea237fe700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fea1c007e40 tx=0x7fea1c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00ed30 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c014420 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea24070d50 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0147d0 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.257+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea24151bb0 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.258+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24073ac0 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.258+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea1c014930 con 0x7fea24152d30 2023-08-18T20:45:49.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.258+0000 7fea0bfff700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 0x7fea1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.258+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fea1c088f60 con 0x7fea24152d30 2023-08-18T20:45:49.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.258+0000 7fea22ffd700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 0x7fea1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.259+0000 7fea22ffd700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 0x7fea1006c5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea18013500 tx=0x7fea18011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.263+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fea1c0542f0 con 0x7fea24152d30 2023-08-18T20:45:49.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.453+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea240c2340 con 0x7fea24152d30 2023-08-18T20:45:49.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.455+0000 7fea0bfff700 1 -- 172.21.15.121:0/959529470 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+22014 (secure 0 0 0) 0x7fea1c057910 con 0x7fea24152d30 2023-08-18T20:45:49.456 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:49.456 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":55,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:48.481264+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:45:47.019972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:45:47.444147+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:49.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 msgr2=0x7fea1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 0x7fea1006c5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea18013500 tx=0x7fea18011000 comp rx=0 tx=0).stop 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 msgr2=0x7fea241e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fea1c007e40 tx=0x7fea1c00e3c0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 shutdown_connections 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fea1006a0e0 0x7fea1006c5a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea24152d30 0x7fea241e8f70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea2406b520 0x7fea240c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 --2- 172.21.15.121:0/959529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea2414fa00 0x7fea24146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 >> 172.21.15.121:0/959529470 conn(0x7fea240c2ca0 msgr2=0x7fea240c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 shutdown_connections 2023-08-18T20:45:49.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.457+0000 7fea29914700 1 -- 172.21.15.121:0/959529470 wait complete. 2023-08-18T20:45:49.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:49.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 Processor -- start 2023-08-18T20:45:49.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 -- start start 2023-08-18T20:45:49.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30b41518e0 0x7f30b4066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 0x7f30b40bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b406cc30 con 0x7f30b40c1030 2023-08-18T20:45:49.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40c0b80 con 0x7f30b41518e0 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.630+0000 7f30bb0fe700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b4155260 con 0x7f30b40bf550 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30b41518e0 0x7f30b4066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30b41518e0 0x7f30b4066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44084/0 (socket says 172.21.15.121:44084) 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 -- 172.21.15.121:0/3289263199 learned_addr learned my addr 172.21.15.121:0/3289263199 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b3fff700 1 --1- 172.21.15.121:0/3289263199 >> v1:172.21.15.121:6789/0 conn(0x7f30b40c1030 0x7f30b406b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50666/0 (socket says 172.21.15.121:50666) 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b969b700 1 --2- 172.21.15.121:0/3289263199 >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 0x7f30b40bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 -- 172.21.15.121:0/3289263199 >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 msgr2=0x7f30b40bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:49.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 --2- 172.21.15.121:0/3289263199 >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 0x7f30b40bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b37fe700 1 -- 172.21.15.121:0/3289263199 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654981577 0 0) 0x7f30b406cc30 con 0x7f30b40c1030 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 -- 172.21.15.121:0/3289263199 >> v1:172.21.15.121:6789/0 conn(0x7f30b40c1030 legacy=0x7f30b406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 -- 172.21.15.121:0/3289263199 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b406ce80 con 0x7f30b41518e0 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b969b700 1 --2- 172.21.15.121:0/3289263199 >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 0x7f30b40bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b8e9a700 1 --2- 172.21.15.121:0/3289263199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b4066340 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30b4154420 tx=0x7f30a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c13342ef17dc47 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b37fe700 1 -- 172.21.15.121:0/3289263199 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a800b870 con 0x7f30b41518e0 2023-08-18T20:45:49.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b37fe700 1 -- 172.21.15.121:0/3289263199 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a800b9d0 con 0x7f30b41518e0 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.631+0000 7f30b37fe700 1 -- 172.21.15.121:0/3289263199 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a800bd60 con 0x7f30b41518e0 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 -- 172.21.15.121:0/3289263199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 msgr2=0x7f30b4066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/3289263199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b4066340 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30b4154420 tx=0x7f30a8009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 -- 172.21.15.121:0/3289263199 shutdown_connections 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/3289263199 >> v2:172.21.15.122:3300/0 conn(0x7f30b40bf550 0x7f30b40bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/3289263199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b4066340 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 -- 172.21.15.121:0/3289263199 >> 172.21.15.121:0/3289263199 conn(0x7f30b40c2ca0 msgr2=0x7f30b40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 -- 172.21.15.121:0/3289263199 shutdown_connections 2023-08-18T20:45:49.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.632+0000 7f30bb0fe700 1 -- 172.21.15.121:0/3289263199 wait complete. 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.633+0000 7f30bb0fe700 1 Processor -- start 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.633+0000 7f30bb0fe700 1 -- start start 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30b40bf550 0x7f30b4158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30b40c1030 0x7f30b40aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4155f80 con 0x7f30b41518e0 2023-08-18T20:45:49.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41ed9e0 con 0x7f30b40bf550 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b414daa0 con 0x7f30b40c1030 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44092/0 (socket says 172.21.15.121:44092) 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 -- 172.21.15.121:0/472055815 learned_addr learned my addr 172.21.15.121:0/472055815 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b8e9a700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30b40bf550 0x7f30b4158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b3fff700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30b40c1030 0x7f30b40aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 -- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30b40c1030 msgr2=0x7f30b40aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30b40c1030 0x7f30b40aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 -- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30b40bf550 msgr2=0x7f30b4158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30b40bf550 0x7f30b4158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 -- 172.21.15.121:0/472055815 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8009550 con 0x7f30b41518e0 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b969b700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00cef0 tx=0x7f30ac00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00ad00 con 0x7f30b41518e0 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00ae60 con 0x7f30b41518e0 2023-08-18T20:45:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b4155c30 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac015680 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.634+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b40aa6f0 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.635+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b406e460 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.636+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f30ac0157e0 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.636+0000 7f30b17fa700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 0x7f309806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.636+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f30ac088d40 con 0x7f30b41518e0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.636+0000 7f30b8e9a700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 0x7f309806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.637+0000 7f30b8e9a700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 0x7f309806c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f30a8014040 tx=0x7f30a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.641+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f30ac0540d0 con 0x7f30b41518e0 2023-08-18T20:45:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.832+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30b406d140 con 0x7f30b41518e0 2023-08-18T20:45:49.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.834+0000 7f30b17fa700 1 -- 172.21.15.121:0/472055815 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+22014 (secure 0 0 0) 0x7f30b406d140 con 0x7f30b41518e0 2023-08-18T20:45:49.836 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:49.836 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":55,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:48.481264+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:45:47.019972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:45:47.444147+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:49.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 msgr2=0x7f309806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 0x7f309806c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f30a8014040 tx=0x7f30a8008030 comp rx=0 tx=0).stop 2023-08-18T20:45:49.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 msgr2=0x7f30b414beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00cef0 tx=0x7f30ac00cf20 comp rx=0 tx=0).stop 2023-08-18T20:45:49.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 shutdown_connections 2023-08-18T20:45:49.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f309806a0e0 0x7f309806c5a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b41518e0 0x7f30b414beb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30b40bf550 0x7f30b4158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 --2- 172.21.15.121:0/472055815 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30b40c1030 0x7f30b40aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 >> 172.21.15.121:0/472055815 conn(0x7f30b40c2ca0 msgr2=0x7f30b406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 shutdown_connections 2023-08-18T20:45:49.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.836+0000 7f30bb0fe700 1 -- 172.21.15.121:0/472055815 wait complete. 2023-08-18T20:45:49.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-08-18T20:45:49.941 INFO:tasks.ceph.mds.a.smithi121.stderr:2023-08-18T20:45:49.940+0000 7f6e8898b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-18T20:45:49.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.973+0000 7f65d4b8c700 1 Processor -- start 2023-08-18T20:45:49.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.973+0000 7f65d4b8c700 1 -- start start 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65d4b8c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65d4b8c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65d006a7e0 0x7f65d00c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65d4b8c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d00c4f40 con 0x7f65d00a6290 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65d4b8c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d00c6120 con 0x7f65d006a7e0 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65d4b8c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01551f0 con 0x7f65d00c0c50 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65d006a7e0 0x7f65d00c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65d006a7e0 0x7f65d00c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44098/0 (socket says 172.21.15.121:44098) 2023-08-18T20:45:49.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 -- 172.21.15.121:0/2901133721 learned_addr learned my addr 172.21.15.121:0/2901133721 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65ce59c700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 -- 172.21.15.121:0/2901133721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 msgr2=0x7f65d006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:49.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 -- 172.21.15.121:0/2901133721 >> v1:172.21.15.122:6789/0 conn(0x7f65d00a6290 legacy=0x7f65d0071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 -- 172.21.15.121:0/2901133721 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00c63a0 con 0x7f65d006a7e0 2023-08-18T20:45:49.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cdd9b700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d006a7e0 0x7f65d00c53d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098f0 tx=0x7f65c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3f3f5733b2d4d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cd59a700 1 -- 172.21.15.121:0/2901133721 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011830 con 0x7f65d006a7e0 2023-08-18T20:45:49.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cd59a700 1 -- 172.21.15.121:0/2901133721 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4011990 con 0x7f65d006a7e0 2023-08-18T20:45:49.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.974+0000 7f65cd59a700 1 -- 172.21.15.121:0/2901133721 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011d20 con 0x7f65d006a7e0 2023-08-18T20:45:49.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 -- 172.21.15.121:0/2901133721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d006a7e0 msgr2=0x7f65d00c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d006a7e0 0x7f65d00c53d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098f0 tx=0x7f65c4009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:49.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 -- 172.21.15.121:0/2901133721 shutdown_connections 2023-08-18T20:45:49.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/2901133721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d006a7e0 0x7f65d00c53d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 -- 172.21.15.121:0/2901133721 >> 172.21.15.121:0/2901133721 conn(0x7f65d00c6b10 msgr2=0x7f65d00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:49.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 -- 172.21.15.121:0/2901133721 shutdown_connections 2023-08-18T20:45:49.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.975+0000 7f65d4b8c700 1 -- 172.21.15.121:0/2901133721 wait complete. 2023-08-18T20:45:49.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.976+0000 7f65d4b8c700 1 Processor -- start 2023-08-18T20:45:49.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.976+0000 7f65d4b8c700 1 -- start start 2023-08-18T20:45:49.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65d006a7e0 0x7f65d00abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d01ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01565c0 con 0x7f65d00a6290 2023-08-18T20:45:49.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01570d0 con 0x7f65d006a7e0 2023-08-18T20:45:49.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65d4b8c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01573b0 con 0x7f65d00c0c50 2023-08-18T20:45:49.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65cdd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65cdd9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44106/0 (socket says 172.21.15.121:44106) 2023-08-18T20:45:49.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65cdd9b700 1 -- 172.21.15.121:0/3694240246 learned_addr learned my addr 172.21.15.121:0/3694240246 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:49.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65ce59c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65d006a7e0 0x7f65d00abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.977+0000 7f65ced9d700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d01ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 -- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 msgr2=0x7f65d01ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d01ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 -- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65d006a7e0 msgr2=0x7f65d00abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65d006a7e0 0x7f65d00abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 -- 172.21.15.121:0/3694240246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009550 con 0x7f65d00a6290 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65cdd9b700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009c40 tx=0x7f65c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4004590 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c401e070 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d0157690 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40038e0 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.978+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d00c1390 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.979+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d00c1520 con 0x7f65d00a6290 2023-08-18T20:45:49.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.979+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65c4003a40 con 0x7f65d00a6290 2023-08-18T20:45:49.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.979+0000 7f65beffd700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 0x7f65b006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:49.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.980+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f65c40896e0 con 0x7f65d00a6290 2023-08-18T20:45:49.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.980+0000 7f65ce59c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 0x7f65b006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:49.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.980+0000 7f65ce59c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 0x7f65b006c570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009be0 tx=0x7f65c0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:49.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:49.984+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f65c4054b00 con 0x7f65d00a6290 2023-08-18T20:45:50.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:50.223+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65d0157e90 con 0x7f65d00a6290 2023-08-18T20:45:51.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.098+0000 7f65beffd700 1 -- 172.21.15.121:0/3694240246 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 119+0+0 (secure 0 0 0) 0x7f65c4058120 con 0x7f65d00a6290 2023-08-18T20:45:51.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.100+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 msgr2=0x7f65b006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.100+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 0x7f65b006c570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009be0 tx=0x7f65c0009210 comp rx=0 tx=0).stop 2023-08-18T20:45:51.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.100+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 msgr2=0x7f65d00ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.100+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009c40 tx=0x7f65c4004750 comp rx=0 tx=0).stop 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 shutdown_connections 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65d00c0c50 0x7f65d01ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65d006a7e0 0x7f65d00abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f65b006a0b0 0x7f65b006c570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 --2- 172.21.15.121:0/3694240246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d00a6290 0x7f65d00ac2d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 >> 172.21.15.121:0/3694240246 conn(0x7f65d00c6b10 msgr2=0x7f65d00c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:51.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 shutdown_connections 2023-08-18T20:45:51.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.101+0000 7f65d4b8c700 1 -- 172.21.15.121:0/3694240246 wait complete. 2023-08-18T20:45:51.114 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-18T20:45:51.115 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-08-18T20:45:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.238+0000 7f1e75a0f700 1 Processor -- start 2023-08-18T20:45:51.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.238+0000 7f1e75a0f700 1 -- start start 2023-08-18T20:45:51.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e75a0f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1e700c7ca0 0x7f1e701543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e75a0f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e700ca4a0 con 0x7f1e70154900 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e75a0f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7006c0f0 con 0x7f1e70151b10 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e75a0f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e70158540 con 0x7f1e700c7ca0 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1e70154900 0x7f1e7015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50696/0 (socket says 172.21.15.121:50696) 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/946920992 learned_addr learned my addr 172.21.15.121:0/946920992 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:51.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6e7fc700 1 --2- 172.21.15.121:0/946920992 >> v2:172.21.15.122:3300/0 conn(0x7f1e700c7ca0 0x7f1e701543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59765452 0 0) 0x7f1e700ca4a0 con 0x7f1e70154900 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e580035b0 con 0x7f1e70154900 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338816000 0 0) 0x7f1e580035b0 con 0x7f1e70154900 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 >> v2:172.21.15.122:3300/0 conn(0x7f1e700c7ca0 msgr2=0x7f1e701543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 --2- 172.21.15.121:0/946920992 >> v2:172.21.15.122:3300/0 conn(0x7f1e700c7ca0 0x7f1e701543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 >> v1:172.21.15.122:6789/0 conn(0x7f1e70151b10 legacy=0x7f1e700c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70158820 con 0x7f1e70154900 2023-08-18T20:45:51.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f1e680019f0 con 0x7f1e70154900 2023-08-18T20:45:51.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 >> v1:172.21.15.121:6789/0 conn(0x7f1e70154900 legacy=0x7f1e7015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 0x7f1e58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e58004850 0x7f1e58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58005210 0x7f1e5800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70158540 con 0x7f1e58003a00 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800c1b0 con 0x7f1e58004850 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.239+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800c370 con 0x7f1e58005210 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 0x7f1e58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6e7fc700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e58004850 0x7f1e58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6f7fe700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58005210 0x7f1e5800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 -- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58005210 msgr2=0x7f1e5800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:51.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58005210 0x7f1e5800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 -- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e58004850 msgr2=0x7f1e58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:51.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e58004850 0x7f1e58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 -- 172.21.15.121:0/946920992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e580035b0 con 0x7f1e58003a00 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/946920992 reap_dead start 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6effd700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 0x7f1e58003e20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1e640017c0 tx=0x7f1e58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2df51d75b7267ff server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640052d0 con 0x7f1e58003a00 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64005430 con 0x7f1e58003a00 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e6dffb700 1 -- 172.21.15.121:0/946920992 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640038c0 con 0x7f1e58003a00 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e75a0f700 1 -- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 msgr2=0x7f1e58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.240+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 0x7f1e58003e20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1e640017c0 tx=0x7f1e58005880 comp rx=0 tx=0).stop 2023-08-18T20:45:51.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.241+0000 7f1e75a0f700 1 -- 172.21.15.121:0/946920992 shutdown_connections 2023-08-18T20:45:51.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.241+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/946920992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e58003a00 0x7f1e58003e20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.241+0000 7f1e75a0f700 1 -- 172.21.15.121:0/946920992 >> 172.21.15.121:0/946920992 conn(0x7f1e70071bb0 msgr2=0x7f1e70071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:51.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.241+0000 7f1e75a0f700 1 -- 172.21.15.121:0/946920992 shutdown_connections 2023-08-18T20:45:51.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.241+0000 7f1e75a0f700 1 -- 172.21.15.121:0/946920992 wait complete. 2023-08-18T20:45:51.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 Processor -- start 2023-08-18T20:45:51.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 -- start start 2023-08-18T20:45:51.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58003a00 0x7f1e701eab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e70153e70 0x7f1e701ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701528b0 con 0x7f1e7014a6e0 2023-08-18T20:45:51.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701522d0 con 0x7f1e70153e70 2023-08-18T20:45:51.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.242+0000 7f1e75a0f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701edbb0 con 0x7f1e58003a00 2023-08-18T20:45:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44126/0 (socket says 172.21.15.121:44126) 2023-08-18T20:45:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/3645025488 learned_addr learned my addr 172.21.15.121:0/3645025488 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:51.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6e7fc700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e70153e70 0x7f1e701ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6effd700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58003a00 0x7f1e701eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58003a00 msgr2=0x7f1e701eab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58003a00 0x7f1e701eab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e70153e70 msgr2=0x7f1e701ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e70153e70 0x7f1e701ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 -- 172.21.15.121:0/3645025488 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70154370 con 0x7f1e7014a6e0 2023-08-18T20:45:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e6f7fe700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c66b0 tx=0x7f1e68007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800eaf0 con 0x7f1e7014a6e0 2023-08-18T20:45:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800ec50 con 0x7f1e7014a6e0 2023-08-18T20:45:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e70152540 con 0x7f1e7014a6e0 2023-08-18T20:45:51.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68013420 con 0x7f1e7014a6e0 2023-08-18T20:45:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.243+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e70154650 con 0x7f1e7014a6e0 2023-08-18T20:45:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.244+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e70074730 con 0x7f1e7014a6e0 2023-08-18T20:45:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.245+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e68013580 con 0x7f1e7014a6e0 2023-08-18T20:45:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.245+0000 7f1e57fff700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.245+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1e68088d00 con 0x7f1e7014a6e0 2023-08-18T20:45:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.245+0000 7f1e6effd700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.245+0000 7f1e6effd700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1e64000c00 tx=0x7f1e64009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.249+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1e68054120 con 0x7f1e7014a6e0 2023-08-18T20:45:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:51.481+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1e700c5bd0 con 0x7f1e7014a6e0 2023-08-18T20:45:52.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.100+0000 7f1e57fff700 1 -- 172.21.15.121:0/3645025488 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1e68057740 con 0x7f1e7014a6e0 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 msgr2=0x7f1e5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1e64000c00 tx=0x7f1e64009030 comp rx=0 tx=0).stop 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 msgr2=0x7f1e70152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c66b0 tx=0x7f1e68007c90 comp rx=0 tx=0).stop 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 shutdown_connections 2023-08-18T20:45:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e7014a6e0 0x7f1e70152d40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e58003a00 0x7f1e701eab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 --2- 172.21.15.121:0/3645025488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e70153e70 0x7f1e701ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 >> 172.21.15.121:0/3645025488 conn(0x7f1e70071bb0 msgr2=0x7f1e700c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 shutdown_connections 2023-08-18T20:45:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.103+0000 7f1e75a0f700 1 -- 172.21.15.121:0/3645025488 wait complete. 2023-08-18T20:45:52.118 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-08-18T20:45:52.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-18T20:45:52.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.244+0000 7fdd01b40700 1 Processor -- start 2023-08-18T20:45:52.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 -- start start 2023-08-18T20:45:52.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc0c4f40 con 0x7fdcfc06a7e0 2023-08-18T20:45:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0c6120 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdd01b40700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1551f0 con 0x7fdcfc0c0c50 2023-08-18T20:45:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdcfbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdcfbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44132/0 (socket says 172.21.15.121:44132) 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdcfaffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdcfc06a7e0 0x7fdcfc0c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50712/0 (socket says 172.21.15.121:50712) 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.245+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1114646736 learned_addr learned my addr 172.21.15.121:0/1114646736 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfb7fe700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1114646736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 msgr2=0x7fdcfc06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfbfff700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1114646736 >> v1:172.21.15.121:6789/0 conn(0x7fdcfc06a7e0 legacy=0x7fdcfc0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1114646736 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0c63a0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfa7fc700 1 -- 172.21.15.121:0/1114646736 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672144132 0 0) 0x7fdcfc0c4f40 con 0x7fdcfc06a7e0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfbfff700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009e50 tx=0x7fdcf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294d61cf896c2225 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfa7fc700 1 -- 172.21.15.121:0/1114646736 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400e070 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfa7fc700 1 -- 172.21.15.121:0/1114646736 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf400b9c0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdcfa7fc700 1 -- 172.21.15.121:0/1114646736 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400bd70 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 -- 172.21.15.121:0/1114646736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 msgr2=0x7fdcfc071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009e50 tx=0x7fdcf400b330 comp rx=0 tx=0).stop 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 -- 172.21.15.121:0/1114646736 shutdown_connections 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc071b80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1114646736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.246+0000 7fdd01b40700 1 -- 172.21.15.121:0/1114646736 >> 172.21.15.121:0/1114646736 conn(0x7fdcfc0c6b10 msgr2=0x7fdcfc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.247+0000 7fdd01b40700 1 -- 172.21.15.121:0/1114646736 shutdown_connections 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.247+0000 7fdd01b40700 1 -- 172.21.15.121:0/1114646736 wait complete. 2023-08-18T20:45:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 Processor -- start 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 -- start start 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcfc06a7e0 0x7fdcfc14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc1ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc151e00 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc14fc20 con 0x7fdcfc06a7e0 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.248+0000 7fdd01b40700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1ec7a0 con 0x7fdcfc0c0c50 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44138/0 (socket says 172.21.15.121:44138) 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1096177950 learned_addr learned my addr 172.21.15.121:0/1096177950 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfaffd700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc1ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfb7fe700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcfc06a7e0 0x7fdcfc14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 msgr2=0x7fdcfc1ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc1ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcfc06a7e0 msgr2=0x7fdcfc14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcfc06a7e0 0x7fdcfc14e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 -- 172.21.15.121:0/1096177950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4009b30 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcfbfff700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b730 tx=0x7fdcf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40048b0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40099b0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf401c650 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc06e510 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.249+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc14dc80 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.250+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc074730 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.251+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdcf401c7b0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.251+0000 7fdcf3fff700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 0x7fdcdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.251+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fdcf408a0a0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.251+0000 7fdcfb7fe700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 0x7fdcdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.251+0000 7fdcfb7fe700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 0x7fdcdc06c5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006b20 tx=0x7fdcec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.255+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdcf40554c0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.488+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcfc0c4a10 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.488+0000 7fdcf3fff700 1 -- 172.21.15.121:0/1096177950 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+6066 (secure 0 0 0) 0x7fdcf4058ae0 con 0x7fdcfc0c5ae0 2023-08-18T20:45:52.489 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:52.489 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6834/1055475719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1055475719},{"type":"v1","addr":"172.21.15.122:6834","nonce":1055475719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1049001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6833","nonce":1049001574},{"type":"v1","addr":"172.21.15.122:6835","nonce":1049001574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:45:35.359510+0000","modified":"2023-08-18T20:45:38.985103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5844":{"gid":5844,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/891706193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":891706193},{"type":"v1","addr":"172.21.15.121:6837","nonce":891706193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-18T20:45:48.481587+0000","modified":"2023-08-18T20:45:52.098318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6836/2177141850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2177141850},{"type":"v1","addr":"172.21.15.121:6836","nonce":2177141850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-18T20:45:52.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 msgr2=0x7fdcdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 0x7fdcdc06c5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006b20 tx=0x7fdcec008040 comp rx=0 tx=0).stop 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 msgr2=0x7fdcfc0ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b730 tx=0x7fdcf4004ad0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 shutdown_connections 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fdcdc06a0e0 0x7fdcdc06c5a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcfc0c5ae0 0x7fdcfc0ac0f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcfc06a7e0 0x7fdcfc14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 --2- 172.21.15.121:0/1096177950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcfc0c0c50 0x7fdcfc1ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 >> 172.21.15.121:0/1096177950 conn(0x7fdcfc0c6b10 msgr2=0x7fdcfc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 shutdown_connections 2023-08-18T20:45:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.490+0000 7fdd01b40700 1 -- 172.21.15.121:0/1096177950 wait complete. 2023-08-18T20:45:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 34 2023-08-18T20:45:52.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.621+0000 7fac9a886700 1 Processor -- start 2023-08-18T20:45:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.621+0000 7fac9a886700 1 -- start start 2023-08-18T20:45:52.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac9a886700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414e950 0x7fac940c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac9a886700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac94070950 0x7fac940c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac9a886700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940c2260 con 0x7fac9414ed30 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac9a886700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac940a6630 con 0x7fac94070950 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac9a886700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac94151d90 con 0x7fac9414e950 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac98e23700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac94070950 0x7fac940c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac98e23700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac94070950 0x7fac940c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44144/0 (socket says 172.21.15.121:44144) 2023-08-18T20:45:52.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.622+0000 7fac98e23700 1 -- 172.21.15.121:0/132095323 learned_addr learned my addr 172.21.15.121:0/132095323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac93fff700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414e950 0x7fac940c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac98e23700 1 -- 172.21.15.121:0/132095323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414e950 msgr2=0x7fac940c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac98e23700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414e950 0x7fac940c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac98e23700 1 -- 172.21.15.121:0/132095323 >> v1:172.21.15.122:6789/0 conn(0x7fac9414ed30 legacy=0x7fac940c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac98e23700 1 -- 172.21.15.121:0/132095323 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac94152070 con 0x7fac94070950 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac98e23700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac94070950 0x7fac940c4b10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009e50 tx=0x7fac8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7339b635d72a4f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac92ffd700 1 -- 172.21.15.121:0/132095323 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00e070 con 0x7fac94070950 2023-08-18T20:45:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac92ffd700 1 -- 172.21.15.121:0/132095323 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c00b9c0 con 0x7fac94070950 2023-08-18T20:45:52.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac92ffd700 1 -- 172.21.15.121:0/132095323 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00bd70 con 0x7fac94070950 2023-08-18T20:45:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac9a886700 1 -- 172.21.15.121:0/132095323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac94070950 msgr2=0x7fac940c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.623+0000 7fac9a886700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac94070950 0x7fac940c4b10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009e50 tx=0x7fac8c00b330 comp rx=0 tx=0).stop 2023-08-18T20:45:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 -- 172.21.15.121:0/132095323 shutdown_connections 2023-08-18T20:45:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac94070950 0x7fac940c4b10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 --2- 172.21.15.121:0/132095323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414e950 0x7fac940c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 -- 172.21.15.121:0/132095323 >> 172.21.15.121:0/132095323 conn(0x7fac940c6b10 msgr2=0x7fac940c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 -- 172.21.15.121:0/132095323 shutdown_connections 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.624+0000 7fac9a886700 1 -- 172.21.15.121:0/132095323 wait complete. 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.625+0000 7fac9a886700 1 Processor -- start 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.625+0000 7fac9a886700 1 -- start start 2023-08-18T20:45:52.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.625+0000 7fac9a886700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac94070950 0x7fac9414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.625+0000 7fac9a886700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414ed30 0x7fac940a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941d97a0 con 0x7fac9414e950 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941d9fd0 con 0x7fac94070950 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac941d9d60 con 0x7fac9414ed30 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44150/0 (socket says 172.21.15.121:44150) 2023-08-18T20:45:52.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 -- 172.21.15.121:0/3975071377 learned_addr learned my addr 172.21.15.121:0/3975071377 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac93fff700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac94070950 0x7fac9414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac98e23700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414ed30 0x7fac940a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 -- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414ed30 msgr2=0x7fac940a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414ed30 0x7fac940a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 -- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac94070950 msgr2=0x7fac9414a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac94070950 0x7fac9414a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 -- 172.21.15.121:0/3975071377 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c009b30 con 0x7fac9414e950 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac937fe700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c510 tx=0x7fac8400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400cea0 con 0x7fac9414e950 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840052d0 con 0x7fac9414e950 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9414a5c0 con 0x7fac9414e950 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84003680 con 0x7fac9414e950 2023-08-18T20:45:52.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.626+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9414c410 con 0x7fac9414e950 2023-08-18T20:45:52.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.627+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac940a71a0 con 0x7fac9414e950 2023-08-18T20:45:52.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.628+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac840037e0 con 0x7fac9414e950 2023-08-18T20:45:52.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.628+0000 7fac90ff9700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 0x7fac8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.628+0000 7fac93fff700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 0x7fac8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.628+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fac84087b80 con 0x7fac9414e950 2023-08-18T20:45:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.629+0000 7fac93fff700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 0x7fac8006c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac88006b20 tx=0x7fac88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.633+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fac940a71a0 con 0x7fac9414e950 2023-08-18T20:45:52.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.825+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac940a71a0 con 0x7fac9414e950 2023-08-18T20:45:52.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.827+0000 7fac90ff9700 1 -- 172.21.15.121:0/3975071377 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+22001 (secure 0 0 0) 0x7fac940a71a0 con 0x7fac9414e950 2023-08-18T20:45:52.828 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:52.828 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":56,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:50.080280+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:45:47.019972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:45:47.444147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:52.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 msgr2=0x7fac8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 0x7fac8006c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac88006b20 tx=0x7fac88008040 comp rx=0 tx=0).stop 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 msgr2=0x7fac9414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c510 tx=0x7fac8400c820 comp rx=0 tx=0).stop 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 shutdown_connections 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fac9414ed30 0x7fac940a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac94070950 0x7fac9414a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fac8006a0e0 0x7fac8006c5a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 --2- 172.21.15.121:0/3975071377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac9414e950 0x7fac9414bed0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 >> 172.21.15.121:0/3975071377 conn(0x7fac940c6b10 msgr2=0x7fac940c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 shutdown_connections 2023-08-18T20:45:52.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.829+0000 7fac9a886700 1 -- 172.21.15.121:0/3975071377 wait complete. 2023-08-18T20:45:52.842 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-18T20:45:52.842 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:45:52.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 Processor -- start 2023-08-18T20:45:52.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 -- start start 2023-08-18T20:45:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 0x7f7cac0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7cac0c4c60 0x7f7cac154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0ca4a0 con 0x7f7cac0c7ca0 2023-08-18T20:45:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac06c0f0 con 0x7f7cac0c4c60 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7cb1872700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac158540 con 0x7f7cac151b10 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7caa7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7cac0c7ca0 0x7f7cac1543c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50738/0 (socket says 172.21.15.121:50738) 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.962+0000 7f7caa7fc700 1 -- 172.21.15.121:0/923045349 learned_addr learned my addr 172.21.15.121:0/923045349 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 --2- 172.21.15.121:0/923045349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 0x7f7cac0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7cab7fe700 1 --2- 172.21.15.121:0/923045349 >> v2:172.21.15.122:3300/0 conn(0x7f7cac0c4c60 0x7f7cac154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7ca9ffb700 1 -- 172.21.15.121:0/923045349 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996199355 0 0) 0x7f7cac0ca4a0 con 0x7f7cac0c7ca0 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7ca9ffb700 1 -- 172.21.15.121:0/923045349 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c980035b0 con 0x7f7cac0c7ca0 2023-08-18T20:45:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 -- 172.21.15.121:0/923045349 >> v2:172.21.15.122:3300/0 conn(0x7f7cac0c4c60 msgr2=0x7f7cac154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 --2- 172.21.15.121:0/923045349 >> v2:172.21.15.122:3300/0 conn(0x7f7cac0c4c60 0x7f7cac154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 -- 172.21.15.121:0/923045349 >> v1:172.21.15.121:6789/0 conn(0x7f7cac0c7ca0 legacy=0x7f7cac1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 -- 172.21.15.121:0/923045349 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac158820 con 0x7f7cac151b10 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7caaffd700 1 --2- 172.21.15.121:0/923045349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 0x7f7cac0c4720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009840 tx=0x7f7ca4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd07e102ecb0ae server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7ca9ffb700 1 -- 172.21.15.121:0/923045349 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4011830 con 0x7f7cac151b10 2023-08-18T20:45:52.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7ca9ffb700 1 -- 172.21.15.121:0/923045349 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4011990 con 0x7f7cac151b10 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.963+0000 7f7ca9ffb700 1 -- 172.21.15.121:0/923045349 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4011d20 con 0x7f7cac151b10 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 -- 172.21.15.121:0/923045349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 msgr2=0x7f7cac0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 --2- 172.21.15.121:0/923045349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 0x7f7cac0c4720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009840 tx=0x7f7ca4009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 -- 172.21.15.121:0/923045349 shutdown_connections 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 --2- 172.21.15.121:0/923045349 >> v2:172.21.15.122:3300/0 conn(0x7f7cac0c4c60 0x7f7cac154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 --2- 172.21.15.121:0/923045349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac151b10 0x7f7cac0c4720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 -- 172.21.15.121:0/923045349 >> 172.21.15.121:0/923045349 conn(0x7f7cac071bb0 msgr2=0x7f7cac071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:52.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 -- 172.21.15.121:0/923045349 shutdown_connections 2023-08-18T20:45:52.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.964+0000 7f7cb1872700 1 -- 172.21.15.121:0/923045349 wait complete. 2023-08-18T20:45:52.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.965+0000 7f7cb1872700 1 Processor -- start 2023-08-18T20:45:52.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 -- start start 2023-08-18T20:45:52.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac0c4c60 0x7f7cac153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 0x7f7cac14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac154180 con 0x7f7cac151b10 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0a97a0 con 0x7f7cac0c7ca0 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.966+0000 7f7cb1872700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0c1080 con 0x7f7cac0c4c60 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44162/0 (socket says 172.21.15.121:44162) 2023-08-18T20:45:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 -- 172.21.15.121:0/3861476170 learned_addr learned my addr 172.21.15.121:0/3861476170 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7caa7fc700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 0x7f7cac14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7caaffd700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac0c4c60 0x7f7cac153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 -- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac0c4c60 msgr2=0x7f7cac153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac0c4c60 0x7f7cac153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 -- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 msgr2=0x7f7cac14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 0x7f7cac14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 -- 172.21.15.121:0/3861476170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40094a0 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7caa7fc700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 0x7f7cac14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cab7fe700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009e30 tx=0x7f7c9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c009ca0 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c00f040 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac0ac570 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c014480 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.967+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac0c3b60 con 0x7f7cac151b10 2023-08-18T20:45:52.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.968+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac0ca910 con 0x7f7cac151b10 2023-08-18T20:45:52.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.968+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c9c0145e0 con 0x7f7cac151b10 2023-08-18T20:45:52.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.969+0000 7f7ca3fff700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 0x7f7c8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:52.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.969+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7c9c089500 con 0x7f7cac151b10 2023-08-18T20:45:52.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.969+0000 7f7caaffd700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 0x7f7c8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:52.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.969+0000 7f7caaffd700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 0x7f7c8c06c5a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40090b0 tx=0x7f7ca4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:52.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:52.973+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7cac0ca910 con 0x7f7cac151b10 2023-08-18T20:45:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.162+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cac0ca130 con 0x7f7c8c06a0e0 2023-08-18T20:45:53.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.176+0000 7f7ca3fff700 1 -- 172.21.15.121:0/3861476170 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550165 (secure 0 0 0) 0x7f7ca4011b00 con 0x7f7c8c06a0e0 2023-08-18T20:45:53.182 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:53.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 msgr2=0x7f7c8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 0x7f7c8c06c5a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40090b0 tx=0x7f7ca4008030 comp rx=0 tx=0).stop 2023-08-18T20:45:53.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 msgr2=0x7f7cac14b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009e30 tx=0x7f7c9c00c3a0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 shutdown_connections 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f7c8c06a0e0 0x7f7c8c06c5a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cac151b10 0x7f7cac14b600 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7cac0c4c60 0x7f7cac153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 --2- 172.21.15.121:0/3861476170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cac0c7ca0 0x7f7cac14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 >> 172.21.15.121:0/3861476170 conn(0x7f7cac071bb0 msgr2=0x7f7cac150540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 shutdown_connections 2023-08-18T20:45:53.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.180+0000 7f7cb1872700 1 -- 172.21.15.121:0/3861476170 wait complete. 2023-08-18T20:45:53.187 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:45:53.193 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-08-18T20:45:52.944006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596695,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":385,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226768,"kb_used_data":6480,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754747952,"statfs":{"total":773094113280,"available":772861902848,"internally_reserved":0,"allocated":6635520,"data_stored":3610658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.869215"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250279+0000","last_change":"2023-08-18T20:45:49.099486+0000","last_active":"2023-08-18T20:45:50.250279+0000","last_peered":"2023-08-18T20:45:50.250279+0000","last_clean":"2023-08-18T20:45:50.250279+0000","last_became_active":"2023-08-18T20:45:49.099129+0000","last_became_peered":"2023-08-18T20:45:49.099129+0000","last_unstale":"2023-08-18T20:45:50.250279+0000","last_undegraded":"2023-08-18T20:45:50.250279+0000","last_fullsized":"2023-08-18T20:45:50.250279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:54.967886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475459+0000","last_change":"2023-08-18T20:45:35.904053+0000","last_active":"2023-08-18T20:45:50.475459+0000","last_peered":"2023-08-18T20:45:50.475459+0000","last_clean":"2023-08-18T20:45:50.475459+0000","last_became_active":"2023-08-18T20:45:35.903735+0000","last_became_peered":"2023-08-18T20:45:35.903735+0000","last_unstale":"2023-08-18T20:45:50.475459+0000","last_undegraded":"2023-08-18T20:45:50.475459+0000","last_fullsized":"2023-08-18T20:45:50.475459+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:00.156386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083867+0000","last_change":"2023-08-18T20:45:49.101890+0000","last_active":"2023-08-18T20:45:50.083867+0000","last_peered":"2023-08-18T20:45:50.083867+0000","last_clean":"2023-08-18T20:45:50.083867+0000","last_became_active":"2023-08-18T20:45:49.101659+0000","last_became_peered":"2023-08-18T20:45:49.101659+0000","last_unstale":"2023-08-18T20:45:50.083867+0000","last_undegraded":"2023-08-18T20:45:50.083867+0000","last_fullsized":"2023-08-18T20:45:50.083867+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:28:52.257145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475266+0000","last_change":"2023-08-18T20:45:35.899964+0000","last_active":"2023-08-18T20:45:50.475266+0000","last_peered":"2023-08-18T20:45:50.475266+0000","last_clean":"2023-08-18T20:45:50.475266+0000","last_became_active":"2023-08-18T20:45:35.899670+0000","last_became_peered":"2023-08-18T20:45:35.899670+0000","last_unstale":"2023-08-18T20:45:50.475266+0000","last_undegraded":"2023-08-18T20:45:50.475266+0000","last_fullsized":"2023-08-18T20:45:50.475266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:31.474422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083944+0000","last_change":"2023-08-18T20:45:49.102624+0000","last_active":"2023-08-18T20:45:50.083944+0000","last_peered":"2023-08-18T20:45:50.083944+0000","last_clean":"2023-08-18T20:45:50.083944+0000","last_became_active":"2023-08-18T20:45:49.102364+0000","last_became_peered":"2023-08-18T20:45:49.102364+0000","last_unstale":"2023-08-18T20:45:50.083944+0000","last_undegraded":"2023-08-18T20:45:50.083944+0000","last_fullsized":"2023-08-18T20:45:50.083944+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:31.410523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087450+0000","last_change":"2023-08-18T20:45:35.906068+0000","last_active":"2023-08-18T20:45:50.087450+0000","last_peered":"2023-08-18T20:45:50.087450+0000","last_clean":"2023-08-18T20:45:50.087450+0000","last_became_active":"2023-08-18T20:45:35.905746+0000","last_became_peered":"2023-08-18T20:45:35.905746+0000","last_unstale":"2023-08-18T20:45:50.087450+0000","last_undegraded":"2023-08-18T20:45:50.087450+0000","last_fullsized":"2023-08-18T20:45:50.087450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:20:35.003721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294791+0000","last_change":"2023-08-18T20:45:49.105061+0000","last_active":"2023-08-18T20:45:50.294791+0000","last_peered":"2023-08-18T20:45:50.294791+0000","last_clean":"2023-08-18T20:45:50.294791+0000","last_became_active":"2023-08-18T20:45:49.104789+0000","last_became_peered":"2023-08-18T20:45:49.104789+0000","last_unstale":"2023-08-18T20:45:50.294791+0000","last_undegraded":"2023-08-18T20:45:50.294791+0000","last_fullsized":"2023-08-18T20:45:50.294791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:42:39.540811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475851+0000","last_change":"2023-08-18T20:45:35.902831+0000","last_active":"2023-08-18T20:45:50.475851+0000","last_peered":"2023-08-18T20:45:50.475851+0000","last_clean":"2023-08-18T20:45:50.475851+0000","last_became_active":"2023-08-18T20:45:35.902583+0000","last_became_peered":"2023-08-18T20:45:35.902583+0000","last_unstale":"2023-08-18T20:45:50.475851+0000","last_undegraded":"2023-08-18T20:45:50.475851+0000","last_fullsized":"2023-08-18T20:45:50.475851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:24:51.743192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475170+0000","last_change":"2023-08-18T20:45:49.100989+0000","last_active":"2023-08-18T20:45:50.475170+0000","last_peered":"2023-08-18T20:45:50.475170+0000","last_clean":"2023-08-18T20:45:50.475170+0000","last_became_active":"2023-08-18T20:45:49.100535+0000","last_became_peered":"2023-08-18T20:45:49.100535+0000","last_unstale":"2023-08-18T20:45:50.475170+0000","last_undegraded":"2023-08-18T20:45:50.475170+0000","last_fullsized":"2023-08-18T20:45:50.475170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:49.191779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250615+0000","last_change":"2023-08-18T20:45:35.907509+0000","last_active":"2023-08-18T20:45:50.250615+0000","last_peered":"2023-08-18T20:45:50.250615+0000","last_clean":"2023-08-18T20:45:50.250615+0000","last_became_active":"2023-08-18T20:45:35.906991+0000","last_became_peered":"2023-08-18T20:45:35.906991+0000","last_unstale":"2023-08-18T20:45:50.250615+0000","last_undegraded":"2023-08-18T20:45:50.250615+0000","last_fullsized":"2023-08-18T20:45:50.250615+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:10:38.613022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086314+0000","last_change":"2023-08-18T20:45:49.102045+0000","last_active":"2023-08-18T20:45:50.086314+0000","last_peered":"2023-08-18T20:45:50.086314+0000","last_clean":"2023-08-18T20:45:50.086314+0000","last_became_active":"2023-08-18T20:45:49.101635+0000","last_became_peered":"2023-08-18T20:45:49.101635+0000","last_unstale":"2023-08-18T20:45:50.086314+0000","last_undegraded":"2023-08-18T20:45:50.086314+0000","last_fullsized":"2023-08-18T20:45:50.086314+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:39.788826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220134+0000","last_change":"2023-08-18T20:45:35.910037+0000","last_active":"2023-08-18T20:45:50.220134+0000","last_peered":"2023-08-18T20:45:50.220134+0000","last_clean":"2023-08-18T20:45:50.220134+0000","last_became_active":"2023-08-18T20:45:35.909760+0000","last_became_peered":"2023-08-18T20:45:35.909760+0000","last_unstale":"2023-08-18T20:45:50.220134+0000","last_undegraded":"2023-08-18T20:45:50.220134+0000","last_fullsized":"2023-08-18T20:45:50.220134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:55:28.559878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087319+0000","last_change":"2023-08-18T20:45:49.106811+0000","last_active":"2023-08-18T20:45:50.087319+0000","last_peered":"2023-08-18T20:45:50.087319+0000","last_clean":"2023-08-18T20:45:50.087319+0000","last_became_active":"2023-08-18T20:45:49.106513+0000","last_became_peered":"2023-08-18T20:45:49.106513+0000","last_unstale":"2023-08-18T20:45:50.087319+0000","last_undegraded":"2023-08-18T20:45:50.087319+0000","last_fullsized":"2023-08-18T20:45:50.087319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:25:22.496125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083852+0000","last_change":"2023-08-18T20:45:35.904459+0000","last_active":"2023-08-18T20:45:50.083852+0000","last_peered":"2023-08-18T20:45:50.083852+0000","last_clean":"2023-08-18T20:45:50.083852+0000","last_became_active":"2023-08-18T20:45:35.904153+0000","last_became_peered":"2023-08-18T20:45:35.904153+0000","last_unstale":"2023-08-18T20:45:50.083852+0000","last_undegraded":"2023-08-18T20:45:50.083852+0000","last_fullsized":"2023-08-18T20:45:50.083852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:15:45.109550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220542+0000","last_change":"2023-08-18T20:45:49.107777+0000","last_active":"2023-08-18T20:45:50.220542+0000","last_peered":"2023-08-18T20:45:50.220542+0000","last_clean":"2023-08-18T20:45:50.220542+0000","last_became_active":"2023-08-18T20:45:49.107464+0000","last_became_peered":"2023-08-18T20:45:49.107464+0000","last_unstale":"2023-08-18T20:45:50.220542+0000","last_undegraded":"2023-08-18T20:45:50.220542+0000","last_fullsized":"2023-08-18T20:45:50.220542+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:25:32.570142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085098+0000","last_change":"2023-08-18T20:45:35.910962+0000","last_active":"2023-08-18T20:45:50.085098+0000","last_peered":"2023-08-18T20:45:50.085098+0000","last_clean":"2023-08-18T20:45:50.085098+0000","last_became_active":"2023-08-18T20:45:35.910721+0000","last_became_peered":"2023-08-18T20:45:35.910721+0000","last_unstale":"2023-08-18T20:45:50.085098+0000","last_undegraded":"2023-08-18T20:45:50.085098+0000","last_fullsized":"2023-08-18T20:45:50.085098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:19:28.887534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220330+0000","last_change":"2023-08-18T20:45:49.100568+0000","last_active":"2023-08-18T20:45:50.220330+0000","last_peered":"2023-08-18T20:45:50.220330+0000","last_clean":"2023-08-18T20:45:50.220330+0000","last_became_active":"2023-08-18T20:45:49.100291+0000","last_became_peered":"2023-08-18T20:45:49.100291+0000","last_unstale":"2023-08-18T20:45:50.220330+0000","last_undegraded":"2023-08-18T20:45:50.220330+0000","last_fullsized":"2023-08-18T20:45:50.220330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:07.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087592+0000","last_change":"2023-08-18T20:45:35.910833+0000","last_active":"2023-08-18T20:45:50.087592+0000","last_peered":"2023-08-18T20:45:50.087592+0000","last_clean":"2023-08-18T20:45:50.087592+0000","last_became_active":"2023-08-18T20:45:35.909062+0000","last_became_peered":"2023-08-18T20:45:35.909062+0000","last_unstale":"2023-08-18T20:45:50.087592+0000","last_undegraded":"2023-08-18T20:45:50.087592+0000","last_fullsized":"2023-08-18T20:45:50.087592+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:01:54.238902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085962+0000","last_change":"2023-08-18T20:45:49.102626+0000","last_active":"2023-08-18T20:45:50.085962+0000","last_peered":"2023-08-18T20:45:50.085962+0000","last_clean":"2023-08-18T20:45:50.085962+0000","last_became_active":"2023-08-18T20:45:49.102328+0000","last_became_peered":"2023-08-18T20:45:49.102328+0000","last_unstale":"2023-08-18T20:45:50.085962+0000","last_undegraded":"2023-08-18T20:45:50.085962+0000","last_fullsized":"2023-08-18T20:45:50.085962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:48:54.348635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087681+0000","last_change":"2023-08-18T20:45:35.904022+0000","last_active":"2023-08-18T20:45:50.087681+0000","last_peered":"2023-08-18T20:45:50.087681+0000","last_clean":"2023-08-18T20:45:50.087681+0000","last_became_active":"2023-08-18T20:45:35.903760+0000","last_became_peered":"2023-08-18T20:45:35.903760+0000","last_unstale":"2023-08-18T20:45:50.087681+0000","last_undegraded":"2023-08-18T20:45:50.087681+0000","last_fullsized":"2023-08-18T20:45:50.087681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:57.878262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084008+0000","last_change":"2023-08-18T20:45:49.095570+0000","last_active":"2023-08-18T20:45:50.084008+0000","last_peered":"2023-08-18T20:45:50.084008+0000","last_clean":"2023-08-18T20:45:50.084008+0000","last_became_active":"2023-08-18T20:45:49.095311+0000","last_became_peered":"2023-08-18T20:45:49.095311+0000","last_unstale":"2023-08-18T20:45:50.084008+0000","last_undegraded":"2023-08-18T20:45:50.084008+0000","last_fullsized":"2023-08-18T20:45:50.084008+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:22:38.693428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475829+0000","last_change":"2023-08-18T20:45:35.906448+0000","last_active":"2023-08-18T20:45:50.475829+0000","last_peered":"2023-08-18T20:45:50.475829+0000","last_clean":"2023-08-18T20:45:50.475829+0000","last_became_active":"2023-08-18T20:45:35.905021+0000","last_became_peered":"2023-08-18T20:45:35.905021+0000","last_unstale":"2023-08-18T20:45:50.475829+0000","last_undegraded":"2023-08-18T20:45:50.475829+0000","last_fullsized":"2023-08-18T20:45:50.475829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:36.072722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294947+0000","last_change":"2023-08-18T20:45:49.104723+0000","last_active":"2023-08-18T20:45:50.294947+0000","last_peered":"2023-08-18T20:45:50.294947+0000","last_clean":"2023-08-18T20:45:50.294947+0000","last_became_active":"2023-08-18T20:45:49.104415+0000","last_became_peered":"2023-08-18T20:45:49.104415+0000","last_unstale":"2023-08-18T20:45:50.294947+0000","last_undegraded":"2023-08-18T20:45:50.294947+0000","last_fullsized":"2023-08-18T20:45:50.294947+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:28.696007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086589+0000","last_change":"2023-08-18T20:45:35.910585+0000","last_active":"2023-08-18T20:45:50.086589+0000","last_peered":"2023-08-18T20:45:50.086589+0000","last_clean":"2023-08-18T20:45:50.086589+0000","last_became_active":"2023-08-18T20:45:35.910306+0000","last_became_peered":"2023-08-18T20:45:35.910306+0000","last_unstale":"2023-08-18T20:45:50.086589+0000","last_undegraded":"2023-08-18T20:45:50.086589+0000","last_fullsized":"2023-08-18T20:45:50.086589+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:07.592995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220290+0000","last_change":"2023-08-18T20:45:49.113069+0000","last_active":"2023-08-18T20:45:50.220290+0000","last_peered":"2023-08-18T20:45:50.220290+0000","last_clean":"2023-08-18T20:45:50.220290+0000","last_became_active":"2023-08-18T20:45:49.112783+0000","last_became_peered":"2023-08-18T20:45:49.112783+0000","last_unstale":"2023-08-18T20:45:50.220290+0000","last_undegraded":"2023-08-18T20:45:50.220290+0000","last_fullsized":"2023-08-18T20:45:50.220290+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:40:30.982050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086000+0000","last_change":"2023-08-18T20:45:35.909011+0000","last_active":"2023-08-18T20:45:50.086000+0000","last_peered":"2023-08-18T20:45:50.086000+0000","last_clean":"2023-08-18T20:45:50.086000+0000","last_became_active":"2023-08-18T20:45:35.908728+0000","last_became_peered":"2023-08-18T20:45:35.908728+0000","last_unstale":"2023-08-18T20:45:50.086000+0000","last_undegraded":"2023-08-18T20:45:50.086000+0000","last_fullsized":"2023-08-18T20:45:50.086000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:57.736358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086606+0000","last_change":"2023-08-18T20:45:49.116908+0000","last_active":"2023-08-18T20:45:50.086606+0000","last_peered":"2023-08-18T20:45:50.086606+0000","last_clean":"2023-08-18T20:45:50.086606+0000","last_became_active":"2023-08-18T20:45:49.116614+0000","last_became_peered":"2023-08-18T20:45:49.116614+0000","last_unstale":"2023-08-18T20:45:50.086606+0000","last_undegraded":"2023-08-18T20:45:50.086606+0000","last_fullsized":"2023-08-18T20:45:50.086606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:54:07.529776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086191+0000","last_change":"2023-08-18T20:45:35.906359+0000","last_active":"2023-08-18T20:45:50.086191+0000","last_peered":"2023-08-18T20:45:50.086191+0000","last_clean":"2023-08-18T20:45:50.086191+0000","last_became_active":"2023-08-18T20:45:35.906092+0000","last_became_peered":"2023-08-18T20:45:35.906092+0000","last_unstale":"2023-08-18T20:45:50.086191+0000","last_undegraded":"2023-08-18T20:45:50.086191+0000","last_fullsized":"2023-08-18T20:45:50.086191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:19:17.479723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476131+0000","last_change":"2023-08-18T20:45:49.112257+0000","last_active":"2023-08-18T20:45:50.476131+0000","last_peered":"2023-08-18T20:45:50.476131+0000","last_clean":"2023-08-18T20:45:50.476131+0000","last_became_active":"2023-08-18T20:45:49.111968+0000","last_became_peered":"2023-08-18T20:45:49.111968+0000","last_unstale":"2023-08-18T20:45:50.476131+0000","last_undegraded":"2023-08-18T20:45:50.476131+0000","last_fullsized":"2023-08-18T20:45:50.476131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:49.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085988+0000","last_change":"2023-08-18T20:45:35.908516+0000","last_active":"2023-08-18T20:45:50.085988+0000","last_peered":"2023-08-18T20:45:50.085988+0000","last_clean":"2023-08-18T20:45:50.085988+0000","last_became_active":"2023-08-18T20:45:35.907957+0000","last_became_peered":"2023-08-18T20:45:35.907957+0000","last_unstale":"2023-08-18T20:45:50.085988+0000","last_undegraded":"2023-08-18T20:45:50.085988+0000","last_fullsized":"2023-08-18T20:45:50.085988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:29.909266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086284+0000","last_change":"2023-08-18T20:45:49.101757+0000","last_active":"2023-08-18T20:45:50.086284+0000","last_peered":"2023-08-18T20:45:50.086284+0000","last_clean":"2023-08-18T20:45:50.086284+0000","last_became_active":"2023-08-18T20:45:49.101469+0000","last_became_peered":"2023-08-18T20:45:49.101469+0000","last_unstale":"2023-08-18T20:45:50.086284+0000","last_undegraded":"2023-08-18T20:45:50.086284+0000","last_fullsized":"2023-08-18T20:45:50.086284+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:07.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083681+0000","last_change":"2023-08-18T20:45:35.905110+0000","last_active":"2023-08-18T20:45:50.083681+0000","last_peered":"2023-08-18T20:45:50.083681+0000","last_clean":"2023-08-18T20:45:50.083681+0000","last_became_active":"2023-08-18T20:45:35.904860+0000","last_became_peered":"2023-08-18T20:45:35.904860+0000","last_unstale":"2023-08-18T20:45:50.083681+0000","last_undegraded":"2023-08-18T20:45:50.083681+0000","last_fullsized":"2023-08-18T20:45:50.083681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:22.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475251+0000","last_change":"2023-08-18T20:45:49.105628+0000","last_active":"2023-08-18T20:45:50.475251+0000","last_peered":"2023-08-18T20:45:50.475251+0000","last_clean":"2023-08-18T20:45:50.475251+0000","last_became_active":"2023-08-18T20:45:49.105274+0000","last_became_peered":"2023-08-18T20:45:49.105274+0000","last_unstale":"2023-08-18T20:45:50.475251+0000","last_undegraded":"2023-08-18T20:45:50.475251+0000","last_fullsized":"2023-08-18T20:45:50.475251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:39.690048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475394+0000","last_change":"2023-08-18T20:45:35.904684+0000","last_active":"2023-08-18T20:45:50.475394+0000","last_peered":"2023-08-18T20:45:50.475394+0000","last_clean":"2023-08-18T20:45:50.475394+0000","last_became_active":"2023-08-18T20:45:35.904415+0000","last_became_peered":"2023-08-18T20:45:35.904415+0000","last_unstale":"2023-08-18T20:45:50.475394+0000","last_undegraded":"2023-08-18T20:45:50.475394+0000","last_fullsized":"2023-08-18T20:45:50.475394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:06.165927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220331+0000","last_change":"2023-08-18T20:45:49.109236+0000","last_active":"2023-08-18T20:45:50.220331+0000","last_peered":"2023-08-18T20:45:50.220331+0000","last_clean":"2023-08-18T20:45:50.220331+0000","last_became_active":"2023-08-18T20:45:49.108985+0000","last_became_peered":"2023-08-18T20:45:49.108985+0000","last_unstale":"2023-08-18T20:45:50.220331+0000","last_undegraded":"2023-08-18T20:45:50.220331+0000","last_fullsized":"2023-08-18T20:45:50.220331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:39.788826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476230+0000","last_change":"2023-08-18T20:45:35.903094+0000","last_active":"2023-08-18T20:45:50.476230+0000","last_peered":"2023-08-18T20:45:50.476230+0000","last_clean":"2023-08-18T20:45:50.476230+0000","last_became_active":"2023-08-18T20:45:35.902444+0000","last_became_peered":"2023-08-18T20:45:35.902444+0000","last_unstale":"2023-08-18T20:45:50.476230+0000","last_undegraded":"2023-08-18T20:45:50.476230+0000","last_fullsized":"2023-08-18T20:45:50.476230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:00.156386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475434+0000","last_change":"2023-08-18T20:45:49.105073+0000","last_active":"2023-08-18T20:45:50.475434+0000","last_peered":"2023-08-18T20:45:50.475434+0000","last_clean":"2023-08-18T20:45:50.475434+0000","last_became_active":"2023-08-18T20:45:49.104791+0000","last_became_peered":"2023-08-18T20:45:49.104791+0000","last_unstale":"2023-08-18T20:45:50.475434+0000","last_undegraded":"2023-08-18T20:45:50.475434+0000","last_fullsized":"2023-08-18T20:45:50.475434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:35:29.892474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250523+0000","last_change":"2023-08-18T20:45:35.901532+0000","last_active":"2023-08-18T20:45:50.250523+0000","last_peered":"2023-08-18T20:45:50.250523+0000","last_clean":"2023-08-18T20:45:50.250523+0000","last_became_active":"2023-08-18T20:45:35.901219+0000","last_became_peered":"2023-08-18T20:45:35.901219+0000","last_unstale":"2023-08-18T20:45:50.250523+0000","last_undegraded":"2023-08-18T20:45:50.250523+0000","last_fullsized":"2023-08-18T20:45:50.250523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:20:50.568908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084038+0000","last_change":"2023-08-18T20:45:49.100599+0000","last_active":"2023-08-18T20:45:50.084038+0000","last_peered":"2023-08-18T20:45:50.084038+0000","last_clean":"2023-08-18T20:45:50.084038+0000","last_became_active":"2023-08-18T20:45:49.100337+0000","last_became_peered":"2023-08-18T20:45:49.100337+0000","last_unstale":"2023-08-18T20:45:50.084038+0000","last_undegraded":"2023-08-18T20:45:50.084038+0000","last_fullsized":"2023-08-18T20:45:50.084038+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:27:40.489298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294901+0000","last_change":"2023-08-18T20:45:35.898503+0000","last_active":"2023-08-18T20:45:50.294901+0000","last_peered":"2023-08-18T20:45:50.294901+0000","last_clean":"2023-08-18T20:45:50.294901+0000","last_became_active":"2023-08-18T20:45:35.898323+0000","last_became_peered":"2023-08-18T20:45:35.898323+0000","last_unstale":"2023-08-18T20:45:50.294901+0000","last_undegraded":"2023-08-18T20:45:50.294901+0000","last_fullsized":"2023-08-18T20:45:50.294901+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:31.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295018+0000","last_change":"2023-08-18T20:45:49.097023+0000","last_active":"2023-08-18T20:45:50.295018+0000","last_peered":"2023-08-18T20:45:50.295018+0000","last_clean":"2023-08-18T20:45:50.295018+0000","last_became_active":"2023-08-18T20:45:49.096745+0000","last_became_peered":"2023-08-18T20:45:49.096745+0000","last_unstale":"2023-08-18T20:45:50.295018+0000","last_undegraded":"2023-08-18T20:45:50.295018+0000","last_fullsized":"2023-08-18T20:45:50.295018+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:16:24.323957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086120+0000","last_change":"2023-08-18T20:45:35.903465+0000","last_active":"2023-08-18T20:45:50.086120+0000","last_peered":"2023-08-18T20:45:50.086120+0000","last_clean":"2023-08-18T20:45:50.086120+0000","last_became_active":"2023-08-18T20:45:35.903146+0000","last_became_peered":"2023-08-18T20:45:35.903146+0000","last_unstale":"2023-08-18T20:45:50.086120+0000","last_undegraded":"2023-08-18T20:45:50.086120+0000","last_fullsized":"2023-08-18T20:45:50.086120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:40:17.862993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084082+0000","last_change":"2023-08-18T20:45:49.098137+0000","last_active":"2023-08-18T20:45:50.084082+0000","last_peered":"2023-08-18T20:45:50.084082+0000","last_clean":"2023-08-18T20:45:50.084082+0000","last_became_active":"2023-08-18T20:45:49.097878+0000","last_became_peered":"2023-08-18T20:45:49.097878+0000","last_unstale":"2023-08-18T20:45:50.084082+0000","last_undegraded":"2023-08-18T20:45:50.084082+0000","last_fullsized":"2023-08-18T20:45:50.084082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:24:20.418872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295047+0000","last_change":"2023-08-18T20:45:35.905931+0000","last_active":"2023-08-18T20:45:50.295047+0000","last_peered":"2023-08-18T20:45:50.295047+0000","last_clean":"2023-08-18T20:45:50.295047+0000","last_became_active":"2023-08-18T20:45:35.905676+0000","last_became_peered":"2023-08-18T20:45:35.905676+0000","last_unstale":"2023-08-18T20:45:50.295047+0000","last_undegraded":"2023-08-18T20:45:50.295047+0000","last_fullsized":"2023-08-18T20:45:50.295047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:17:09.840341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084751+0000","last_change":"2023-08-18T20:45:49.094711+0000","last_active":"2023-08-18T20:45:50.084751+0000","last_peered":"2023-08-18T20:45:50.084751+0000","last_clean":"2023-08-18T20:45:50.084751+0000","last_became_active":"2023-08-18T20:45:49.094403+0000","last_became_peered":"2023-08-18T20:45:49.094403+0000","last_unstale":"2023-08-18T20:45:50.084751+0000","last_undegraded":"2023-08-18T20:45:50.084751+0000","last_fullsized":"2023-08-18T20:45:50.084751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:34:32.248592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294781+0000","last_change":"2023-08-18T20:45:35.906132+0000","last_active":"2023-08-18T20:45:50.294781+0000","last_peered":"2023-08-18T20:45:50.294781+0000","last_clean":"2023-08-18T20:45:50.294781+0000","last_became_active":"2023-08-18T20:45:35.905839+0000","last_became_peered":"2023-08-18T20:45:35.905839+0000","last_unstale":"2023-08-18T20:45:50.294781+0000","last_undegraded":"2023-08-18T20:45:50.294781+0000","last_fullsized":"2023-08-18T20:45:50.294781+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:56:48.784312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475177+0000","last_change":"2023-08-18T20:45:49.112406+0000","last_active":"2023-08-18T20:45:50.475177+0000","last_peered":"2023-08-18T20:45:50.475177+0000","last_clean":"2023-08-18T20:45:50.475177+0000","last_became_active":"2023-08-18T20:45:49.112007+0000","last_became_peered":"2023-08-18T20:45:49.112007+0000","last_unstale":"2023-08-18T20:45:50.475177+0000","last_undegraded":"2023-08-18T20:45:50.475177+0000","last_fullsized":"2023-08-18T20:45:50.475177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:25:04.862249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086202+0000","last_change":"2023-08-18T20:45:35.909007+0000","last_active":"2023-08-18T20:45:50.086202+0000","last_peered":"2023-08-18T20:45:50.086202+0000","last_clean":"2023-08-18T20:45:50.086202+0000","last_became_active":"2023-08-18T20:45:35.908647+0000","last_became_peered":"2023-08-18T20:45:35.908647+0000","last_unstale":"2023-08-18T20:45:50.086202+0000","last_undegraded":"2023-08-18T20:45:50.086202+0000","last_fullsized":"2023-08-18T20:45:50.086202+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:32:37.486795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474613+0000","last_change":"2023-08-18T20:45:49.088906+0000","last_active":"2023-08-18T20:45:50.474613+0000","last_peered":"2023-08-18T20:45:50.474613+0000","last_clean":"2023-08-18T20:45:50.474613+0000","last_became_active":"2023-08-18T20:45:49.088635+0000","last_became_peered":"2023-08-18T20:45:49.088635+0000","last_unstale":"2023-08-18T20:45:50.474613+0000","last_undegraded":"2023-08-18T20:45:50.474613+0000","last_fullsized":"2023-08-18T20:45:50.474613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:23:31.185569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086554+0000","last_change":"2023-08-18T20:45:35.902924+0000","last_active":"2023-08-18T20:45:50.086554+0000","last_peered":"2023-08-18T20:45:50.086554+0000","last_clean":"2023-08-18T20:45:50.086554+0000","last_became_active":"2023-08-18T20:45:35.902559+0000","last_became_peered":"2023-08-18T20:45:35.902559+0000","last_unstale":"2023-08-18T20:45:50.086554+0000","last_undegraded":"2023-08-18T20:45:50.086554+0000","last_fullsized":"2023-08-18T20:45:50.086554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:07.409053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085797+0000","last_change":"2023-08-18T20:45:49.113166+0000","last_active":"2023-08-18T20:45:50.085797+0000","last_peered":"2023-08-18T20:45:50.085797+0000","last_clean":"2023-08-18T20:45:50.085797+0000","last_became_active":"2023-08-18T20:45:49.112840+0000","last_became_peered":"2023-08-18T20:45:49.112840+0000","last_unstale":"2023-08-18T20:45:50.085797+0000","last_undegraded":"2023-08-18T20:45:50.085797+0000","last_fullsized":"2023-08-18T20:45:50.085797+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:06:50.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086649+0000","last_change":"2023-08-18T20:45:35.902555+0000","last_active":"2023-08-18T20:45:50.086649+0000","last_peered":"2023-08-18T20:45:50.086649+0000","last_clean":"2023-08-18T20:45:50.086649+0000","last_became_active":"2023-08-18T20:45:35.902253+0000","last_became_peered":"2023-08-18T20:45:35.902253+0000","last_unstale":"2023-08-18T20:45:50.086649+0000","last_undegraded":"2023-08-18T20:45:50.086649+0000","last_fullsized":"2023-08-18T20:45:50.086649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:13.781290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220202+0000","last_change":"2023-08-18T20:45:49.109032+0000","last_active":"2023-08-18T20:45:50.220202+0000","last_peered":"2023-08-18T20:45:50.220202+0000","last_clean":"2023-08-18T20:45:50.220202+0000","last_became_active":"2023-08-18T20:45:49.108744+0000","last_became_peered":"2023-08-18T20:45:49.108744+0000","last_unstale":"2023-08-18T20:45:50.220202+0000","last_undegraded":"2023-08-18T20:45:50.220202+0000","last_fullsized":"2023-08-18T20:45:50.220202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:51:42.700242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475826+0000","last_change":"2023-08-18T20:45:35.902409+0000","last_active":"2023-08-18T20:45:50.475826+0000","last_peered":"2023-08-18T20:45:50.475826+0000","last_clean":"2023-08-18T20:45:50.475826+0000","last_became_active":"2023-08-18T20:45:35.902127+0000","last_became_peered":"2023-08-18T20:45:35.902127+0000","last_unstale":"2023-08-18T20:45:50.475826+0000","last_undegraded":"2023-08-18T20:45:50.475826+0000","last_fullsized":"2023-08-18T20:45:50.475826+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:54:02.974779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085958+0000","last_change":"2023-08-18T20:45:49.117955+0000","last_active":"2023-08-18T20:45:50.085958+0000","last_peered":"2023-08-18T20:45:50.085958+0000","last_clean":"2023-08-18T20:45:50.085958+0000","last_became_active":"2023-08-18T20:45:49.117667+0000","last_became_peered":"2023-08-18T20:45:49.117667+0000","last_unstale":"2023-08-18T20:45:50.085958+0000","last_undegraded":"2023-08-18T20:45:50.085958+0000","last_fullsized":"2023-08-18T20:45:50.085958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:35:37.215104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475125+0000","last_change":"2023-08-18T20:45:35.894279+0000","last_active":"2023-08-18T20:45:50.475125+0000","last_peered":"2023-08-18T20:45:50.475125+0000","last_clean":"2023-08-18T20:45:50.475125+0000","last_became_active":"2023-08-18T20:45:35.894004+0000","last_became_peered":"2023-08-18T20:45:35.894004+0000","last_unstale":"2023-08-18T20:45:50.475125+0000","last_undegraded":"2023-08-18T20:45:50.475125+0000","last_fullsized":"2023-08-18T20:45:50.475125+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:46:10.723937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087175+0000","last_change":"2023-08-18T20:45:49.102691+0000","last_active":"2023-08-18T20:45:50.087175+0000","last_peered":"2023-08-18T20:45:50.087175+0000","last_clean":"2023-08-18T20:45:50.087175+0000","last_became_active":"2023-08-18T20:45:49.102457+0000","last_became_peered":"2023-08-18T20:45:49.102457+0000","last_unstale":"2023-08-18T20:45:50.087175+0000","last_undegraded":"2023-08-18T20:45:50.087175+0000","last_fullsized":"2023-08-18T20:45:50.087175+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:18:44.413266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087466+0000","last_change":"2023-08-18T20:45:35.907408+0000","last_active":"2023-08-18T20:45:50.087466+0000","last_peered":"2023-08-18T20:45:50.087466+0000","last_clean":"2023-08-18T20:45:50.087466+0000","last_became_active":"2023-08-18T20:45:35.907139+0000","last_became_peered":"2023-08-18T20:45:35.907139+0000","last_unstale":"2023-08-18T20:45:50.087466+0000","last_undegraded":"2023-08-18T20:45:50.087466+0000","last_fullsized":"2023-08-18T20:45:50.087466+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:10:56.828273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084161+0000","last_change":"2023-08-18T20:45:49.104403+0000","last_active":"2023-08-18T20:45:50.084161+0000","last_peered":"2023-08-18T20:45:50.084161+0000","last_clean":"2023-08-18T20:45:50.084161+0000","last_became_active":"2023-08-18T20:45:49.104129+0000","last_became_peered":"2023-08-18T20:45:49.104129+0000","last_unstale":"2023-08-18T20:45:50.084161+0000","last_undegraded":"2023-08-18T20:45:50.084161+0000","last_fullsized":"2023-08-18T20:45:50.084161+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:56:59.878635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085297+0000","last_change":"2023-08-18T20:45:35.910266+0000","last_active":"2023-08-18T20:45:50.085297+0000","last_peered":"2023-08-18T20:45:50.085297+0000","last_clean":"2023-08-18T20:45:50.085297+0000","last_became_active":"2023-08-18T20:45:35.909890+0000","last_became_peered":"2023-08-18T20:45:35.909890+0000","last_unstale":"2023-08-18T20:45:50.085297+0000","last_undegraded":"2023-08-18T20:45:50.085297+0000","last_fullsized":"2023-08-18T20:45:50.085297+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:52.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220734+0000","last_change":"2023-08-18T20:45:49.109344+0000","last_active":"2023-08-18T20:45:50.220734+0000","last_peered":"2023-08-18T20:45:50.220734+0000","last_clean":"2023-08-18T20:45:50.220734+0000","last_became_active":"2023-08-18T20:45:49.109028+0000","last_became_peered":"2023-08-18T20:45:49.109028+0000","last_unstale":"2023-08-18T20:45:50.220734+0000","last_undegraded":"2023-08-18T20:45:50.220734+0000","last_fullsized":"2023-08-18T20:45:50.220734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:50:36.228429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475427+0000","last_change":"2023-08-18T20:45:35.904760+0000","last_active":"2023-08-18T20:45:50.475427+0000","last_peered":"2023-08-18T20:45:50.475427+0000","last_clean":"2023-08-18T20:45:50.475427+0000","last_became_active":"2023-08-18T20:45:35.904451+0000","last_became_peered":"2023-08-18T20:45:35.904451+0000","last_unstale":"2023-08-18T20:45:50.475427+0000","last_undegraded":"2023-08-18T20:45:50.475427+0000","last_fullsized":"2023-08-18T20:45:50.475427+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:34:03.959717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086512+0000","last_change":"2023-08-18T20:45:49.113734+0000","last_active":"2023-08-18T20:45:50.086512+0000","last_peered":"2023-08-18T20:45:50.086512+0000","last_clean":"2023-08-18T20:45:50.086512+0000","last_became_active":"2023-08-18T20:45:49.113444+0000","last_became_peered":"2023-08-18T20:45:49.113444+0000","last_unstale":"2023-08-18T20:45:50.086512+0000","last_undegraded":"2023-08-18T20:45:50.086512+0000","last_fullsized":"2023-08-18T20:45:50.086512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:29:01.343832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220133+0000","last_change":"2023-08-18T20:45:35.900863+0000","last_active":"2023-08-18T20:45:50.220133+0000","last_peered":"2023-08-18T20:45:50.220133+0000","last_clean":"2023-08-18T20:45:50.220133+0000","last_became_active":"2023-08-18T20:45:35.900630+0000","last_became_peered":"2023-08-18T20:45:35.900630+0000","last_unstale":"2023-08-18T20:45:50.220133+0000","last_undegraded":"2023-08-18T20:45:50.220133+0000","last_fullsized":"2023-08-18T20:45:50.220133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:36:26.525186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475429+0000","last_change":"2023-08-18T20:45:49.107804+0000","last_active":"2023-08-18T20:45:50.475429+0000","last_peered":"2023-08-18T20:45:50.475429+0000","last_clean":"2023-08-18T20:45:50.475429+0000","last_became_active":"2023-08-18T20:45:49.107443+0000","last_became_peered":"2023-08-18T20:45:49.107443+0000","last_unstale":"2023-08-18T20:45:50.475429+0000","last_undegraded":"2023-08-18T20:45:50.475429+0000","last_fullsized":"2023-08-18T20:45:50.475429+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:18.966380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087335+0000","last_change":"2023-08-18T20:45:48.103035+0000","last_active":"2023-08-18T20:45:50.087335+0000","last_peered":"2023-08-18T20:45:50.087335+0000","last_clean":"2023-08-18T20:45:50.087335+0000","last_became_active":"2023-08-18T20:45:48.102800+0000","last_became_peered":"2023-08-18T20:45:48.102800+0000","last_unstale":"2023-08-18T20:45:50.087335+0000","last_undegraded":"2023-08-18T20:45:50.087335+0000","last_fullsized":"2023-08-18T20:45:50.087335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:40:50.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250433+0000","last_change":"2023-08-18T20:45:35.898466+0000","last_active":"2023-08-18T20:45:50.250433+0000","last_peered":"2023-08-18T20:45:50.250433+0000","last_clean":"2023-08-18T20:45:50.250433+0000","last_became_active":"2023-08-18T20:45:35.898171+0000","last_became_peered":"2023-08-18T20:45:35.898171+0000","last_unstale":"2023-08-18T20:45:50.250433+0000","last_undegraded":"2023-08-18T20:45:50.250433+0000","last_fullsized":"2023-08-18T20:45:50.250433+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:16:04.608368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"51'4","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475341+0000","last_change":"2023-08-18T20:45:34.973966+0000","last_active":"2023-08-18T20:45:50.475341+0000","last_peered":"2023-08-18T20:45:50.475341+0000","last_clean":"2023-08-18T20:45:50.475341+0000","last_became_active":"2023-08-18T20:45:34.973275+0000","last_became_peered":"2023-08-18T20:45:34.973275+0000","last_unstale":"2023-08-18T20:45:50.475341+0000","last_undegraded":"2023-08-18T20:45:50.475341+0000","last_fullsized":"2023-08-18T20:45:50.475341+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:34.969516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475672+0000","last_change":"2023-08-18T20:45:49.104855+0000","last_active":"2023-08-18T20:45:50.475672+0000","last_peered":"2023-08-18T20:45:50.475672+0000","last_clean":"2023-08-18T20:45:50.475672+0000","last_became_active":"2023-08-18T20:45:49.101466+0000","last_became_peered":"2023-08-18T20:45:49.101466+0000","last_unstale":"2023-08-18T20:45:50.475672+0000","last_undegraded":"2023-08-18T20:45:50.475672+0000","last_fullsized":"2023-08-18T20:45:50.475672+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:03:39.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251027+0000","last_change":"2023-08-18T20:45:48.097618+0000","last_active":"2023-08-18T20:45:50.251027+0000","last_peered":"2023-08-18T20:45:50.251027+0000","last_clean":"2023-08-18T20:45:50.251027+0000","last_became_active":"2023-08-18T20:45:48.097347+0000","last_became_peered":"2023-08-18T20:45:48.097347+0000","last_unstale":"2023-08-18T20:45:50.251027+0000","last_undegraded":"2023-08-18T20:45:50.251027+0000","last_fullsized":"2023-08-18T20:45:50.251027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475953+0000","last_change":"2023-08-18T20:45:35.905614+0000","last_active":"2023-08-18T20:45:50.475953+0000","last_peered":"2023-08-18T20:45:50.475953+0000","last_clean":"2023-08-18T20:45:50.475953+0000","last_became_active":"2023-08-18T20:45:35.905300+0000","last_became_peered":"2023-08-18T20:45:35.905300+0000","last_unstale":"2023-08-18T20:45:50.475953+0000","last_undegraded":"2023-08-18T20:45:50.475953+0000","last_fullsized":"2023-08-18T20:45:50.475953+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:58:33.811946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220826+0000","last_change":"2023-08-18T20:45:34.974441+0000","last_active":"2023-08-18T20:45:50.220826+0000","last_peered":"2023-08-18T20:45:50.220826+0000","last_clean":"2023-08-18T20:45:50.220826+0000","last_became_active":"2023-08-18T20:45:34.974160+0000","last_became_peered":"2023-08-18T20:45:34.974160+0000","last_unstale":"2023-08-18T20:45:50.220826+0000","last_undegraded":"2023-08-18T20:45:50.220826+0000","last_fullsized":"2023-08-18T20:45:50.220826+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:05:07.579774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474548+0000","last_change":"2023-08-18T20:45:49.107063+0000","last_active":"2023-08-18T20:45:50.474548+0000","last_peered":"2023-08-18T20:45:50.474548+0000","last_clean":"2023-08-18T20:45:50.474548+0000","last_became_active":"2023-08-18T20:45:49.106796+0000","last_became_peered":"2023-08-18T20:45:49.106796+0000","last_unstale":"2023-08-18T20:45:50.474548+0000","last_undegraded":"2023-08-18T20:45:50.474548+0000","last_fullsized":"2023-08-18T20:45:50.474548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:03:40.931566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"55'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084754+0000","last_change":"2023-08-18T20:45:48.100506+0000","last_active":"2023-08-18T20:45:50.084754+0000","last_peered":"2023-08-18T20:45:50.084754+0000","last_clean":"2023-08-18T20:45:50.084754+0000","last_became_active":"2023-08-18T20:45:48.100217+0000","last_became_peered":"2023-08-18T20:45:48.100217+0000","last_unstale":"2023-08-18T20:45:50.084754+0000","last_undegraded":"2023-08-18T20:45:50.084754+0000","last_fullsized":"2023-08-18T20:45:50.084754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:37.988740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220833+0000","last_change":"2023-08-18T20:45:35.901281+0000","last_active":"2023-08-18T20:45:50.220833+0000","last_peered":"2023-08-18T20:45:50.220833+0000","last_clean":"2023-08-18T20:45:50.220833+0000","last_became_active":"2023-08-18T20:45:35.900941+0000","last_became_peered":"2023-08-18T20:45:35.900941+0000","last_unstale":"2023-08-18T20:45:50.220833+0000","last_undegraded":"2023-08-18T20:45:50.220833+0000","last_fullsized":"2023-08-18T20:45:50.220833+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:50:45.348529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220563+0000","last_change":"2023-08-18T20:45:34.972508+0000","last_active":"2023-08-18T20:45:50.220563+0000","last_peered":"2023-08-18T20:45:50.220563+0000","last_clean":"2023-08-18T20:45:50.220563+0000","last_became_active":"2023-08-18T20:45:34.972220+0000","last_became_peered":"2023-08-18T20:45:34.972220+0000","last_unstale":"2023-08-18T20:45:50.220563+0000","last_undegraded":"2023-08-18T20:45:50.220563+0000","last_fullsized":"2023-08-18T20:45:50.220563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:52:15.257091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.219907+0000","last_change":"2023-08-18T20:45:49.107174+0000","last_active":"2023-08-18T20:45:50.219907+0000","last_peered":"2023-08-18T20:45:50.219907+0000","last_clean":"2023-08-18T20:45:50.219907+0000","last_became_active":"2023-08-18T20:45:49.106234+0000","last_became_peered":"2023-08-18T20:45:49.106234+0000","last_unstale":"2023-08-18T20:45:50.219907+0000","last_undegraded":"2023-08-18T20:45:50.219907+0000","last_fullsized":"2023-08-18T20:45:50.219907+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:43.124577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087547+0000","last_change":"2023-08-18T20:45:48.100285+0000","last_active":"2023-08-18T20:45:50.087547+0000","last_peered":"2023-08-18T20:45:50.087547+0000","last_clean":"2023-08-18T20:45:50.087547+0000","last_became_active":"2023-08-18T20:45:48.100014+0000","last_became_peered":"2023-08-18T20:45:48.100014+0000","last_unstale":"2023-08-18T20:45:50.087547+0000","last_undegraded":"2023-08-18T20:45:50.087547+0000","last_fullsized":"2023-08-18T20:45:50.087547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:07.879781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087667+0000","last_change":"2023-08-18T20:45:35.904462+0000","last_active":"2023-08-18T20:45:50.087667+0000","last_peered":"2023-08-18T20:45:50.087667+0000","last_clean":"2023-08-18T20:45:50.087667+0000","last_became_active":"2023-08-18T20:45:35.904204+0000","last_became_peered":"2023-08-18T20:45:35.904204+0000","last_unstale":"2023-08-18T20:45:50.087667+0000","last_undegraded":"2023-08-18T20:45:50.087667+0000","last_fullsized":"2023-08-18T20:45:50.087667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:00.258977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220501+0000","last_change":"2023-08-18T20:45:34.963794+0000","last_active":"2023-08-18T20:45:50.220501+0000","last_peered":"2023-08-18T20:45:50.220501+0000","last_clean":"2023-08-18T20:45:50.220501+0000","last_became_active":"2023-08-18T20:45:34.963499+0000","last_became_peered":"2023-08-18T20:45:34.963499+0000","last_unstale":"2023-08-18T20:45:50.220501+0000","last_undegraded":"2023-08-18T20:45:50.220501+0000","last_fullsized":"2023-08-18T20:45:50.220501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:12.774743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476053+0000","last_change":"2023-08-18T20:45:49.110555+0000","last_active":"2023-08-18T20:45:50.476053+0000","last_peered":"2023-08-18T20:45:50.476053+0000","last_clean":"2023-08-18T20:45:50.476053+0000","last_became_active":"2023-08-18T20:45:49.110271+0000","last_became_peered":"2023-08-18T20:45:49.110271+0000","last_unstale":"2023-08-18T20:45:50.476053+0000","last_undegraded":"2023-08-18T20:45:50.476053+0000","last_fullsized":"2023-08-18T20:45:50.476053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:41.464763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.219931+0000","last_change":"2023-08-18T20:45:48.102940+0000","last_active":"2023-08-18T20:45:50.219931+0000","last_peered":"2023-08-18T20:45:50.219931+0000","last_clean":"2023-08-18T20:45:50.219931+0000","last_became_active":"2023-08-18T20:45:48.102612+0000","last_became_peered":"2023-08-18T20:45:48.102612+0000","last_unstale":"2023-08-18T20:45:50.219931+0000","last_undegraded":"2023-08-18T20:45:50.219931+0000","last_fullsized":"2023-08-18T20:45:50.219931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:34:11.385755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083950+0000","last_change":"2023-08-18T20:45:35.891246+0000","last_active":"2023-08-18T20:45:50.083950+0000","last_peered":"2023-08-18T20:45:50.083950+0000","last_clean":"2023-08-18T20:45:50.083950+0000","last_became_active":"2023-08-18T20:45:35.890993+0000","last_became_peered":"2023-08-18T20:45:35.890993+0000","last_unstale":"2023-08-18T20:45:50.083950+0000","last_undegraded":"2023-08-18T20:45:50.083950+0000","last_fullsized":"2023-08-18T20:45:50.083950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:16:51.270223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295009+0000","last_change":"2023-08-18T20:45:34.977145+0000","last_active":"2023-08-18T20:45:50.295009+0000","last_peered":"2023-08-18T20:45:50.295009+0000","last_clean":"2023-08-18T20:45:50.295009+0000","last_became_active":"2023-08-18T20:45:34.976889+0000","last_became_peered":"2023-08-18T20:45:34.976889+0000","last_unstale":"2023-08-18T20:45:50.295009+0000","last_undegraded":"2023-08-18T20:45:50.295009+0000","last_fullsized":"2023-08-18T20:45:50.295009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:15.017419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250791+0000","last_change":"2023-08-18T20:45:49.097091+0000","last_active":"2023-08-18T20:45:50.250791+0000","last_peered":"2023-08-18T20:45:50.250791+0000","last_clean":"2023-08-18T20:45:50.250791+0000","last_became_active":"2023-08-18T20:45:49.096825+0000","last_became_peered":"2023-08-18T20:45:49.096825+0000","last_unstale":"2023-08-18T20:45:50.250791+0000","last_undegraded":"2023-08-18T20:45:50.250791+0000","last_fullsized":"2023-08-18T20:45:50.250791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:13:21.448708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083942+0000","last_change":"2023-08-18T20:45:48.099311+0000","last_active":"2023-08-18T20:45:50.083942+0000","last_peered":"2023-08-18T20:45:50.083942+0000","last_clean":"2023-08-18T20:45:50.083942+0000","last_became_active":"2023-08-18T20:45:48.098996+0000","last_became_peered":"2023-08-18T20:45:48.098996+0000","last_unstale":"2023-08-18T20:45:50.083942+0000","last_undegraded":"2023-08-18T20:45:50.083942+0000","last_fullsized":"2023-08-18T20:45:50.083942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:25.615098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474736+0000","last_change":"2023-08-18T20:45:35.907867+0000","last_active":"2023-08-18T20:45:50.474736+0000","last_peered":"2023-08-18T20:45:50.474736+0000","last_clean":"2023-08-18T20:45:50.474736+0000","last_became_active":"2023-08-18T20:45:35.907577+0000","last_became_peered":"2023-08-18T20:45:35.907577+0000","last_unstale":"2023-08-18T20:45:50.474736+0000","last_undegraded":"2023-08-18T20:45:50.474736+0000","last_fullsized":"2023-08-18T20:45:50.474736+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:19.233819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295082+0000","last_change":"2023-08-18T20:45:34.976208+0000","last_active":"2023-08-18T20:45:50.295082+0000","last_peered":"2023-08-18T20:45:50.295082+0000","last_clean":"2023-08-18T20:45:50.295082+0000","last_became_active":"2023-08-18T20:45:34.975809+0000","last_became_peered":"2023-08-18T20:45:34.975809+0000","last_unstale":"2023-08-18T20:45:50.295082+0000","last_undegraded":"2023-08-18T20:45:50.295082+0000","last_fullsized":"2023-08-18T20:45:50.295082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:51:15.359929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220189+0000","last_change":"2023-08-18T20:45:49.106835+0000","last_active":"2023-08-18T20:45:50.220189+0000","last_peered":"2023-08-18T20:45:50.220189+0000","last_clean":"2023-08-18T20:45:50.220189+0000","last_became_active":"2023-08-18T20:45:49.106517+0000","last_became_peered":"2023-08-18T20:45:49.106517+0000","last_unstale":"2023-08-18T20:45:50.220189+0000","last_undegraded":"2023-08-18T20:45:50.220189+0000","last_fullsized":"2023-08-18T20:45:50.220189+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:05.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475902+0000","last_change":"2023-08-18T20:45:48.098856+0000","last_active":"2023-08-18T20:45:50.475902+0000","last_peered":"2023-08-18T20:45:50.475902+0000","last_clean":"2023-08-18T20:45:50.475902+0000","last_became_active":"2023-08-18T20:45:48.098540+0000","last_became_peered":"2023-08-18T20:45:48.098540+0000","last_unstale":"2023-08-18T20:45:50.475902+0000","last_undegraded":"2023-08-18T20:45:50.475902+0000","last_fullsized":"2023-08-18T20:45:50.475902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:46:22.839300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250091+0000","last_change":"2023-08-18T20:45:35.901449+0000","last_active":"2023-08-18T20:45:50.250091+0000","last_peered":"2023-08-18T20:45:50.250091+0000","last_clean":"2023-08-18T20:45:50.250091+0000","last_became_active":"2023-08-18T20:45:35.901106+0000","last_became_peered":"2023-08-18T20:45:35.901106+0000","last_unstale":"2023-08-18T20:45:50.250091+0000","last_undegraded":"2023-08-18T20:45:50.250091+0000","last_fullsized":"2023-08-18T20:45:50.250091+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:44:59.645343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294658+0000","last_change":"2023-08-18T20:45:34.977662+0000","last_active":"2023-08-18T20:45:50.294658+0000","last_peered":"2023-08-18T20:45:50.294658+0000","last_clean":"2023-08-18T20:45:50.294658+0000","last_became_active":"2023-08-18T20:45:34.977395+0000","last_became_peered":"2023-08-18T20:45:34.977395+0000","last_unstale":"2023-08-18T20:45:50.294658+0000","last_undegraded":"2023-08-18T20:45:50.294658+0000","last_fullsized":"2023-08-18T20:45:50.294658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:28:49.488764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220789+0000","last_change":"2023-08-18T20:45:49.112748+0000","last_active":"2023-08-18T20:45:50.220789+0000","last_peered":"2023-08-18T20:45:50.220789+0000","last_clean":"2023-08-18T20:45:50.220789+0000","last_became_active":"2023-08-18T20:45:49.112444+0000","last_became_peered":"2023-08-18T20:45:49.112444+0000","last_unstale":"2023-08-18T20:45:50.220789+0000","last_undegraded":"2023-08-18T20:45:50.220789+0000","last_fullsized":"2023-08-18T20:45:50.220789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:20:02.757611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085800+0000","last_change":"2023-08-18T20:45:48.094431+0000","last_active":"2023-08-18T20:45:50.085800+0000","last_peered":"2023-08-18T20:45:50.085800+0000","last_clean":"2023-08-18T20:45:50.085800+0000","last_became_active":"2023-08-18T20:45:48.094172+0000","last_became_peered":"2023-08-18T20:45:48.094172+0000","last_unstale":"2023-08-18T20:45:50.085800+0000","last_undegraded":"2023-08-18T20:45:50.085800+0000","last_fullsized":"2023-08-18T20:45:50.085800+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:55:40.675240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294910+0000","last_change":"2023-08-18T20:45:35.902649+0000","last_active":"2023-08-18T20:45:50.294910+0000","last_peered":"2023-08-18T20:45:50.294910+0000","last_clean":"2023-08-18T20:45:50.294910+0000","last_became_active":"2023-08-18T20:45:35.902336+0000","last_became_peered":"2023-08-18T20:45:35.902336+0000","last_unstale":"2023-08-18T20:45:50.294910+0000","last_undegraded":"2023-08-18T20:45:50.294910+0000","last_fullsized":"2023-08-18T20:45:50.294910+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:28:06.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250116+0000","last_change":"2023-08-18T20:45:34.974043+0000","last_active":"2023-08-18T20:45:50.250116+0000","last_peered":"2023-08-18T20:45:50.250116+0000","last_clean":"2023-08-18T20:45:50.250116+0000","last_became_active":"2023-08-18T20:45:34.973763+0000","last_became_peered":"2023-08-18T20:45:34.973763+0000","last_unstale":"2023-08-18T20:45:50.250116+0000","last_undegraded":"2023-08-18T20:45:50.250116+0000","last_fullsized":"2023-08-18T20:45:50.250116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:59.149839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294861+0000","last_change":"2023-08-18T20:45:49.099815+0000","last_active":"2023-08-18T20:45:50.294861+0000","last_peered":"2023-08-18T20:45:50.294861+0000","last_clean":"2023-08-18T20:45:50.294861+0000","last_became_active":"2023-08-18T20:45:49.099519+0000","last_became_peered":"2023-08-18T20:45:49.099519+0000","last_unstale":"2023-08-18T20:45:50.294861+0000","last_undegraded":"2023-08-18T20:45:50.294861+0000","last_fullsized":"2023-08-18T20:45:50.294861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:28:04.062016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"55'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084859+0000","last_change":"2023-08-18T20:45:48.097288+0000","last_active":"2023-08-18T20:45:50.084859+0000","last_peered":"2023-08-18T20:45:50.084859+0000","last_clean":"2023-08-18T20:45:50.084859+0000","last_became_active":"2023-08-18T20:45:48.095327+0000","last_became_peered":"2023-08-18T20:45:48.095327+0000","last_unstale":"2023-08-18T20:45:50.084859+0000","last_undegraded":"2023-08-18T20:45:50.084859+0000","last_fullsized":"2023-08-18T20:45:50.084859+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:16:04.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475003+0000","last_change":"2023-08-18T20:45:35.888678+0000","last_active":"2023-08-18T20:45:50.475003+0000","last_peered":"2023-08-18T20:45:50.475003+0000","last_clean":"2023-08-18T20:45:50.475003+0000","last_became_active":"2023-08-18T20:45:35.888415+0000","last_became_peered":"2023-08-18T20:45:35.888415+0000","last_unstale":"2023-08-18T20:45:50.475003+0000","last_undegraded":"2023-08-18T20:45:50.475003+0000","last_fullsized":"2023-08-18T20:45:50.475003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:03:26.507636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087421+0000","last_change":"2023-08-18T20:45:34.977639+0000","last_active":"2023-08-18T20:45:50.087421+0000","last_peered":"2023-08-18T20:45:50.087421+0000","last_clean":"2023-08-18T20:45:50.087421+0000","last_became_active":"2023-08-18T20:45:34.977299+0000","last_became_peered":"2023-08-18T20:45:34.977299+0000","last_unstale":"2023-08-18T20:45:50.087421+0000","last_undegraded":"2023-08-18T20:45:50.087421+0000","last_fullsized":"2023-08-18T20:45:50.087421+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:30.302588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475068+0000","last_change":"2023-08-18T20:45:49.117823+0000","last_active":"2023-08-18T20:45:50.475068+0000","last_peered":"2023-08-18T20:45:50.475068+0000","last_clean":"2023-08-18T20:45:50.475068+0000","last_became_active":"2023-08-18T20:45:49.117514+0000","last_became_peered":"2023-08-18T20:45:49.117514+0000","last_unstale":"2023-08-18T20:45:50.475068+0000","last_undegraded":"2023-08-18T20:45:50.475068+0000","last_fullsized":"2023-08-18T20:45:50.475068+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:54:16.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"55'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250899+0000","last_change":"2023-08-18T20:45:48.096185+0000","last_active":"2023-08-18T20:45:50.250899+0000","last_peered":"2023-08-18T20:45:50.250899+0000","last_clean":"2023-08-18T20:45:50.250899+0000","last_became_active":"2023-08-18T20:45:48.095929+0000","last_became_peered":"2023-08-18T20:45:48.095929+0000","last_unstale":"2023-08-18T20:45:50.250899+0000","last_undegraded":"2023-08-18T20:45:50.250899+0000","last_fullsized":"2023-08-18T20:45:50.250899+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:54:09.318242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294963+0000","last_change":"2023-08-18T20:45:35.903372+0000","last_active":"2023-08-18T20:45:50.294963+0000","last_peered":"2023-08-18T20:45:50.294963+0000","last_clean":"2023-08-18T20:45:50.294963+0000","last_became_active":"2023-08-18T20:45:35.903163+0000","last_became_peered":"2023-08-18T20:45:35.903163+0000","last_unstale":"2023-08-18T20:45:50.294963+0000","last_undegraded":"2023-08-18T20:45:50.294963+0000","last_fullsized":"2023-08-18T20:45:50.294963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:54:49.007390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476335+0000","last_change":"2023-08-18T20:45:34.965192+0000","last_active":"2023-08-18T20:45:50.476335+0000","last_peered":"2023-08-18T20:45:50.476335+0000","last_clean":"2023-08-18T20:45:50.476335+0000","last_became_active":"2023-08-18T20:45:34.964736+0000","last_became_peered":"2023-08-18T20:45:34.964736+0000","last_unstale":"2023-08-18T20:45:50.476335+0000","last_undegraded":"2023-08-18T20:45:50.476335+0000","last_fullsized":"2023-08-18T20:45:50.476335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:40.842282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220052+0000","last_change":"2023-08-18T20:45:49.106995+0000","last_active":"2023-08-18T20:45:50.220052+0000","last_peered":"2023-08-18T20:45:50.220052+0000","last_clean":"2023-08-18T20:45:50.220052+0000","last_became_active":"2023-08-18T20:45:49.106744+0000","last_became_peered":"2023-08-18T20:45:49.106744+0000","last_unstale":"2023-08-18T20:45:50.220052+0000","last_undegraded":"2023-08-18T20:45:50.220052+0000","last_fullsized":"2023-08-18T20:45:50.220052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:55.601013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087421+0000","last_change":"2023-08-18T20:45:48.100732+0000","last_active":"2023-08-18T20:45:50.087421+0000","last_peered":"2023-08-18T20:45:50.087421+0000","last_clean":"2023-08-18T20:45:50.087421+0000","last_became_active":"2023-08-18T20:45:48.100461+0000","last_became_peered":"2023-08-18T20:45:48.100461+0000","last_unstale":"2023-08-18T20:45:50.087421+0000","last_undegraded":"2023-08-18T20:45:50.087421+0000","last_fullsized":"2023-08-18T20:45:50.087421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:44.238945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250942+0000","last_change":"2023-08-18T20:45:35.905230+0000","last_active":"2023-08-18T20:45:50.250942+0000","last_peered":"2023-08-18T20:45:50.250942+0000","last_clean":"2023-08-18T20:45:50.250942+0000","last_became_active":"2023-08-18T20:45:35.904679+0000","last_became_peered":"2023-08-18T20:45:35.904679+0000","last_unstale":"2023-08-18T20:45:50.250942+0000","last_undegraded":"2023-08-18T20:45:50.250942+0000","last_fullsized":"2023-08-18T20:45:50.250942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:42.481956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"51'3","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087457+0000","last_change":"2023-08-18T20:45:34.977643+0000","last_active":"2023-08-18T20:45:50.087457+0000","last_peered":"2023-08-18T20:45:50.087457+0000","last_clean":"2023-08-18T20:45:50.087457+0000","last_became_active":"2023-08-18T20:45:34.977323+0000","last_became_peered":"2023-08-18T20:45:34.977323+0000","last_unstale":"2023-08-18T20:45:50.087457+0000","last_undegraded":"2023-08-18T20:45:50.087457+0000","last_fullsized":"2023-08-18T20:45:50.087457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:37.596930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085636+0000","last_change":"2023-08-18T20:45:49.102200+0000","last_active":"2023-08-18T20:45:50.085636+0000","last_peered":"2023-08-18T20:45:50.085636+0000","last_clean":"2023-08-18T20:45:50.085636+0000","last_became_active":"2023-08-18T20:45:49.101926+0000","last_became_peered":"2023-08-18T20:45:49.101926+0000","last_unstale":"2023-08-18T20:45:50.085636+0000","last_undegraded":"2023-08-18T20:45:50.085636+0000","last_fullsized":"2023-08-18T20:45:50.085636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:42:07.052522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086833+0000","last_change":"2023-08-18T20:45:48.096876+0000","last_active":"2023-08-18T20:45:50.086833+0000","last_peered":"2023-08-18T20:45:50.086833+0000","last_clean":"2023-08-18T20:45:50.086833+0000","last_became_active":"2023-08-18T20:45:48.096577+0000","last_became_peered":"2023-08-18T20:45:48.096577+0000","last_unstale":"2023-08-18T20:45:50.086833+0000","last_undegraded":"2023-08-18T20:45:50.086833+0000","last_fullsized":"2023-08-18T20:45:50.086833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:50:35.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476256+0000","last_change":"2023-08-18T20:45:35.907868+0000","last_active":"2023-08-18T20:45:50.476256+0000","last_peered":"2023-08-18T20:45:50.476256+0000","last_clean":"2023-08-18T20:45:50.476256+0000","last_became_active":"2023-08-18T20:45:35.907562+0000","last_became_peered":"2023-08-18T20:45:35.907562+0000","last_unstale":"2023-08-18T20:45:50.476256+0000","last_undegraded":"2023-08-18T20:45:50.476256+0000","last_fullsized":"2023-08-18T20:45:50.476256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:48:03.888126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"52'9","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474998+0000","last_change":"2023-08-18T20:45:34.967721+0000","last_active":"2023-08-18T20:45:50.474998+0000","last_peered":"2023-08-18T20:45:50.474998+0000","last_clean":"2023-08-18T20:45:50.474998+0000","last_became_active":"2023-08-18T20:45:34.967000+0000","last_became_peered":"2023-08-18T20:45:34.967000+0000","last_unstale":"2023-08-18T20:45:50.474998+0000","last_undegraded":"2023-08-18T20:45:50.474998+0000","last_fullsized":"2023-08-18T20:45:50.474998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:33:30.678774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250557+0000","last_change":"2023-08-18T20:45:49.108242+0000","last_active":"2023-08-18T20:45:50.250557+0000","last_peered":"2023-08-18T20:45:50.250557+0000","last_clean":"2023-08-18T20:45:50.250557+0000","last_became_active":"2023-08-18T20:45:49.107980+0000","last_became_peered":"2023-08-18T20:45:49.107980+0000","last_unstale":"2023-08-18T20:45:50.250557+0000","last_undegraded":"2023-08-18T20:45:50.250557+0000","last_fullsized":"2023-08-18T20:45:50.250557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:34:53.009014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083749+0000","last_change":"2023-08-18T20:45:48.096964+0000","last_active":"2023-08-18T20:45:50.083749+0000","last_peered":"2023-08-18T20:45:50.083749+0000","last_clean":"2023-08-18T20:45:50.083749+0000","last_became_active":"2023-08-18T20:45:48.096687+0000","last_became_peered":"2023-08-18T20:45:48.096687+0000","last_unstale":"2023-08-18T20:45:50.083749+0000","last_undegraded":"2023-08-18T20:45:50.083749+0000","last_fullsized":"2023-08-18T20:45:50.083749+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:22:17.896828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475247+0000","last_change":"2023-08-18T20:45:35.905432+0000","last_active":"2023-08-18T20:45:50.475247+0000","last_peered":"2023-08-18T20:45:50.475247+0000","last_clean":"2023-08-18T20:45:50.475247+0000","last_became_active":"2023-08-18T20:45:35.905124+0000","last_became_peered":"2023-08-18T20:45:35.905124+0000","last_unstale":"2023-08-18T20:45:50.475247+0000","last_undegraded":"2023-08-18T20:45:50.475247+0000","last_fullsized":"2023-08-18T20:45:50.475247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:19.233819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087499+0000","last_change":"2023-08-18T20:45:34.979922+0000","last_active":"2023-08-18T20:45:50.087499+0000","last_peered":"2023-08-18T20:45:50.087499+0000","last_clean":"2023-08-18T20:45:50.087499+0000","last_became_active":"2023-08-18T20:45:34.979663+0000","last_became_peered":"2023-08-18T20:45:34.979663+0000","last_unstale":"2023-08-18T20:45:50.087499+0000","last_undegraded":"2023-08-18T20:45:50.087499+0000","last_fullsized":"2023-08-18T20:45:50.087499+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:03.595891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251024+0000","last_change":"2023-08-18T20:45:49.093062+0000","last_active":"2023-08-18T20:45:50.251024+0000","last_peered":"2023-08-18T20:45:50.251024+0000","last_clean":"2023-08-18T20:45:50.251024+0000","last_became_active":"2023-08-18T20:45:49.092763+0000","last_became_peered":"2023-08-18T20:45:49.092763+0000","last_unstale":"2023-08-18T20:45:50.251024+0000","last_undegraded":"2023-08-18T20:45:50.251024+0000","last_fullsized":"2023-08-18T20:45:50.251024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:19:42.006590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"55'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220013+0000","last_change":"2023-08-18T20:45:48.102117+0000","last_active":"2023-08-18T20:45:50.220013+0000","last_peered":"2023-08-18T20:45:50.220013+0000","last_clean":"2023-08-18T20:45:50.220013+0000","last_became_active":"2023-08-18T20:45:48.101829+0000","last_became_peered":"2023-08-18T20:45:48.101829+0000","last_unstale":"2023-08-18T20:45:50.220013+0000","last_undegraded":"2023-08-18T20:45:50.220013+0000","last_fullsized":"2023-08-18T20:45:50.220013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085179+0000","last_change":"2023-08-18T20:45:35.905734+0000","last_active":"2023-08-18T20:45:50.085179+0000","last_peered":"2023-08-18T20:45:50.085179+0000","last_clean":"2023-08-18T20:45:50.085179+0000","last_became_active":"2023-08-18T20:45:35.903295+0000","last_became_peered":"2023-08-18T20:45:35.903295+0000","last_unstale":"2023-08-18T20:45:50.085179+0000","last_undegraded":"2023-08-18T20:45:50.085179+0000","last_fullsized":"2023-08-18T20:45:50.085179+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:42.481956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085414+0000","last_change":"2023-08-18T20:45:34.976533+0000","last_active":"2023-08-18T20:45:50.085414+0000","last_peered":"2023-08-18T20:45:50.085414+0000","last_clean":"2023-08-18T20:45:50.085414+0000","last_became_active":"2023-08-18T20:45:34.975963+0000","last_became_peered":"2023-08-18T20:45:34.975963+0000","last_unstale":"2023-08-18T20:45:50.085414+0000","last_undegraded":"2023-08-18T20:45:50.085414+0000","last_fullsized":"2023-08-18T20:45:50.085414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:28.998973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086469+0000","last_change":"2023-08-18T20:45:49.107232+0000","last_active":"2023-08-18T20:45:50.086469+0000","last_peered":"2023-08-18T20:45:50.086469+0000","last_clean":"2023-08-18T20:45:50.086469+0000","last_became_active":"2023-08-18T20:45:49.106955+0000","last_became_peered":"2023-08-18T20:45:49.106955+0000","last_unstale":"2023-08-18T20:45:50.086469+0000","last_undegraded":"2023-08-18T20:45:50.086469+0000","last_fullsized":"2023-08-18T20:45:50.086469+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:37.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085348+0000","last_change":"2023-08-18T20:45:48.099995+0000","last_active":"2023-08-18T20:45:50.085348+0000","last_peered":"2023-08-18T20:45:50.085348+0000","last_clean":"2023-08-18T20:45:50.085348+0000","last_became_active":"2023-08-18T20:45:48.099720+0000","last_became_peered":"2023-08-18T20:45:48.099720+0000","last_unstale":"2023-08-18T20:45:50.085348+0000","last_undegraded":"2023-08-18T20:45:50.085348+0000","last_fullsized":"2023-08-18T20:45:50.085348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250160+0000","last_change":"2023-08-18T20:45:35.901127+0000","last_active":"2023-08-18T20:45:50.250160+0000","last_peered":"2023-08-18T20:45:50.250160+0000","last_clean":"2023-08-18T20:45:50.250160+0000","last_became_active":"2023-08-18T20:45:35.900148+0000","last_became_peered":"2023-08-18T20:45:35.900148+0000","last_unstale":"2023-08-18T20:45:50.250160+0000","last_undegraded":"2023-08-18T20:45:50.250160+0000","last_fullsized":"2023-08-18T20:45:50.250160+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:48:03.888126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086274+0000","last_change":"2023-08-18T20:45:34.978720+0000","last_active":"2023-08-18T20:45:50.086274+0000","last_peered":"2023-08-18T20:45:50.086274+0000","last_clean":"2023-08-18T20:45:50.086274+0000","last_became_active":"2023-08-18T20:45:34.978408+0000","last_became_peered":"2023-08-18T20:45:34.978408+0000","last_unstale":"2023-08-18T20:45:50.086274+0000","last_undegraded":"2023-08-18T20:45:50.086274+0000","last_fullsized":"2023-08-18T20:45:50.086274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:30:09.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250812+0000","last_change":"2023-08-18T20:45:49.099417+0000","last_active":"2023-08-18T20:45:50.250812+0000","last_peered":"2023-08-18T20:45:50.250812+0000","last_clean":"2023-08-18T20:45:50.250812+0000","last_became_active":"2023-08-18T20:45:49.099130+0000","last_became_peered":"2023-08-18T20:45:49.099130+0000","last_unstale":"2023-08-18T20:45:50.250812+0000","last_undegraded":"2023-08-18T20:45:50.250812+0000","last_fullsized":"2023-08-18T20:45:50.250812+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:43:47.967029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086472+0000","last_change":"2023-08-18T20:45:48.104030+0000","last_active":"2023-08-18T20:45:50.086472+0000","last_peered":"2023-08-18T20:45:50.086472+0000","last_clean":"2023-08-18T20:45:50.086472+0000","last_became_active":"2023-08-18T20:45:48.103769+0000","last_became_peered":"2023-08-18T20:45:48.103769+0000","last_unstale":"2023-08-18T20:45:50.086472+0000","last_undegraded":"2023-08-18T20:45:50.086472+0000","last_fullsized":"2023-08-18T20:45:50.086472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:04.480711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474879+0000","last_change":"2023-08-18T20:45:35.904813+0000","last_active":"2023-08-18T20:45:50.474879+0000","last_peered":"2023-08-18T20:45:50.474879+0000","last_clean":"2023-08-18T20:45:50.474879+0000","last_became_active":"2023-08-18T20:45:35.904395+0000","last_became_peered":"2023-08-18T20:45:35.904395+0000","last_unstale":"2023-08-18T20:45:50.474879+0000","last_undegraded":"2023-08-18T20:45:50.474879+0000","last_fullsized":"2023-08-18T20:45:50.474879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:31:28.984964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"51'8","reported_seq":29,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475357+0000","last_change":"2023-08-18T20:45:34.973681+0000","last_active":"2023-08-18T20:45:50.475357+0000","last_peered":"2023-08-18T20:45:50.475357+0000","last_clean":"2023-08-18T20:45:50.475357+0000","last_became_active":"2023-08-18T20:45:34.973398+0000","last_became_peered":"2023-08-18T20:45:34.973398+0000","last_unstale":"2023-08-18T20:45:50.475357+0000","last_undegraded":"2023-08-18T20:45:50.475357+0000","last_fullsized":"2023-08-18T20:45:50.475357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:55:56.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475534+0000","last_change":"2023-08-18T20:45:49.111615+0000","last_active":"2023-08-18T20:45:50.475534+0000","last_peered":"2023-08-18T20:45:50.475534+0000","last_clean":"2023-08-18T20:45:50.475534+0000","last_became_active":"2023-08-18T20:45:49.111310+0000","last_became_peered":"2023-08-18T20:45:49.111310+0000","last_unstale":"2023-08-18T20:45:50.475534+0000","last_undegraded":"2023-08-18T20:45:50.475534+0000","last_fullsized":"2023-08-18T20:45:50.475534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:31:42.104021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087345+0000","last_change":"2023-08-18T20:45:48.099054+0000","last_active":"2023-08-18T20:45:50.087345+0000","last_peered":"2023-08-18T20:45:50.087345+0000","last_clean":"2023-08-18T20:45:50.087345+0000","last_became_active":"2023-08-18T20:45:48.098788+0000","last_became_peered":"2023-08-18T20:45:48.098788+0000","last_unstale":"2023-08-18T20:45:50.087345+0000","last_undegraded":"2023-08-18T20:45:50.087345+0000","last_fullsized":"2023-08-18T20:45:50.087345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:14.591791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220376+0000","last_change":"2023-08-18T20:45:35.907903+0000","last_active":"2023-08-18T20:45:50.220376+0000","last_peered":"2023-08-18T20:45:50.220376+0000","last_clean":"2023-08-18T20:45:50.220376+0000","last_became_active":"2023-08-18T20:45:35.907569+0000","last_became_peered":"2023-08-18T20:45:35.907569+0000","last_unstale":"2023-08-18T20:45:50.220376+0000","last_undegraded":"2023-08-18T20:45:50.220376+0000","last_fullsized":"2023-08-18T20:45:50.220376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:48.224775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086731+0000","last_change":"2023-08-18T20:45:34.978323+0000","last_active":"2023-08-18T20:45:50.086731+0000","last_peered":"2023-08-18T20:45:50.086731+0000","last_clean":"2023-08-18T20:45:50.086731+0000","last_became_active":"2023-08-18T20:45:34.978045+0000","last_became_peered":"2023-08-18T20:45:34.978045+0000","last_unstale":"2023-08-18T20:45:50.086731+0000","last_undegraded":"2023-08-18T20:45:50.086731+0000","last_fullsized":"2023-08-18T20:45:50.086731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:22.200601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220245+0000","last_change":"2023-08-18T20:45:49.108898+0000","last_active":"2023-08-18T20:45:50.220245+0000","last_peered":"2023-08-18T20:45:50.220245+0000","last_clean":"2023-08-18T20:45:50.220245+0000","last_became_active":"2023-08-18T20:45:49.108625+0000","last_became_peered":"2023-08-18T20:45:49.108625+0000","last_unstale":"2023-08-18T20:45:50.220245+0000","last_undegraded":"2023-08-18T20:45:50.220245+0000","last_fullsized":"2023-08-18T20:45:50.220245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:02:10.855415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087101+0000","last_change":"2023-08-18T20:45:48.100079+0000","last_active":"2023-08-18T20:45:50.087101+0000","last_peered":"2023-08-18T20:45:50.087101+0000","last_clean":"2023-08-18T20:45:50.087101+0000","last_became_active":"2023-08-18T20:45:48.099791+0000","last_became_peered":"2023-08-18T20:45:48.099791+0000","last_unstale":"2023-08-18T20:45:50.087101+0000","last_undegraded":"2023-08-18T20:45:50.087101+0000","last_fullsized":"2023-08-18T20:45:50.087101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:56:45.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085058+0000","last_change":"2023-08-18T20:45:35.900572+0000","last_active":"2023-08-18T20:45:50.085058+0000","last_peered":"2023-08-18T20:45:50.085058+0000","last_clean":"2023-08-18T20:45:50.085058+0000","last_became_active":"2023-08-18T20:45:35.900283+0000","last_became_peered":"2023-08-18T20:45:35.900283+0000","last_unstale":"2023-08-18T20:45:50.085058+0000","last_undegraded":"2023-08-18T20:45:50.085058+0000","last_fullsized":"2023-08-18T20:45:50.085058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:18.764268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"52'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086888+0000","last_change":"2023-08-18T20:45:34.976456+0000","last_active":"2023-08-18T20:45:50.086888+0000","last_peered":"2023-08-18T20:45:50.086888+0000","last_clean":"2023-08-18T20:45:50.086888+0000","last_became_active":"2023-08-18T20:45:34.976025+0000","last_became_peered":"2023-08-18T20:45:34.976025+0000","last_unstale":"2023-08-18T20:45:50.086888+0000","last_undegraded":"2023-08-18T20:45:50.086888+0000","last_fullsized":"2023-08-18T20:45:50.086888+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:22.093838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475239+0000","last_change":"2023-08-18T20:45:49.107952+0000","last_active":"2023-08-18T20:45:50.475239+0000","last_peered":"2023-08-18T20:45:50.475239+0000","last_clean":"2023-08-18T20:45:50.475239+0000","last_became_active":"2023-08-18T20:45:49.107330+0000","last_became_peered":"2023-08-18T20:45:49.107330+0000","last_unstale":"2023-08-18T20:45:50.475239+0000","last_undegraded":"2023-08-18T20:45:50.475239+0000","last_fullsized":"2023-08-18T20:45:50.475239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:23:31.185569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086562+0000","last_change":"2023-08-18T20:45:48.098058+0000","last_active":"2023-08-18T20:45:50.086562+0000","last_peered":"2023-08-18T20:45:50.086562+0000","last_clean":"2023-08-18T20:45:50.086562+0000","last_became_active":"2023-08-18T20:45:48.097827+0000","last_became_peered":"2023-08-18T20:45:48.097827+0000","last_unstale":"2023-08-18T20:45:50.086562+0000","last_undegraded":"2023-08-18T20:45:50.086562+0000","last_fullsized":"2023-08-18T20:45:50.086562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:20:14.773116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086774+0000","last_change":"2023-08-18T20:45:35.903676+0000","last_active":"2023-08-18T20:45:50.086774+0000","last_peered":"2023-08-18T20:45:50.086774+0000","last_clean":"2023-08-18T20:45:50.086774+0000","last_became_active":"2023-08-18T20:45:35.902862+0000","last_became_peered":"2023-08-18T20:45:35.902862+0000","last_unstale":"2023-08-18T20:45:50.086774+0000","last_undegraded":"2023-08-18T20:45:50.086774+0000","last_fullsized":"2023-08-18T20:45:50.086774+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:52:16.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220423+0000","last_change":"2023-08-18T20:45:34.972345+0000","last_active":"2023-08-18T20:45:50.220423+0000","last_peered":"2023-08-18T20:45:50.220423+0000","last_clean":"2023-08-18T20:45:50.220423+0000","last_became_active":"2023-08-18T20:45:34.971833+0000","last_became_peered":"2023-08-18T20:45:34.971833+0000","last_unstale":"2023-08-18T20:45:50.220423+0000","last_undegraded":"2023-08-18T20:45:50.220423+0000","last_fullsized":"2023-08-18T20:45:50.220423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:53:53.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250169+0000","last_change":"2023-08-18T20:45:49.100112+0000","last_active":"2023-08-18T20:45:50.250169+0000","last_peered":"2023-08-18T20:45:50.250169+0000","last_clean":"2023-08-18T20:45:50.250169+0000","last_became_active":"2023-08-18T20:45:49.099827+0000","last_became_peered":"2023-08-18T20:45:49.099827+0000","last_unstale":"2023-08-18T20:45:50.250169+0000","last_undegraded":"2023-08-18T20:45:50.250169+0000","last_fullsized":"2023-08-18T20:45:50.250169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:49.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220595+0000","last_change":"2023-08-18T20:45:48.104128+0000","last_active":"2023-08-18T20:45:50.220595+0000","last_peered":"2023-08-18T20:45:50.220595+0000","last_clean":"2023-08-18T20:45:50.220595+0000","last_became_active":"2023-08-18T20:45:48.103849+0000","last_became_peered":"2023-08-18T20:45:48.103849+0000","last_unstale":"2023-08-18T20:45:50.220595+0000","last_undegraded":"2023-08-18T20:45:50.220595+0000","last_fullsized":"2023-08-18T20:45:50.220595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:35.322510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250941+0000","last_change":"2023-08-18T20:45:35.898724+0000","last_active":"2023-08-18T20:45:50.250941+0000","last_peered":"2023-08-18T20:45:50.250941+0000","last_clean":"2023-08-18T20:45:50.250941+0000","last_became_active":"2023-08-18T20:45:35.898443+0000","last_became_peered":"2023-08-18T20:45:35.898443+0000","last_unstale":"2023-08-18T20:45:50.250941+0000","last_undegraded":"2023-08-18T20:45:50.250941+0000","last_fullsized":"2023-08-18T20:45:50.250941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:41:53.933466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474882+0000","last_change":"2023-08-18T20:45:34.967849+0000","last_active":"2023-08-18T20:45:50.474882+0000","last_peered":"2023-08-18T20:45:50.474882+0000","last_clean":"2023-08-18T20:45:50.474882+0000","last_became_active":"2023-08-18T20:45:34.967588+0000","last_became_peered":"2023-08-18T20:45:34.967588+0000","last_unstale":"2023-08-18T20:45:50.474882+0000","last_undegraded":"2023-08-18T20:45:50.474882+0000","last_fullsized":"2023-08-18T20:45:50.474882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:34:02.953170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475277+0000","last_change":"2023-08-18T20:45:49.102492+0000","last_active":"2023-08-18T20:45:50.475277+0000","last_peered":"2023-08-18T20:45:50.475277+0000","last_clean":"2023-08-18T20:45:50.475277+0000","last_became_active":"2023-08-18T20:45:49.102141+0000","last_became_peered":"2023-08-18T20:45:49.102141+0000","last_unstale":"2023-08-18T20:45:50.475277+0000","last_undegraded":"2023-08-18T20:45:50.475277+0000","last_fullsized":"2023-08-18T20:45:50.475277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:58:46.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250611+0000","last_change":"2023-08-18T20:45:48.091171+0000","last_active":"2023-08-18T20:45:50.250611+0000","last_peered":"2023-08-18T20:45:50.250611+0000","last_clean":"2023-08-18T20:45:50.250611+0000","last_became_active":"2023-08-18T20:45:48.090499+0000","last_became_peered":"2023-08-18T20:45:48.090499+0000","last_unstale":"2023-08-18T20:45:50.250611+0000","last_undegraded":"2023-08-18T20:45:50.250611+0000","last_fullsized":"2023-08-18T20:45:50.250611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:56:06.440689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250101+0000","last_change":"2023-08-18T20:45:35.897819+0000","last_active":"2023-08-18T20:45:50.250101+0000","last_peered":"2023-08-18T20:45:50.250101+0000","last_clean":"2023-08-18T20:45:50.250101+0000","last_became_active":"2023-08-18T20:45:35.897534+0000","last_became_peered":"2023-08-18T20:45:35.897534+0000","last_unstale":"2023-08-18T20:45:50.250101+0000","last_undegraded":"2023-08-18T20:45:50.250101+0000","last_fullsized":"2023-08-18T20:45:50.250101+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:06.165927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087634+0000","last_change":"2023-08-18T20:45:34.979956+0000","last_active":"2023-08-18T20:45:50.087634+0000","last_peered":"2023-08-18T20:45:50.087634+0000","last_clean":"2023-08-18T20:45:50.087634+0000","last_became_active":"2023-08-18T20:45:34.979674+0000","last_became_peered":"2023-08-18T20:45:34.979674+0000","last_unstale":"2023-08-18T20:45:50.087634+0000","last_undegraded":"2023-08-18T20:45:50.087634+0000","last_fullsized":"2023-08-18T20:45:50.087634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:38:43.424408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475328+0000","last_change":"2023-08-18T20:45:49.102682+0000","last_active":"2023-08-18T20:45:50.475328+0000","last_peered":"2023-08-18T20:45:50.475328+0000","last_clean":"2023-08-18T20:45:50.475328+0000","last_became_active":"2023-08-18T20:45:49.102234+0000","last_became_peered":"2023-08-18T20:45:49.102234+0000","last_unstale":"2023-08-18T20:45:50.475328+0000","last_undegraded":"2023-08-18T20:45:50.475328+0000","last_fullsized":"2023-08-18T20:45:50.475328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:41.464763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474598+0000","last_change":"2023-08-18T20:45:48.091909+0000","last_active":"2023-08-18T20:45:50.474598+0000","last_peered":"2023-08-18T20:45:50.474598+0000","last_clean":"2023-08-18T20:45:50.474598+0000","last_became_active":"2023-08-18T20:45:48.091657+0000","last_became_peered":"2023-08-18T20:45:48.091657+0000","last_unstale":"2023-08-18T20:45:50.474598+0000","last_undegraded":"2023-08-18T20:45:50.474598+0000","last_fullsized":"2023-08-18T20:45:50.474598+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:31:57.749029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475467+0000","last_change":"2023-08-18T20:45:35.905583+0000","last_active":"2023-08-18T20:45:50.475467+0000","last_peered":"2023-08-18T20:45:50.475467+0000","last_clean":"2023-08-18T20:45:50.475467+0000","last_became_active":"2023-08-18T20:45:35.905306+0000","last_became_peered":"2023-08-18T20:45:35.905306+0000","last_unstale":"2023-08-18T20:45:50.475467+0000","last_undegraded":"2023-08-18T20:45:50.475467+0000","last_fullsized":"2023-08-18T20:45:50.475467+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:33:31.685321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294944+0000","last_change":"2023-08-18T20:45:34.976273+0000","last_active":"2023-08-18T20:45:50.294944+0000","last_peered":"2023-08-18T20:45:50.294944+0000","last_clean":"2023-08-18T20:45:50.294944+0000","last_became_active":"2023-08-18T20:45:34.975767+0000","last_became_peered":"2023-08-18T20:45:34.975767+0000","last_unstale":"2023-08-18T20:45:50.294944+0000","last_undegraded":"2023-08-18T20:45:50.294944+0000","last_fullsized":"2023-08-18T20:45:50.294944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:50:26.231804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250681+0000","last_change":"2023-08-18T20:45:49.093195+0000","last_active":"2023-08-18T20:45:50.250681+0000","last_peered":"2023-08-18T20:45:50.250681+0000","last_clean":"2023-08-18T20:45:50.250681+0000","last_became_active":"2023-08-18T20:45:49.092909+0000","last_became_peered":"2023-08-18T20:45:49.092909+0000","last_unstale":"2023-08-18T20:45:50.250681+0000","last_undegraded":"2023-08-18T20:45:50.250681+0000","last_fullsized":"2023-08-18T20:45:50.250681+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:00.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250704+0000","last_change":"2023-08-18T20:45:48.096855+0000","last_active":"2023-08-18T20:45:50.250704+0000","last_peered":"2023-08-18T20:45:50.250704+0000","last_clean":"2023-08-18T20:45:50.250704+0000","last_became_active":"2023-08-18T20:45:48.096595+0000","last_became_peered":"2023-08-18T20:45:48.096595+0000","last_unstale":"2023-08-18T20:45:50.250704+0000","last_undegraded":"2023-08-18T20:45:50.250704+0000","last_fullsized":"2023-08-18T20:45:50.250704+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:33:49.552446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474802+0000","last_change":"2023-08-18T20:45:35.902727+0000","last_active":"2023-08-18T20:45:50.474802+0000","last_peered":"2023-08-18T20:45:50.474802+0000","last_clean":"2023-08-18T20:45:50.474802+0000","last_became_active":"2023-08-18T20:45:35.902454+0000","last_became_peered":"2023-08-18T20:45:35.902454+0000","last_unstale":"2023-08-18T20:45:50.474802+0000","last_undegraded":"2023-08-18T20:45:50.474802+0000","last_fullsized":"2023-08-18T20:45:50.474802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:35:16.773417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294607+0000","last_change":"2023-08-18T20:45:34.977507+0000","last_active":"2023-08-18T20:45:50.294607+0000","last_peered":"2023-08-18T20:45:50.294607+0000","last_clean":"2023-08-18T20:45:50.294607+0000","last_became_active":"2023-08-18T20:45:34.977042+0000","last_became_peered":"2023-08-18T20:45:34.977042+0000","last_unstale":"2023-08-18T20:45:50.294607+0000","last_undegraded":"2023-08-18T20:45:50.294607+0000","last_fullsized":"2023-08-18T20:45:50.294607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:13:41.724053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250410+0000","last_change":"2023-08-18T20:45:49.096842+0000","last_active":"2023-08-18T20:45:50.250410+0000","last_peered":"2023-08-18T20:45:50.250410+0000","last_clean":"2023-08-18T20:45:50.250410+0000","last_became_active":"2023-08-18T20:45:49.096559+0000","last_became_peered":"2023-08-18T20:45:49.096559+0000","last_unstale":"2023-08-18T20:45:50.250410+0000","last_undegraded":"2023-08-18T20:45:50.250410+0000","last_fullsized":"2023-08-18T20:45:50.250410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:01:24.061777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083780+0000","last_change":"2023-08-18T20:45:48.100547+0000","last_active":"2023-08-18T20:45:50.083780+0000","last_peered":"2023-08-18T20:45:50.083780+0000","last_clean":"2023-08-18T20:45:50.083780+0000","last_became_active":"2023-08-18T20:45:48.100239+0000","last_became_peered":"2023-08-18T20:45:48.100239+0000","last_unstale":"2023-08-18T20:45:50.083780+0000","last_undegraded":"2023-08-18T20:45:50.083780+0000","last_fullsized":"2023-08-18T20:45:50.083780+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:04:40.336594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084039+0000","last_change":"2023-08-18T20:45:35.904814+0000","last_active":"2023-08-18T20:45:50.084039+0000","last_peered":"2023-08-18T20:45:50.084039+0000","last_clean":"2023-08-18T20:45:50.084039+0000","last_became_active":"2023-08-18T20:45:35.904550+0000","last_became_peered":"2023-08-18T20:45:35.904550+0000","last_unstale":"2023-08-18T20:45:50.084039+0000","last_undegraded":"2023-08-18T20:45:50.084039+0000","last_fullsized":"2023-08-18T20:45:50.084039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:03:07.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474686+0000","last_change":"2023-08-18T20:45:34.973010+0000","last_active":"2023-08-18T20:45:50.474686+0000","last_peered":"2023-08-18T20:45:50.474686+0000","last_clean":"2023-08-18T20:45:50.474686+0000","last_became_active":"2023-08-18T20:45:34.972735+0000","last_became_peered":"2023-08-18T20:45:34.972735+0000","last_unstale":"2023-08-18T20:45:50.474686+0000","last_undegraded":"2023-08-18T20:45:50.474686+0000","last_fullsized":"2023-08-18T20:45:50.474686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:25.564444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083745+0000","last_change":"2023-08-18T20:45:49.101885+0000","last_active":"2023-08-18T20:45:50.083745+0000","last_peered":"2023-08-18T20:45:50.083745+0000","last_clean":"2023-08-18T20:45:50.083745+0000","last_became_active":"2023-08-18T20:45:49.101609+0000","last_became_peered":"2023-08-18T20:45:49.101609+0000","last_unstale":"2023-08-18T20:45:50.083745+0000","last_undegraded":"2023-08-18T20:45:50.083745+0000","last_fullsized":"2023-08-18T20:45:50.083745+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:45:50.918567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084718+0000","last_change":"2023-08-18T20:45:48.095569+0000","last_active":"2023-08-18T20:45:50.084718+0000","last_peered":"2023-08-18T20:45:50.084718+0000","last_clean":"2023-08-18T20:45:50.084718+0000","last_became_active":"2023-08-18T20:45:48.095017+0000","last_became_peered":"2023-08-18T20:45:48.095017+0000","last_unstale":"2023-08-18T20:45:50.084718+0000","last_undegraded":"2023-08-18T20:45:50.084718+0000","last_fullsized":"2023-08-18T20:45:50.084718+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:22.082008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087191+0000","last_change":"2023-08-18T20:45:35.910372+0000","last_active":"2023-08-18T20:45:50.087191+0000","last_peered":"2023-08-18T20:45:50.087191+0000","last_clean":"2023-08-18T20:45:50.087191+0000","last_became_active":"2023-08-18T20:45:35.907965+0000","last_became_peered":"2023-08-18T20:45:35.907965+0000","last_unstale":"2023-08-18T20:45:50.087191+0000","last_undegraded":"2023-08-18T20:45:50.087191+0000","last_fullsized":"2023-08-18T20:45:50.087191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:29:32.362055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086676+0000","last_change":"2023-08-18T20:45:34.976242+0000","last_active":"2023-08-18T20:45:50.086676+0000","last_peered":"2023-08-18T20:45:50.086676+0000","last_clean":"2023-08-18T20:45:50.086676+0000","last_became_active":"2023-08-18T20:45:34.975953+0000","last_became_peered":"2023-08-18T20:45:34.975953+0000","last_unstale":"2023-08-18T20:45:50.086676+0000","last_undegraded":"2023-08-18T20:45:50.086676+0000","last_fullsized":"2023-08-18T20:45:50.086676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:25:18.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250834+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:45:50.250834+0000","last_peered":"2023-08-18T20:45:50.250834+0000","last_clean":"2023-08-18T20:45:50.250834+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:45:50.250834+0000","last_undegraded":"2023-08-18T20:45:50.250834+0000","last_fullsized":"2023-08-18T20:45:50.250834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:58:23.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294821+0000","last_change":"2023-08-18T20:45:49.103360+0000","last_active":"2023-08-18T20:45:50.294821+0000","last_peered":"2023-08-18T20:45:50.294821+0000","last_clean":"2023-08-18T20:45:50.294821+0000","last_became_active":"2023-08-18T20:45:49.103059+0000","last_became_peered":"2023-08-18T20:45:49.103059+0000","last_unstale":"2023-08-18T20:45:50.294821+0000","last_undegraded":"2023-08-18T20:45:50.294821+0000","last_fullsized":"2023-08-18T20:45:50.294821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:49:34.858707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474829+0000","last_change":"2023-08-18T20:45:48.094558+0000","last_active":"2023-08-18T20:45:50.474829+0000","last_peered":"2023-08-18T20:45:50.474829+0000","last_clean":"2023-08-18T20:45:50.474829+0000","last_became_active":"2023-08-18T20:45:48.094090+0000","last_became_peered":"2023-08-18T20:45:48.094090+0000","last_unstale":"2023-08-18T20:45:50.474829+0000","last_undegraded":"2023-08-18T20:45:50.474829+0000","last_fullsized":"2023-08-18T20:45:50.474829+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:17.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250882+0000","last_change":"2023-08-18T20:45:35.907483+0000","last_active":"2023-08-18T20:45:50.250882+0000","last_peered":"2023-08-18T20:45:50.250882+0000","last_clean":"2023-08-18T20:45:50.250882+0000","last_became_active":"2023-08-18T20:45:35.906686+0000","last_became_peered":"2023-08-18T20:45:35.906686+0000","last_unstale":"2023-08-18T20:45:50.250882+0000","last_undegraded":"2023-08-18T20:45:50.250882+0000","last_fullsized":"2023-08-18T20:45:50.250882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:37.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087817+0000","last_change":"2023-08-18T20:45:34.978091+0000","last_active":"2023-08-18T20:45:50.087817+0000","last_peered":"2023-08-18T20:45:50.087817+0000","last_clean":"2023-08-18T20:45:50.087817+0000","last_became_active":"2023-08-18T20:45:34.977812+0000","last_became_peered":"2023-08-18T20:45:34.977812+0000","last_unstale":"2023-08-18T20:45:50.087817+0000","last_undegraded":"2023-08-18T20:45:50.087817+0000","last_fullsized":"2023-08-18T20:45:50.087817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.923345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250942+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:45:50.250942+0000","last_peered":"2023-08-18T20:45:50.250942+0000","last_clean":"2023-08-18T20:45:50.250942+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:45:50.250942+0000","last_undegraded":"2023-08-18T20:45:50.250942+0000","last_fullsized":"2023-08-18T20:45:50.250942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:44:17.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220517+0000","last_change":"2023-08-18T20:45:49.107055+0000","last_active":"2023-08-18T20:45:50.220517+0000","last_peered":"2023-08-18T20:45:50.220517+0000","last_clean":"2023-08-18T20:45:50.220517+0000","last_became_active":"2023-08-18T20:45:49.106793+0000","last_became_peered":"2023-08-18T20:45:49.106793+0000","last_unstale":"2023-08-18T20:45:50.220517+0000","last_undegraded":"2023-08-18T20:45:50.220517+0000","last_fullsized":"2023-08-18T20:45:50.220517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:20.528110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294917+0000","last_change":"2023-08-18T20:45:48.098230+0000","last_active":"2023-08-18T20:45:50.294917+0000","last_peered":"2023-08-18T20:45:50.294917+0000","last_clean":"2023-08-18T20:45:50.294917+0000","last_became_active":"2023-08-18T20:45:48.097967+0000","last_became_peered":"2023-08-18T20:45:48.097967+0000","last_unstale":"2023-08-18T20:45:50.294917+0000","last_undegraded":"2023-08-18T20:45:50.294917+0000","last_fullsized":"2023-08-18T20:45:50.294917+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:03:41.873552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250296+0000","last_change":"2023-08-18T20:45:35.901362+0000","last_active":"2023-08-18T20:45:50.250296+0000","last_peered":"2023-08-18T20:45:50.250296+0000","last_clean":"2023-08-18T20:45:50.250296+0000","last_became_active":"2023-08-18T20:45:35.900540+0000","last_became_peered":"2023-08-18T20:45:35.900540+0000","last_unstale":"2023-08-18T20:45:50.250296+0000","last_undegraded":"2023-08-18T20:45:50.250296+0000","last_fullsized":"2023-08-18T20:45:50.250296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:28.907738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220410+0000","last_change":"2023-08-18T20:45:34.974454+0000","last_active":"2023-08-18T20:45:50.220410+0000","last_peered":"2023-08-18T20:45:50.220410+0000","last_clean":"2023-08-18T20:45:50.220410+0000","last_became_active":"2023-08-18T20:45:34.974193+0000","last_became_peered":"2023-08-18T20:45:34.974193+0000","last_unstale":"2023-08-18T20:45:50.220410+0000","last_undegraded":"2023-08-18T20:45:50.220410+0000","last_fullsized":"2023-08-18T20:45:50.220410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:20:01.651207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085572+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:45:50.085572+0000","last_peered":"2023-08-18T20:45:50.085572+0000","last_clean":"2023-08-18T20:45:50.085572+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:45:50.085572+0000","last_undegraded":"2023-08-18T20:45:50.085572+0000","last_fullsized":"2023-08-18T20:45:50.085572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:34:29.107120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087192+0000","last_change":"2023-08-18T20:45:49.102167+0000","last_active":"2023-08-18T20:45:50.087192+0000","last_peered":"2023-08-18T20:45:50.087192+0000","last_clean":"2023-08-18T20:45:50.087192+0000","last_became_active":"2023-08-18T20:45:49.101893+0000","last_became_peered":"2023-08-18T20:45:49.101893+0000","last_unstale":"2023-08-18T20:45:50.087192+0000","last_undegraded":"2023-08-18T20:45:50.087192+0000","last_fullsized":"2023-08-18T20:45:50.087192+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:06:15.693695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295178+0000","last_change":"2023-08-18T20:45:48.092956+0000","last_active":"2023-08-18T20:45:50.295178+0000","last_peered":"2023-08-18T20:45:50.295178+0000","last_clean":"2023-08-18T20:45:50.295178+0000","last_became_active":"2023-08-18T20:45:48.092647+0000","last_became_peered":"2023-08-18T20:45:48.092647+0000","last_unstale":"2023-08-18T20:45:50.295178+0000","last_undegraded":"2023-08-18T20:45:50.295178+0000","last_fullsized":"2023-08-18T20:45:50.295178+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:31:40.877512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250459+0000","last_change":"2023-08-18T20:45:35.900789+0000","last_active":"2023-08-18T20:45:50.250459+0000","last_peered":"2023-08-18T20:45:50.250459+0000","last_clean":"2023-08-18T20:45:50.250459+0000","last_became_active":"2023-08-18T20:45:35.900218+0000","last_became_peered":"2023-08-18T20:45:35.900218+0000","last_unstale":"2023-08-18T20:45:50.250459+0000","last_undegraded":"2023-08-18T20:45:50.250459+0000","last_fullsized":"2023-08-18T20:45:50.250459+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:54.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294644+0000","last_change":"2023-08-18T20:45:34.976358+0000","last_active":"2023-08-18T20:45:50.294644+0000","last_peered":"2023-08-18T20:45:50.294644+0000","last_clean":"2023-08-18T20:45:50.294644+0000","last_became_active":"2023-08-18T20:45:34.976019+0000","last_became_peered":"2023-08-18T20:45:34.976019+0000","last_unstale":"2023-08-18T20:45:50.294644+0000","last_undegraded":"2023-08-18T20:45:50.294644+0000","last_fullsized":"2023-08-18T20:45:50.294644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:51:53.467255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086599+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:45:50.086599+0000","last_peered":"2023-08-18T20:45:50.086599+0000","last_clean":"2023-08-18T20:45:50.086599+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:45:50.086599+0000","last_undegraded":"2023-08-18T20:45:50.086599+0000","last_fullsized":"2023-08-18T20:45:50.086599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:45:55.305453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251123+0000","last_change":"2023-08-18T20:45:49.102540+0000","last_active":"2023-08-18T20:45:50.251123+0000","last_peered":"2023-08-18T20:45:50.251123+0000","last_clean":"2023-08-18T20:45:50.251123+0000","last_became_active":"2023-08-18T20:45:49.102269+0000","last_became_peered":"2023-08-18T20:45:49.102269+0000","last_unstale":"2023-08-18T20:45:50.251123+0000","last_undegraded":"2023-08-18T20:45:50.251123+0000","last_fullsized":"2023-08-18T20:45:50.251123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:34:12.389449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294555+0000","last_change":"2023-08-18T20:45:48.093876+0000","last_active":"2023-08-18T20:45:50.294555+0000","last_peered":"2023-08-18T20:45:50.294555+0000","last_clean":"2023-08-18T20:45:50.294555+0000","last_became_active":"2023-08-18T20:45:48.093609+0000","last_became_peered":"2023-08-18T20:45:48.093609+0000","last_unstale":"2023-08-18T20:45:50.294555+0000","last_undegraded":"2023-08-18T20:45:50.294555+0000","last_fullsized":"2023-08-18T20:45:50.294555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:57.366750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085430+0000","last_change":"2023-08-18T20:45:35.903258+0000","last_active":"2023-08-18T20:45:50.085430+0000","last_peered":"2023-08-18T20:45:50.085430+0000","last_clean":"2023-08-18T20:45:50.085430+0000","last_became_active":"2023-08-18T20:45:35.902942+0000","last_became_peered":"2023-08-18T20:45:35.902942+0000","last_unstale":"2023-08-18T20:45:50.085430+0000","last_undegraded":"2023-08-18T20:45:50.085430+0000","last_fullsized":"2023-08-18T20:45:50.085430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:33:59.270393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085733+0000","last_change":"2023-08-18T20:45:34.975679+0000","last_active":"2023-08-18T20:45:50.085733+0000","last_peered":"2023-08-18T20:45:50.085733+0000","last_clean":"2023-08-18T20:45:50.085733+0000","last_became_active":"2023-08-18T20:45:34.975369+0000","last_became_peered":"2023-08-18T20:45:34.975369+0000","last_unstale":"2023-08-18T20:45:50.085733+0000","last_undegraded":"2023-08-18T20:45:50.085733+0000","last_fullsized":"2023-08-18T20:45:50.085733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:51:28.574638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086049+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:45:50.086049+0000","last_peered":"2023-08-18T20:45:50.086049+0000","last_clean":"2023-08-18T20:45:50.086049+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:45:50.086049+0000","last_undegraded":"2023-08-18T20:45:50.086049+0000","last_fullsized":"2023-08-18T20:45:50.086049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:40.730655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220737+0000","last_change":"2023-08-18T20:45:49.115470+0000","last_active":"2023-08-18T20:45:50.220737+0000","last_peered":"2023-08-18T20:45:50.220737+0000","last_clean":"2023-08-18T20:45:50.220737+0000","last_became_active":"2023-08-18T20:45:49.115109+0000","last_became_peered":"2023-08-18T20:45:49.115109+0000","last_unstale":"2023-08-18T20:45:50.220737+0000","last_undegraded":"2023-08-18T20:45:50.220737+0000","last_fullsized":"2023-08-18T20:45:50.220737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:36.219442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295095+0000","last_change":"2023-08-18T20:45:48.091236+0000","last_active":"2023-08-18T20:45:50.295095+0000","last_peered":"2023-08-18T20:45:50.295095+0000","last_clean":"2023-08-18T20:45:50.295095+0000","last_became_active":"2023-08-18T20:45:48.090997+0000","last_became_peered":"2023-08-18T20:45:48.090997+0000","last_unstale":"2023-08-18T20:45:50.295095+0000","last_undegraded":"2023-08-18T20:45:50.295095+0000","last_fullsized":"2023-08-18T20:45:50.295095+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:13.578398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220376+0000","last_change":"2023-08-18T20:45:35.901239+0000","last_active":"2023-08-18T20:45:50.220376+0000","last_peered":"2023-08-18T20:45:50.220376+0000","last_clean":"2023-08-18T20:45:50.220376+0000","last_became_active":"2023-08-18T20:45:35.900850+0000","last_became_peered":"2023-08-18T20:45:35.900850+0000","last_unstale":"2023-08-18T20:45:50.220376+0000","last_undegraded":"2023-08-18T20:45:50.220376+0000","last_fullsized":"2023-08-18T20:45:50.220376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:24.757067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220487+0000","last_change":"2023-08-18T20:45:34.970857+0000","last_active":"2023-08-18T20:45:50.220487+0000","last_peered":"2023-08-18T20:45:50.220487+0000","last_clean":"2023-08-18T20:45:50.220487+0000","last_became_active":"2023-08-18T20:45:34.970218+0000","last_became_peered":"2023-08-18T20:45:34.970218+0000","last_unstale":"2023-08-18T20:45:50.220487+0000","last_undegraded":"2023-08-18T20:45:50.220487+0000","last_fullsized":"2023-08-18T20:45:50.220487+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:06.586449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086320+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:45:50.086320+0000","last_peered":"2023-08-18T20:45:50.086320+0000","last_clean":"2023-08-18T20:45:50.086320+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:45:50.086320+0000","last_undegraded":"2023-08-18T20:45:50.086320+0000","last_fullsized":"2023-08-18T20:45:50.086320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:09:12.095253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474818+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:45:50.474818+0000","last_peered":"2023-08-18T20:45:50.474818+0000","last_clean":"2023-08-18T20:45:50.474818+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:45:50.474818+0000","last_undegraded":"2023-08-18T20:45:50.474818+0000","last_fullsized":"2023-08-18T20:45:50.474818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:53:59.891577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083700+0000","last_change":"2023-08-18T20:45:49.095928+0000","last_active":"2023-08-18T20:45:50.083700+0000","last_peered":"2023-08-18T20:45:50.083700+0000","last_clean":"2023-08-18T20:45:50.083700+0000","last_became_active":"2023-08-18T20:45:49.094918+0000","last_became_peered":"2023-08-18T20:45:49.094918+0000","last_unstale":"2023-08-18T20:45:50.083700+0000","last_undegraded":"2023-08-18T20:45:50.083700+0000","last_fullsized":"2023-08-18T20:45:50.083700+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:46:36.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476131+0000","last_change":"2023-08-18T20:45:48.097543+0000","last_active":"2023-08-18T20:45:50.476131+0000","last_peered":"2023-08-18T20:45:50.476131+0000","last_clean":"2023-08-18T20:45:50.476131+0000","last_became_active":"2023-08-18T20:45:48.095231+0000","last_became_peered":"2023-08-18T20:45:48.095231+0000","last_unstale":"2023-08-18T20:45:50.476131+0000","last_undegraded":"2023-08-18T20:45:50.476131+0000","last_fullsized":"2023-08-18T20:45:50.476131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:18.281289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251084+0000","last_change":"2023-08-18T20:45:35.898795+0000","last_active":"2023-08-18T20:45:50.251084+0000","last_peered":"2023-08-18T20:45:50.251084+0000","last_clean":"2023-08-18T20:45:50.251084+0000","last_became_active":"2023-08-18T20:45:35.898518+0000","last_became_peered":"2023-08-18T20:45:35.898518+0000","last_unstale":"2023-08-18T20:45:50.251084+0000","last_undegraded":"2023-08-18T20:45:50.251084+0000","last_fullsized":"2023-08-18T20:45:50.251084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:30.005520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295030+0000","last_change":"2023-08-18T20:45:34.977122+0000","last_active":"2023-08-18T20:45:50.295030+0000","last_peered":"2023-08-18T20:45:50.295030+0000","last_clean":"2023-08-18T20:45:50.295030+0000","last_became_active":"2023-08-18T20:45:34.976575+0000","last_became_peered":"2023-08-18T20:45:34.976575+0000","last_unstale":"2023-08-18T20:45:50.295030+0000","last_undegraded":"2023-08-18T20:45:50.295030+0000","last_fullsized":"2023-08-18T20:45:50.295030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:12:05.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295081+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:45:50.295081+0000","last_peered":"2023-08-18T20:45:50.295081+0000","last_clean":"2023-08-18T20:45:50.295081+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:45:50.295081+0000","last_undegraded":"2023-08-18T20:45:50.295081+0000","last_fullsized":"2023-08-18T20:45:50.295081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:20.746890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294549+0000","last_change":"2023-08-18T20:45:49.101258+0000","last_active":"2023-08-18T20:45:50.294549+0000","last_peered":"2023-08-18T20:45:50.294549+0000","last_clean":"2023-08-18T20:45:50.294549+0000","last_became_active":"2023-08-18T20:45:49.101034+0000","last_became_peered":"2023-08-18T20:45:49.101034+0000","last_unstale":"2023-08-18T20:45:50.294549+0000","last_undegraded":"2023-08-18T20:45:50.294549+0000","last_fullsized":"2023-08-18T20:45:50.294549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:56:31.807173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087770+0000","last_change":"2023-08-18T20:45:48.100631+0000","last_active":"2023-08-18T20:45:50.087770+0000","last_peered":"2023-08-18T20:45:50.087770+0000","last_clean":"2023-08-18T20:45:50.087770+0000","last_became_active":"2023-08-18T20:45:48.100331+0000","last_became_peered":"2023-08-18T20:45:48.100331+0000","last_unstale":"2023-08-18T20:45:50.087770+0000","last_undegraded":"2023-08-18T20:45:50.087770+0000","last_fullsized":"2023-08-18T20:45:50.087770+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:31.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476246+0000","last_change":"2023-08-18T20:45:35.905894+0000","last_active":"2023-08-18T20:45:50.476246+0000","last_peered":"2023-08-18T20:45:50.476246+0000","last_clean":"2023-08-18T20:45:50.476246+0000","last_became_active":"2023-08-18T20:45:35.905198+0000","last_became_peered":"2023-08-18T20:45:35.905198+0000","last_unstale":"2023-08-18T20:45:50.476246+0000","last_undegraded":"2023-08-18T20:45:50.476246+0000","last_fullsized":"2023-08-18T20:45:50.476246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:44:59.645343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087611+0000","last_change":"2023-08-18T20:45:34.978547+0000","last_active":"2023-08-18T20:45:50.087611+0000","last_peered":"2023-08-18T20:45:50.087611+0000","last_clean":"2023-08-18T20:45:50.087611+0000","last_became_active":"2023-08-18T20:45:34.977631+0000","last_became_peered":"2023-08-18T20:45:34.977631+0000","last_unstale":"2023-08-18T20:45:50.087611+0000","last_undegraded":"2023-08-18T20:45:50.087611+0000","last_fullsized":"2023-08-18T20:45:50.087611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:27:48.352619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476006+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:45:50.476006+0000","last_peered":"2023-08-18T20:45:50.476006+0000","last_clean":"2023-08-18T20:45:50.476006+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:45:50.476006+0000","last_undegraded":"2023-08-18T20:45:50.476006+0000","last_fullsized":"2023-08-18T20:45:50.476006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:52:34.056355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1282048,"data_stored":895202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.505},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68000000000000005,"5min":1.101,"15min":1.101},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":1.159,"15min":1.159},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79100000000000004,"5min":1.373,"15min":1.373},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":305682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77900000000000003,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.81299999999999994,"15min":0.86099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.755,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.82999999999999996,"15min":0.877},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82599999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83299999999999996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.74099999999999999,"15min":0.77500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80400000000000005,"5min":6.548,"15min":6.548},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.39800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86299999999999999,"5min":1.101,"15min":1.101},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.875,"5min":1.123,"15min":1.123},"last":0.497}]},{"osd":7,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.435}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1286144,"data_stored":890889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.216,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.45400000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.307},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.71999999999999997,"15min":0.77900000000000003},"min":{"1min":0.218,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.6930000000000001,"5min":12.057,"15min":12.057},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.629,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41099999999999998},"min":{"1min":0.27400000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.76200000000000001,"15min":0.81899999999999995},"min":{"1min":0.25700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.7190000000000001,"5min":11.927,"15min":11.927},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.44700000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.355,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":1.329,"15min":1.329},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.621,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":1.3,"15min":1.3},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6399999999999999,"5min":12.029,"15min":12.029},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38100000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.9700000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.97999999999999998,"15min":1.0389999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.669,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.47499999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":304036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.42199999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.313},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23000000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.37},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28599999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.247},{"interface":"front","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.621},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31,"15min":0.308},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":0.27100000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.314},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.34300000000000003},"min":{"1min":0.29199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.34399999999999997},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.222},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.65100000000000002,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":6.6429999999999998,"5min":6.6429999999999998,"15min":6.6429999999999998},"last":0.33000000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.64300000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":5.7039999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.505}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":304618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.41599999999999998,"15min":0.435},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.40400000000000003,"5min":1.599,"15min":1.599},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.311,"5min":1.391,"15min":1.571},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.41099999999999998,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47099999999999997,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":1.125,"15min":1.2569999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45800000000000002,"5min":13.94,"15min":13.94},"last":0.438}]},{"osd":2,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":1.3740000000000001,"15min":1.5469999999999999},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.40300000000000002,"5min":10.375,"15min":10.375},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.44500000000000001,"5min":1.643,"15min":1.643},"last":0.373}]},{"osd":4,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":1.589,"15min":1.764},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.087,"15min":1.175},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77000000000000002,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.66600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.619,"15min":1.7889999999999999},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.1040000000000001,"15min":1.194},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":1.704,"15min":1.704},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.643,"15min":1.819},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.139,"15min":1.2310000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71599999999999997,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.61199999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":308871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.30199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.40799999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75900000000000001,"5min":0.875,"15min":0.875},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.45400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.314},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.77400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.26700000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.371},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.495}]},{"osd":7,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.71099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47699999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":304092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.40899999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.62},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70699999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.745,"15min":0.745},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:45:53.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-18T20:45:53.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.352+0000 7f2c2a61a700 1 Processor -- start 2023-08-18T20:45:53.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.353+0000 7f2c2a61a700 1 -- start start 2023-08-18T20:45:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.353+0000 7f2c2a61a700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2c2414e950 0x7f2c240c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c2a61a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c240c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c2a61a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240c2260 con 0x7f2c2414ed30 2023-08-18T20:45:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c2a61a700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240a6630 con 0x7f2c2414e950 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c2a61a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24151d90 con 0x7f2c24070950 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c237fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2c2414ed30 0x7f2c240c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50750/0 (socket says 172.21.15.121:50750) 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c237fe700 1 -- 172.21.15.121:0/373771936 learned_addr learned my addr 172.21.15.121:0/373771936 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c23fff700 1 --2- 172.21.15.121:0/373771936 >> v2:172.21.15.122:3300/0 conn(0x7f2c2414e950 0x7f2c240c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c28bb7700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c240c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144668991 0 0) 0x7f2c240c2260 con 0x7f2c2414ed30 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c100035b0 con 0x7f2c2414ed30 2023-08-18T20:45:53.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525245835 0 0) 0x7f2c100035b0 con 0x7f2c2414ed30 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 msgr2=0x7f2c240c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c240c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 >> v2:172.21.15.122:3300/0 conn(0x7f2c2414e950 msgr2=0x7f2c240c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 --2- 172.21.15.121:0/373771936 >> v2:172.21.15.122:3300/0 conn(0x7f2c2414e950 0x7f2c240c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24152070 con 0x7f2c2414ed30 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c23fff700 1 --2- 172.21.15.121:0/373771936 >> v2:172.21.15.122:3300/0 conn(0x7f2c2414e950 0x7f2c240c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:53.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f2c0c001670 con 0x7f2c2414ed30 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 >> v1:172.21.15.121:6789/0 conn(0x7f2c2414ed30 legacy=0x7f2c240c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c10003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c10003ff0 0x7f2c10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10004d90 0x7f2c10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240a6630 con 0x7f2c10003ff0 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24151d90 con 0x7f2c10004d90 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000bac0 con 0x7f2c24070950 2023-08-18T20:45:53.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c237fe700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c10003ff0 0x7f2c10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c28bb7700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10004d90 0x7f2c10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.354+0000 7f2c23fff700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c10003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 -- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 msgr2=0x7f2c10003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c24070950 0x7f2c10003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 -- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10004d90 msgr2=0x7f2c10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10004d90 0x7f2c10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 -- 172.21.15.121:0/373771936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100035b0 con 0x7f2c10003ff0 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c237fe700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c10003ff0 0x7f2c10004850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c320 tx=0x7f2c10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b1771a5f4269df server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00ce60 con 0x7f2c10003ff0 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c005960 con 0x7f2c10003ff0 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c22ffd700 1 -- 172.21.15.121:0/373771936 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005cf0 con 0x7f2c10003ff0 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c2a61a700 1 -- 172.21.15.121:0/373771936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c10003ff0 msgr2=0x7f2c10004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/373771936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c10003ff0 0x7f2c10004850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c320 tx=0x7f2c10005880 comp rx=0 tx=0).stop 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.355+0000 7f2c28bb7700 1 -- 172.21.15.121:0/373771936 reap_dead start 2023-08-18T20:45:53.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.356+0000 7f2c2a61a700 1 -- 172.21.15.121:0/373771936 shutdown_connections 2023-08-18T20:45:53.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.356+0000 7f2c2a61a700 1 -- 172.21.15.121:0/373771936 >> 172.21.15.121:0/373771936 conn(0x7f2c240c6b10 msgr2=0x7f2c240c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:53.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.356+0000 7f2c2a61a700 1 -- 172.21.15.121:0/373771936 shutdown_connections 2023-08-18T20:45:53.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.356+0000 7f2c2a61a700 1 -- 172.21.15.121:0/373771936 wait complete. 2023-08-18T20:45:53.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.357+0000 7f2c2a61a700 1 Processor -- start 2023-08-18T20:45:53.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.357+0000 7f2c2a61a700 1 -- start start 2023-08-18T20:45:53.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.357+0000 7f2c2a61a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10003ff0 0x7f2c241db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.357+0000 7f2c2a61a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c241ec8a0 0x7f2c241482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241e95c0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241dd8b0 con 0x7f2c10003ff0 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241dd5d0 con 0x7f2c241ec8a0 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44180/0 (socket says 172.21.15.121:44180) 2023-08-18T20:45:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 -- 172.21.15.121:0/1326137078 learned_addr learned my addr 172.21.15.121:0/1326137078 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c28bb7700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c241ec8a0 0x7f2c241482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c23fff700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10003ff0 0x7f2c241db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 -- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c241ec8a0 msgr2=0x7f2c241482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c241ec8a0 0x7f2c241482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 -- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10003ff0 msgr2=0x7f2c241db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10003ff0 0x7f2c241db7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 -- 172.21.15.121:0/1326137078 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c241e8f70 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c237fe700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c000ed0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c001680 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c004ce0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c241e9250 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.358+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c241dc8b0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.359+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c241e8dd0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.360+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c0c0070d0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.360+0000 7f2c20ff9700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 0x7f2c0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.360+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f2c0c089e60 con 0x7f2c241dd0d0 2023-08-18T20:45:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.360+0000 7f2c23fff700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 0x7f2c0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.360+0000 7f2c23fff700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 0x7f2c0406c5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d30 tx=0x7f2c14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.364+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2c241e8dd0 con 0x7f2c241dd0d0 2023-08-18T20:45:53.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.551+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 --> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c240716e0 con 0x7f2c0406a0e0 2023-08-18T20:45:53.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.565+0000 7f2c20ff9700 1 -- 172.21.15.121:0/1326137078 <== mgr.4101 v2:172.21.15.121:6832/2511824978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550165 (secure 0 0 0) 0x7f2c14009e70 con 0x7f2c0406a0e0 2023-08-18T20:45:53.571 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 msgr2=0x7f2c0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 0x7f2c0406c5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d30 tx=0x7f2c14008040 comp rx=0 tx=0).stop 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 msgr2=0x7f2c241ec360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c001a00 comp rx=0 tx=0).stop 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 shutdown_connections 2023-08-18T20:45:53.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c241ec8a0 0x7f2c241482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c10003ff0 0x7f2c241db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f2c0406a0e0 0x7f2c0406c5a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 --2- 172.21.15.121:0/1326137078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c241dd0d0 0x7f2c241ec360 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.569+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 >> 172.21.15.121:0/1326137078 conn(0x7f2c240c6b10 msgr2=0x7f2c2414e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.570+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 shutdown_connections 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.570+0000 7f2c2a61a700 1 -- 172.21.15.121:0/1326137078 wait complete. 2023-08-18T20:45:53.576 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2023-08-18T20:45:53.582 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-08-18T20:45:52.944006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596695,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":385,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226768,"kb_used_data":6480,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754747952,"statfs":{"total":773094113280,"available":772861902848,"internally_reserved":0,"allocated":6635520,"data_stored":3610658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.869215"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250279+0000","last_change":"2023-08-18T20:45:49.099486+0000","last_active":"2023-08-18T20:45:50.250279+0000","last_peered":"2023-08-18T20:45:50.250279+0000","last_clean":"2023-08-18T20:45:50.250279+0000","last_became_active":"2023-08-18T20:45:49.099129+0000","last_became_peered":"2023-08-18T20:45:49.099129+0000","last_unstale":"2023-08-18T20:45:50.250279+0000","last_undegraded":"2023-08-18T20:45:50.250279+0000","last_fullsized":"2023-08-18T20:45:50.250279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:54.967886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475459+0000","last_change":"2023-08-18T20:45:35.904053+0000","last_active":"2023-08-18T20:45:50.475459+0000","last_peered":"2023-08-18T20:45:50.475459+0000","last_clean":"2023-08-18T20:45:50.475459+0000","last_became_active":"2023-08-18T20:45:35.903735+0000","last_became_peered":"2023-08-18T20:45:35.903735+0000","last_unstale":"2023-08-18T20:45:50.475459+0000","last_undegraded":"2023-08-18T20:45:50.475459+0000","last_fullsized":"2023-08-18T20:45:50.475459+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:00.156386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083867+0000","last_change":"2023-08-18T20:45:49.101890+0000","last_active":"2023-08-18T20:45:50.083867+0000","last_peered":"2023-08-18T20:45:50.083867+0000","last_clean":"2023-08-18T20:45:50.083867+0000","last_became_active":"2023-08-18T20:45:49.101659+0000","last_became_peered":"2023-08-18T20:45:49.101659+0000","last_unstale":"2023-08-18T20:45:50.083867+0000","last_undegraded":"2023-08-18T20:45:50.083867+0000","last_fullsized":"2023-08-18T20:45:50.083867+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:28:52.257145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475266+0000","last_change":"2023-08-18T20:45:35.899964+0000","last_active":"2023-08-18T20:45:50.475266+0000","last_peered":"2023-08-18T20:45:50.475266+0000","last_clean":"2023-08-18T20:45:50.475266+0000","last_became_active":"2023-08-18T20:45:35.899670+0000","last_became_peered":"2023-08-18T20:45:35.899670+0000","last_unstale":"2023-08-18T20:45:50.475266+0000","last_undegraded":"2023-08-18T20:45:50.475266+0000","last_fullsized":"2023-08-18T20:45:50.475266+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:54:31.474422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083944+0000","last_change":"2023-08-18T20:45:49.102624+0000","last_active":"2023-08-18T20:45:50.083944+0000","last_peered":"2023-08-18T20:45:50.083944+0000","last_clean":"2023-08-18T20:45:50.083944+0000","last_became_active":"2023-08-18T20:45:49.102364+0000","last_became_peered":"2023-08-18T20:45:49.102364+0000","last_unstale":"2023-08-18T20:45:50.083944+0000","last_undegraded":"2023-08-18T20:45:50.083944+0000","last_fullsized":"2023-08-18T20:45:50.083944+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:41:31.410523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087450+0000","last_change":"2023-08-18T20:45:35.906068+0000","last_active":"2023-08-18T20:45:50.087450+0000","last_peered":"2023-08-18T20:45:50.087450+0000","last_clean":"2023-08-18T20:45:50.087450+0000","last_became_active":"2023-08-18T20:45:35.905746+0000","last_became_peered":"2023-08-18T20:45:35.905746+0000","last_unstale":"2023-08-18T20:45:50.087450+0000","last_undegraded":"2023-08-18T20:45:50.087450+0000","last_fullsized":"2023-08-18T20:45:50.087450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:20:35.003721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294791+0000","last_change":"2023-08-18T20:45:49.105061+0000","last_active":"2023-08-18T20:45:50.294791+0000","last_peered":"2023-08-18T20:45:50.294791+0000","last_clean":"2023-08-18T20:45:50.294791+0000","last_became_active":"2023-08-18T20:45:49.104789+0000","last_became_peered":"2023-08-18T20:45:49.104789+0000","last_unstale":"2023-08-18T20:45:50.294791+0000","last_undegraded":"2023-08-18T20:45:50.294791+0000","last_fullsized":"2023-08-18T20:45:50.294791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:42:39.540811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475851+0000","last_change":"2023-08-18T20:45:35.902831+0000","last_active":"2023-08-18T20:45:50.475851+0000","last_peered":"2023-08-18T20:45:50.475851+0000","last_clean":"2023-08-18T20:45:50.475851+0000","last_became_active":"2023-08-18T20:45:35.902583+0000","last_became_peered":"2023-08-18T20:45:35.902583+0000","last_unstale":"2023-08-18T20:45:50.475851+0000","last_undegraded":"2023-08-18T20:45:50.475851+0000","last_fullsized":"2023-08-18T20:45:50.475851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:24:51.743192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475170+0000","last_change":"2023-08-18T20:45:49.100989+0000","last_active":"2023-08-18T20:45:50.475170+0000","last_peered":"2023-08-18T20:45:50.475170+0000","last_clean":"2023-08-18T20:45:50.475170+0000","last_became_active":"2023-08-18T20:45:49.100535+0000","last_became_peered":"2023-08-18T20:45:49.100535+0000","last_unstale":"2023-08-18T20:45:50.475170+0000","last_undegraded":"2023-08-18T20:45:50.475170+0000","last_fullsized":"2023-08-18T20:45:50.475170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:49.191779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250615+0000","last_change":"2023-08-18T20:45:35.907509+0000","last_active":"2023-08-18T20:45:50.250615+0000","last_peered":"2023-08-18T20:45:50.250615+0000","last_clean":"2023-08-18T20:45:50.250615+0000","last_became_active":"2023-08-18T20:45:35.906991+0000","last_became_peered":"2023-08-18T20:45:35.906991+0000","last_unstale":"2023-08-18T20:45:50.250615+0000","last_undegraded":"2023-08-18T20:45:50.250615+0000","last_fullsized":"2023-08-18T20:45:50.250615+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:10:38.613022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086314+0000","last_change":"2023-08-18T20:45:49.102045+0000","last_active":"2023-08-18T20:45:50.086314+0000","last_peered":"2023-08-18T20:45:50.086314+0000","last_clean":"2023-08-18T20:45:50.086314+0000","last_became_active":"2023-08-18T20:45:49.101635+0000","last_became_peered":"2023-08-18T20:45:49.101635+0000","last_unstale":"2023-08-18T20:45:50.086314+0000","last_undegraded":"2023-08-18T20:45:50.086314+0000","last_fullsized":"2023-08-18T20:45:50.086314+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:39.788826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220134+0000","last_change":"2023-08-18T20:45:35.910037+0000","last_active":"2023-08-18T20:45:50.220134+0000","last_peered":"2023-08-18T20:45:50.220134+0000","last_clean":"2023-08-18T20:45:50.220134+0000","last_became_active":"2023-08-18T20:45:35.909760+0000","last_became_peered":"2023-08-18T20:45:35.909760+0000","last_unstale":"2023-08-18T20:45:50.220134+0000","last_undegraded":"2023-08-18T20:45:50.220134+0000","last_fullsized":"2023-08-18T20:45:50.220134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:55:28.559878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087319+0000","last_change":"2023-08-18T20:45:49.106811+0000","last_active":"2023-08-18T20:45:50.087319+0000","last_peered":"2023-08-18T20:45:50.087319+0000","last_clean":"2023-08-18T20:45:50.087319+0000","last_became_active":"2023-08-18T20:45:49.106513+0000","last_became_peered":"2023-08-18T20:45:49.106513+0000","last_unstale":"2023-08-18T20:45:50.087319+0000","last_undegraded":"2023-08-18T20:45:50.087319+0000","last_fullsized":"2023-08-18T20:45:50.087319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:25:22.496125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083852+0000","last_change":"2023-08-18T20:45:35.904459+0000","last_active":"2023-08-18T20:45:50.083852+0000","last_peered":"2023-08-18T20:45:50.083852+0000","last_clean":"2023-08-18T20:45:50.083852+0000","last_became_active":"2023-08-18T20:45:35.904153+0000","last_became_peered":"2023-08-18T20:45:35.904153+0000","last_unstale":"2023-08-18T20:45:50.083852+0000","last_undegraded":"2023-08-18T20:45:50.083852+0000","last_fullsized":"2023-08-18T20:45:50.083852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:15:45.109550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220542+0000","last_change":"2023-08-18T20:45:49.107777+0000","last_active":"2023-08-18T20:45:50.220542+0000","last_peered":"2023-08-18T20:45:50.220542+0000","last_clean":"2023-08-18T20:45:50.220542+0000","last_became_active":"2023-08-18T20:45:49.107464+0000","last_became_peered":"2023-08-18T20:45:49.107464+0000","last_unstale":"2023-08-18T20:45:50.220542+0000","last_undegraded":"2023-08-18T20:45:50.220542+0000","last_fullsized":"2023-08-18T20:45:50.220542+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:25:32.570142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085098+0000","last_change":"2023-08-18T20:45:35.910962+0000","last_active":"2023-08-18T20:45:50.085098+0000","last_peered":"2023-08-18T20:45:50.085098+0000","last_clean":"2023-08-18T20:45:50.085098+0000","last_became_active":"2023-08-18T20:45:35.910721+0000","last_became_peered":"2023-08-18T20:45:35.910721+0000","last_unstale":"2023-08-18T20:45:50.085098+0000","last_undegraded":"2023-08-18T20:45:50.085098+0000","last_fullsized":"2023-08-18T20:45:50.085098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:19:28.887534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220330+0000","last_change":"2023-08-18T20:45:49.100568+0000","last_active":"2023-08-18T20:45:50.220330+0000","last_peered":"2023-08-18T20:45:50.220330+0000","last_clean":"2023-08-18T20:45:50.220330+0000","last_became_active":"2023-08-18T20:45:49.100291+0000","last_became_peered":"2023-08-18T20:45:49.100291+0000","last_unstale":"2023-08-18T20:45:50.220330+0000","last_undegraded":"2023-08-18T20:45:50.220330+0000","last_fullsized":"2023-08-18T20:45:50.220330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:07.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087592+0000","last_change":"2023-08-18T20:45:35.910833+0000","last_active":"2023-08-18T20:45:50.087592+0000","last_peered":"2023-08-18T20:45:50.087592+0000","last_clean":"2023-08-18T20:45:50.087592+0000","last_became_active":"2023-08-18T20:45:35.909062+0000","last_became_peered":"2023-08-18T20:45:35.909062+0000","last_unstale":"2023-08-18T20:45:50.087592+0000","last_undegraded":"2023-08-18T20:45:50.087592+0000","last_fullsized":"2023-08-18T20:45:50.087592+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:01:54.238902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085962+0000","last_change":"2023-08-18T20:45:49.102626+0000","last_active":"2023-08-18T20:45:50.085962+0000","last_peered":"2023-08-18T20:45:50.085962+0000","last_clean":"2023-08-18T20:45:50.085962+0000","last_became_active":"2023-08-18T20:45:49.102328+0000","last_became_peered":"2023-08-18T20:45:49.102328+0000","last_unstale":"2023-08-18T20:45:50.085962+0000","last_undegraded":"2023-08-18T20:45:50.085962+0000","last_fullsized":"2023-08-18T20:45:50.085962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:48:54.348635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087681+0000","last_change":"2023-08-18T20:45:35.904022+0000","last_active":"2023-08-18T20:45:50.087681+0000","last_peered":"2023-08-18T20:45:50.087681+0000","last_clean":"2023-08-18T20:45:50.087681+0000","last_became_active":"2023-08-18T20:45:35.903760+0000","last_became_peered":"2023-08-18T20:45:35.903760+0000","last_unstale":"2023-08-18T20:45:50.087681+0000","last_undegraded":"2023-08-18T20:45:50.087681+0000","last_fullsized":"2023-08-18T20:45:50.087681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:26:57.878262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084008+0000","last_change":"2023-08-18T20:45:49.095570+0000","last_active":"2023-08-18T20:45:50.084008+0000","last_peered":"2023-08-18T20:45:50.084008+0000","last_clean":"2023-08-18T20:45:50.084008+0000","last_became_active":"2023-08-18T20:45:49.095311+0000","last_became_peered":"2023-08-18T20:45:49.095311+0000","last_unstale":"2023-08-18T20:45:50.084008+0000","last_undegraded":"2023-08-18T20:45:50.084008+0000","last_fullsized":"2023-08-18T20:45:50.084008+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:22:38.693428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475829+0000","last_change":"2023-08-18T20:45:35.906448+0000","last_active":"2023-08-18T20:45:50.475829+0000","last_peered":"2023-08-18T20:45:50.475829+0000","last_clean":"2023-08-18T20:45:50.475829+0000","last_became_active":"2023-08-18T20:45:35.905021+0000","last_became_peered":"2023-08-18T20:45:35.905021+0000","last_unstale":"2023-08-18T20:45:50.475829+0000","last_undegraded":"2023-08-18T20:45:50.475829+0000","last_fullsized":"2023-08-18T20:45:50.475829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:53:36.072722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294947+0000","last_change":"2023-08-18T20:45:49.104723+0000","last_active":"2023-08-18T20:45:50.294947+0000","last_peered":"2023-08-18T20:45:50.294947+0000","last_clean":"2023-08-18T20:45:50.294947+0000","last_became_active":"2023-08-18T20:45:49.104415+0000","last_became_peered":"2023-08-18T20:45:49.104415+0000","last_unstale":"2023-08-18T20:45:50.294947+0000","last_undegraded":"2023-08-18T20:45:50.294947+0000","last_fullsized":"2023-08-18T20:45:50.294947+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:28.696007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086589+0000","last_change":"2023-08-18T20:45:35.910585+0000","last_active":"2023-08-18T20:45:50.086589+0000","last_peered":"2023-08-18T20:45:50.086589+0000","last_clean":"2023-08-18T20:45:50.086589+0000","last_became_active":"2023-08-18T20:45:35.910306+0000","last_became_peered":"2023-08-18T20:45:35.910306+0000","last_unstale":"2023-08-18T20:45:50.086589+0000","last_undegraded":"2023-08-18T20:45:50.086589+0000","last_fullsized":"2023-08-18T20:45:50.086589+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:07.592995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220290+0000","last_change":"2023-08-18T20:45:49.113069+0000","last_active":"2023-08-18T20:45:50.220290+0000","last_peered":"2023-08-18T20:45:50.220290+0000","last_clean":"2023-08-18T20:45:50.220290+0000","last_became_active":"2023-08-18T20:45:49.112783+0000","last_became_peered":"2023-08-18T20:45:49.112783+0000","last_unstale":"2023-08-18T20:45:50.220290+0000","last_undegraded":"2023-08-18T20:45:50.220290+0000","last_fullsized":"2023-08-18T20:45:50.220290+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:40:30.982050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086000+0000","last_change":"2023-08-18T20:45:35.909011+0000","last_active":"2023-08-18T20:45:50.086000+0000","last_peered":"2023-08-18T20:45:50.086000+0000","last_clean":"2023-08-18T20:45:50.086000+0000","last_became_active":"2023-08-18T20:45:35.908728+0000","last_became_peered":"2023-08-18T20:45:35.908728+0000","last_unstale":"2023-08-18T20:45:50.086000+0000","last_undegraded":"2023-08-18T20:45:50.086000+0000","last_fullsized":"2023-08-18T20:45:50.086000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:01:57.736358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086606+0000","last_change":"2023-08-18T20:45:49.116908+0000","last_active":"2023-08-18T20:45:50.086606+0000","last_peered":"2023-08-18T20:45:50.086606+0000","last_clean":"2023-08-18T20:45:50.086606+0000","last_became_active":"2023-08-18T20:45:49.116614+0000","last_became_peered":"2023-08-18T20:45:49.116614+0000","last_unstale":"2023-08-18T20:45:50.086606+0000","last_undegraded":"2023-08-18T20:45:50.086606+0000","last_fullsized":"2023-08-18T20:45:50.086606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:54:07.529776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086191+0000","last_change":"2023-08-18T20:45:35.906359+0000","last_active":"2023-08-18T20:45:50.086191+0000","last_peered":"2023-08-18T20:45:50.086191+0000","last_clean":"2023-08-18T20:45:50.086191+0000","last_became_active":"2023-08-18T20:45:35.906092+0000","last_became_peered":"2023-08-18T20:45:35.906092+0000","last_unstale":"2023-08-18T20:45:50.086191+0000","last_undegraded":"2023-08-18T20:45:50.086191+0000","last_fullsized":"2023-08-18T20:45:50.086191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:19:17.479723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476131+0000","last_change":"2023-08-18T20:45:49.112257+0000","last_active":"2023-08-18T20:45:50.476131+0000","last_peered":"2023-08-18T20:45:50.476131+0000","last_clean":"2023-08-18T20:45:50.476131+0000","last_became_active":"2023-08-18T20:45:49.111968+0000","last_became_peered":"2023-08-18T20:45:49.111968+0000","last_unstale":"2023-08-18T20:45:50.476131+0000","last_undegraded":"2023-08-18T20:45:50.476131+0000","last_fullsized":"2023-08-18T20:45:50.476131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:49.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085988+0000","last_change":"2023-08-18T20:45:35.908516+0000","last_active":"2023-08-18T20:45:50.085988+0000","last_peered":"2023-08-18T20:45:50.085988+0000","last_clean":"2023-08-18T20:45:50.085988+0000","last_became_active":"2023-08-18T20:45:35.907957+0000","last_became_peered":"2023-08-18T20:45:35.907957+0000","last_unstale":"2023-08-18T20:45:50.085988+0000","last_undegraded":"2023-08-18T20:45:50.085988+0000","last_fullsized":"2023-08-18T20:45:50.085988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:11:29.909266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086284+0000","last_change":"2023-08-18T20:45:49.101757+0000","last_active":"2023-08-18T20:45:50.086284+0000","last_peered":"2023-08-18T20:45:50.086284+0000","last_clean":"2023-08-18T20:45:50.086284+0000","last_became_active":"2023-08-18T20:45:49.101469+0000","last_became_peered":"2023-08-18T20:45:49.101469+0000","last_unstale":"2023-08-18T20:45:50.086284+0000","last_undegraded":"2023-08-18T20:45:50.086284+0000","last_fullsized":"2023-08-18T20:45:50.086284+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:51:07.390829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083681+0000","last_change":"2023-08-18T20:45:35.905110+0000","last_active":"2023-08-18T20:45:50.083681+0000","last_peered":"2023-08-18T20:45:50.083681+0000","last_clean":"2023-08-18T20:45:50.083681+0000","last_became_active":"2023-08-18T20:45:35.904860+0000","last_became_peered":"2023-08-18T20:45:35.904860+0000","last_unstale":"2023-08-18T20:45:50.083681+0000","last_undegraded":"2023-08-18T20:45:50.083681+0000","last_fullsized":"2023-08-18T20:45:50.083681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:22.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475251+0000","last_change":"2023-08-18T20:45:49.105628+0000","last_active":"2023-08-18T20:45:50.475251+0000","last_peered":"2023-08-18T20:45:50.475251+0000","last_clean":"2023-08-18T20:45:50.475251+0000","last_became_active":"2023-08-18T20:45:49.105274+0000","last_became_peered":"2023-08-18T20:45:49.105274+0000","last_unstale":"2023-08-18T20:45:50.475251+0000","last_undegraded":"2023-08-18T20:45:50.475251+0000","last_fullsized":"2023-08-18T20:45:50.475251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:39.690048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475394+0000","last_change":"2023-08-18T20:45:35.904684+0000","last_active":"2023-08-18T20:45:50.475394+0000","last_peered":"2023-08-18T20:45:50.475394+0000","last_clean":"2023-08-18T20:45:50.475394+0000","last_became_active":"2023-08-18T20:45:35.904415+0000","last_became_peered":"2023-08-18T20:45:35.904415+0000","last_unstale":"2023-08-18T20:45:50.475394+0000","last_undegraded":"2023-08-18T20:45:50.475394+0000","last_fullsized":"2023-08-18T20:45:50.475394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:06.165927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220331+0000","last_change":"2023-08-18T20:45:49.109236+0000","last_active":"2023-08-18T20:45:50.220331+0000","last_peered":"2023-08-18T20:45:50.220331+0000","last_clean":"2023-08-18T20:45:50.220331+0000","last_became_active":"2023-08-18T20:45:49.108985+0000","last_became_peered":"2023-08-18T20:45:49.108985+0000","last_unstale":"2023-08-18T20:45:50.220331+0000","last_undegraded":"2023-08-18T20:45:50.220331+0000","last_fullsized":"2023-08-18T20:45:50.220331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:04:39.788826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476230+0000","last_change":"2023-08-18T20:45:35.903094+0000","last_active":"2023-08-18T20:45:50.476230+0000","last_peered":"2023-08-18T20:45:50.476230+0000","last_clean":"2023-08-18T20:45:50.476230+0000","last_became_active":"2023-08-18T20:45:35.902444+0000","last_became_peered":"2023-08-18T20:45:35.902444+0000","last_unstale":"2023-08-18T20:45:50.476230+0000","last_undegraded":"2023-08-18T20:45:50.476230+0000","last_fullsized":"2023-08-18T20:45:50.476230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:36:00.156386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475434+0000","last_change":"2023-08-18T20:45:49.105073+0000","last_active":"2023-08-18T20:45:50.475434+0000","last_peered":"2023-08-18T20:45:50.475434+0000","last_clean":"2023-08-18T20:45:50.475434+0000","last_became_active":"2023-08-18T20:45:49.104791+0000","last_became_peered":"2023-08-18T20:45:49.104791+0000","last_unstale":"2023-08-18T20:45:50.475434+0000","last_undegraded":"2023-08-18T20:45:50.475434+0000","last_fullsized":"2023-08-18T20:45:50.475434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:35:29.892474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250523+0000","last_change":"2023-08-18T20:45:35.901532+0000","last_active":"2023-08-18T20:45:50.250523+0000","last_peered":"2023-08-18T20:45:50.250523+0000","last_clean":"2023-08-18T20:45:50.250523+0000","last_became_active":"2023-08-18T20:45:35.901219+0000","last_became_peered":"2023-08-18T20:45:35.901219+0000","last_unstale":"2023-08-18T20:45:50.250523+0000","last_undegraded":"2023-08-18T20:45:50.250523+0000","last_fullsized":"2023-08-18T20:45:50.250523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:20:50.568908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084038+0000","last_change":"2023-08-18T20:45:49.100599+0000","last_active":"2023-08-18T20:45:50.084038+0000","last_peered":"2023-08-18T20:45:50.084038+0000","last_clean":"2023-08-18T20:45:50.084038+0000","last_became_active":"2023-08-18T20:45:49.100337+0000","last_became_peered":"2023-08-18T20:45:49.100337+0000","last_unstale":"2023-08-18T20:45:50.084038+0000","last_undegraded":"2023-08-18T20:45:50.084038+0000","last_fullsized":"2023-08-18T20:45:50.084038+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:27:40.489298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294901+0000","last_change":"2023-08-18T20:45:35.898503+0000","last_active":"2023-08-18T20:45:50.294901+0000","last_peered":"2023-08-18T20:45:50.294901+0000","last_clean":"2023-08-18T20:45:50.294901+0000","last_became_active":"2023-08-18T20:45:35.898323+0000","last_became_peered":"2023-08-18T20:45:35.898323+0000","last_unstale":"2023-08-18T20:45:50.294901+0000","last_undegraded":"2023-08-18T20:45:50.294901+0000","last_fullsized":"2023-08-18T20:45:50.294901+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:21:31.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295018+0000","last_change":"2023-08-18T20:45:49.097023+0000","last_active":"2023-08-18T20:45:50.295018+0000","last_peered":"2023-08-18T20:45:50.295018+0000","last_clean":"2023-08-18T20:45:50.295018+0000","last_became_active":"2023-08-18T20:45:49.096745+0000","last_became_peered":"2023-08-18T20:45:49.096745+0000","last_unstale":"2023-08-18T20:45:50.295018+0000","last_undegraded":"2023-08-18T20:45:50.295018+0000","last_fullsized":"2023-08-18T20:45:50.295018+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:16:24.323957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086120+0000","last_change":"2023-08-18T20:45:35.903465+0000","last_active":"2023-08-18T20:45:50.086120+0000","last_peered":"2023-08-18T20:45:50.086120+0000","last_clean":"2023-08-18T20:45:50.086120+0000","last_became_active":"2023-08-18T20:45:35.903146+0000","last_became_peered":"2023-08-18T20:45:35.903146+0000","last_unstale":"2023-08-18T20:45:50.086120+0000","last_undegraded":"2023-08-18T20:45:50.086120+0000","last_fullsized":"2023-08-18T20:45:50.086120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:40:17.862993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084082+0000","last_change":"2023-08-18T20:45:49.098137+0000","last_active":"2023-08-18T20:45:50.084082+0000","last_peered":"2023-08-18T20:45:50.084082+0000","last_clean":"2023-08-18T20:45:50.084082+0000","last_became_active":"2023-08-18T20:45:49.097878+0000","last_became_peered":"2023-08-18T20:45:49.097878+0000","last_unstale":"2023-08-18T20:45:50.084082+0000","last_undegraded":"2023-08-18T20:45:50.084082+0000","last_fullsized":"2023-08-18T20:45:50.084082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:24:20.418872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295047+0000","last_change":"2023-08-18T20:45:35.905931+0000","last_active":"2023-08-18T20:45:50.295047+0000","last_peered":"2023-08-18T20:45:50.295047+0000","last_clean":"2023-08-18T20:45:50.295047+0000","last_became_active":"2023-08-18T20:45:35.905676+0000","last_became_peered":"2023-08-18T20:45:35.905676+0000","last_unstale":"2023-08-18T20:45:50.295047+0000","last_undegraded":"2023-08-18T20:45:50.295047+0000","last_fullsized":"2023-08-18T20:45:50.295047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:17:09.840341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084751+0000","last_change":"2023-08-18T20:45:49.094711+0000","last_active":"2023-08-18T20:45:50.084751+0000","last_peered":"2023-08-18T20:45:50.084751+0000","last_clean":"2023-08-18T20:45:50.084751+0000","last_became_active":"2023-08-18T20:45:49.094403+0000","last_became_peered":"2023-08-18T20:45:49.094403+0000","last_unstale":"2023-08-18T20:45:50.084751+0000","last_undegraded":"2023-08-18T20:45:50.084751+0000","last_fullsized":"2023-08-18T20:45:50.084751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:34:32.248592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294781+0000","last_change":"2023-08-18T20:45:35.906132+0000","last_active":"2023-08-18T20:45:50.294781+0000","last_peered":"2023-08-18T20:45:50.294781+0000","last_clean":"2023-08-18T20:45:50.294781+0000","last_became_active":"2023-08-18T20:45:35.905839+0000","last_became_peered":"2023-08-18T20:45:35.905839+0000","last_unstale":"2023-08-18T20:45:50.294781+0000","last_undegraded":"2023-08-18T20:45:50.294781+0000","last_fullsized":"2023-08-18T20:45:50.294781+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:56:48.784312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475177+0000","last_change":"2023-08-18T20:45:49.112406+0000","last_active":"2023-08-18T20:45:50.475177+0000","last_peered":"2023-08-18T20:45:50.475177+0000","last_clean":"2023-08-18T20:45:50.475177+0000","last_became_active":"2023-08-18T20:45:49.112007+0000","last_became_peered":"2023-08-18T20:45:49.112007+0000","last_unstale":"2023-08-18T20:45:50.475177+0000","last_undegraded":"2023-08-18T20:45:50.475177+0000","last_fullsized":"2023-08-18T20:45:50.475177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:25:04.862249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086202+0000","last_change":"2023-08-18T20:45:35.909007+0000","last_active":"2023-08-18T20:45:50.086202+0000","last_peered":"2023-08-18T20:45:50.086202+0000","last_clean":"2023-08-18T20:45:50.086202+0000","last_became_active":"2023-08-18T20:45:35.908647+0000","last_became_peered":"2023-08-18T20:45:35.908647+0000","last_unstale":"2023-08-18T20:45:50.086202+0000","last_undegraded":"2023-08-18T20:45:50.086202+0000","last_fullsized":"2023-08-18T20:45:50.086202+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:32:37.486795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474613+0000","last_change":"2023-08-18T20:45:49.088906+0000","last_active":"2023-08-18T20:45:50.474613+0000","last_peered":"2023-08-18T20:45:50.474613+0000","last_clean":"2023-08-18T20:45:50.474613+0000","last_became_active":"2023-08-18T20:45:49.088635+0000","last_became_peered":"2023-08-18T20:45:49.088635+0000","last_unstale":"2023-08-18T20:45:50.474613+0000","last_undegraded":"2023-08-18T20:45:50.474613+0000","last_fullsized":"2023-08-18T20:45:50.474613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:23:31.185569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086554+0000","last_change":"2023-08-18T20:45:35.902924+0000","last_active":"2023-08-18T20:45:50.086554+0000","last_peered":"2023-08-18T20:45:50.086554+0000","last_clean":"2023-08-18T20:45:50.086554+0000","last_became_active":"2023-08-18T20:45:35.902559+0000","last_became_peered":"2023-08-18T20:45:35.902559+0000","last_unstale":"2023-08-18T20:45:50.086554+0000","last_undegraded":"2023-08-18T20:45:50.086554+0000","last_fullsized":"2023-08-18T20:45:50.086554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:07.409053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085797+0000","last_change":"2023-08-18T20:45:49.113166+0000","last_active":"2023-08-18T20:45:50.085797+0000","last_peered":"2023-08-18T20:45:50.085797+0000","last_clean":"2023-08-18T20:45:50.085797+0000","last_became_active":"2023-08-18T20:45:49.112840+0000","last_became_peered":"2023-08-18T20:45:49.112840+0000","last_unstale":"2023-08-18T20:45:50.085797+0000","last_undegraded":"2023-08-18T20:45:50.085797+0000","last_fullsized":"2023-08-18T20:45:50.085797+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:06:50.744707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086649+0000","last_change":"2023-08-18T20:45:35.902555+0000","last_active":"2023-08-18T20:45:50.086649+0000","last_peered":"2023-08-18T20:45:50.086649+0000","last_clean":"2023-08-18T20:45:50.086649+0000","last_became_active":"2023-08-18T20:45:35.902253+0000","last_became_peered":"2023-08-18T20:45:35.902253+0000","last_unstale":"2023-08-18T20:45:50.086649+0000","last_undegraded":"2023-08-18T20:45:50.086649+0000","last_fullsized":"2023-08-18T20:45:50.086649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:13.781290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220202+0000","last_change":"2023-08-18T20:45:49.109032+0000","last_active":"2023-08-18T20:45:50.220202+0000","last_peered":"2023-08-18T20:45:50.220202+0000","last_clean":"2023-08-18T20:45:50.220202+0000","last_became_active":"2023-08-18T20:45:49.108744+0000","last_became_peered":"2023-08-18T20:45:49.108744+0000","last_unstale":"2023-08-18T20:45:50.220202+0000","last_undegraded":"2023-08-18T20:45:50.220202+0000","last_fullsized":"2023-08-18T20:45:50.220202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:51:42.700242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475826+0000","last_change":"2023-08-18T20:45:35.902409+0000","last_active":"2023-08-18T20:45:50.475826+0000","last_peered":"2023-08-18T20:45:50.475826+0000","last_clean":"2023-08-18T20:45:50.475826+0000","last_became_active":"2023-08-18T20:45:35.902127+0000","last_became_peered":"2023-08-18T20:45:35.902127+0000","last_unstale":"2023-08-18T20:45:50.475826+0000","last_undegraded":"2023-08-18T20:45:50.475826+0000","last_fullsized":"2023-08-18T20:45:50.475826+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:54:02.974779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085958+0000","last_change":"2023-08-18T20:45:49.117955+0000","last_active":"2023-08-18T20:45:50.085958+0000","last_peered":"2023-08-18T20:45:50.085958+0000","last_clean":"2023-08-18T20:45:50.085958+0000","last_became_active":"2023-08-18T20:45:49.117667+0000","last_became_peered":"2023-08-18T20:45:49.117667+0000","last_unstale":"2023-08-18T20:45:50.085958+0000","last_undegraded":"2023-08-18T20:45:50.085958+0000","last_fullsized":"2023-08-18T20:45:50.085958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:35:37.215104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475125+0000","last_change":"2023-08-18T20:45:35.894279+0000","last_active":"2023-08-18T20:45:50.475125+0000","last_peered":"2023-08-18T20:45:50.475125+0000","last_clean":"2023-08-18T20:45:50.475125+0000","last_became_active":"2023-08-18T20:45:35.894004+0000","last_became_peered":"2023-08-18T20:45:35.894004+0000","last_unstale":"2023-08-18T20:45:50.475125+0000","last_undegraded":"2023-08-18T20:45:50.475125+0000","last_fullsized":"2023-08-18T20:45:50.475125+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:46:10.723937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087175+0000","last_change":"2023-08-18T20:45:49.102691+0000","last_active":"2023-08-18T20:45:50.087175+0000","last_peered":"2023-08-18T20:45:50.087175+0000","last_clean":"2023-08-18T20:45:50.087175+0000","last_became_active":"2023-08-18T20:45:49.102457+0000","last_became_peered":"2023-08-18T20:45:49.102457+0000","last_unstale":"2023-08-18T20:45:50.087175+0000","last_undegraded":"2023-08-18T20:45:50.087175+0000","last_fullsized":"2023-08-18T20:45:50.087175+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:18:44.413266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087466+0000","last_change":"2023-08-18T20:45:35.907408+0000","last_active":"2023-08-18T20:45:50.087466+0000","last_peered":"2023-08-18T20:45:50.087466+0000","last_clean":"2023-08-18T20:45:50.087466+0000","last_became_active":"2023-08-18T20:45:35.907139+0000","last_became_peered":"2023-08-18T20:45:35.907139+0000","last_unstale":"2023-08-18T20:45:50.087466+0000","last_undegraded":"2023-08-18T20:45:50.087466+0000","last_fullsized":"2023-08-18T20:45:50.087466+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:10:56.828273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084161+0000","last_change":"2023-08-18T20:45:49.104403+0000","last_active":"2023-08-18T20:45:50.084161+0000","last_peered":"2023-08-18T20:45:50.084161+0000","last_clean":"2023-08-18T20:45:50.084161+0000","last_became_active":"2023-08-18T20:45:49.104129+0000","last_became_peered":"2023-08-18T20:45:49.104129+0000","last_unstale":"2023-08-18T20:45:50.084161+0000","last_undegraded":"2023-08-18T20:45:50.084161+0000","last_fullsized":"2023-08-18T20:45:50.084161+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:56:59.878635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085297+0000","last_change":"2023-08-18T20:45:35.910266+0000","last_active":"2023-08-18T20:45:50.085297+0000","last_peered":"2023-08-18T20:45:50.085297+0000","last_clean":"2023-08-18T20:45:50.085297+0000","last_became_active":"2023-08-18T20:45:35.909890+0000","last_became_peered":"2023-08-18T20:45:35.909890+0000","last_unstale":"2023-08-18T20:45:50.085297+0000","last_undegraded":"2023-08-18T20:45:50.085297+0000","last_fullsized":"2023-08-18T20:45:50.085297+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:49:52.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220734+0000","last_change":"2023-08-18T20:45:49.109344+0000","last_active":"2023-08-18T20:45:50.220734+0000","last_peered":"2023-08-18T20:45:50.220734+0000","last_clean":"2023-08-18T20:45:50.220734+0000","last_became_active":"2023-08-18T20:45:49.109028+0000","last_became_peered":"2023-08-18T20:45:49.109028+0000","last_unstale":"2023-08-18T20:45:50.220734+0000","last_undegraded":"2023-08-18T20:45:50.220734+0000","last_fullsized":"2023-08-18T20:45:50.220734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:50:36.228429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475427+0000","last_change":"2023-08-18T20:45:35.904760+0000","last_active":"2023-08-18T20:45:50.475427+0000","last_peered":"2023-08-18T20:45:50.475427+0000","last_clean":"2023-08-18T20:45:50.475427+0000","last_became_active":"2023-08-18T20:45:35.904451+0000","last_became_peered":"2023-08-18T20:45:35.904451+0000","last_unstale":"2023-08-18T20:45:50.475427+0000","last_undegraded":"2023-08-18T20:45:50.475427+0000","last_fullsized":"2023-08-18T20:45:50.475427+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:34:03.959717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086512+0000","last_change":"2023-08-18T20:45:49.113734+0000","last_active":"2023-08-18T20:45:50.086512+0000","last_peered":"2023-08-18T20:45:50.086512+0000","last_clean":"2023-08-18T20:45:50.086512+0000","last_became_active":"2023-08-18T20:45:49.113444+0000","last_became_peered":"2023-08-18T20:45:49.113444+0000","last_unstale":"2023-08-18T20:45:50.086512+0000","last_undegraded":"2023-08-18T20:45:50.086512+0000","last_fullsized":"2023-08-18T20:45:50.086512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:29:01.343832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220133+0000","last_change":"2023-08-18T20:45:35.900863+0000","last_active":"2023-08-18T20:45:50.220133+0000","last_peered":"2023-08-18T20:45:50.220133+0000","last_clean":"2023-08-18T20:45:50.220133+0000","last_became_active":"2023-08-18T20:45:35.900630+0000","last_became_peered":"2023-08-18T20:45:35.900630+0000","last_unstale":"2023-08-18T20:45:50.220133+0000","last_undegraded":"2023-08-18T20:45:50.220133+0000","last_fullsized":"2023-08-18T20:45:50.220133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:36:26.525186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475429+0000","last_change":"2023-08-18T20:45:49.107804+0000","last_active":"2023-08-18T20:45:50.475429+0000","last_peered":"2023-08-18T20:45:50.475429+0000","last_clean":"2023-08-18T20:45:50.475429+0000","last_became_active":"2023-08-18T20:45:49.107443+0000","last_became_peered":"2023-08-18T20:45:49.107443+0000","last_unstale":"2023-08-18T20:45:50.475429+0000","last_undegraded":"2023-08-18T20:45:50.475429+0000","last_fullsized":"2023-08-18T20:45:50.475429+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:18.966380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087335+0000","last_change":"2023-08-18T20:45:48.103035+0000","last_active":"2023-08-18T20:45:50.087335+0000","last_peered":"2023-08-18T20:45:50.087335+0000","last_clean":"2023-08-18T20:45:50.087335+0000","last_became_active":"2023-08-18T20:45:48.102800+0000","last_became_peered":"2023-08-18T20:45:48.102800+0000","last_unstale":"2023-08-18T20:45:50.087335+0000","last_undegraded":"2023-08-18T20:45:50.087335+0000","last_fullsized":"2023-08-18T20:45:50.087335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:40:50.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250433+0000","last_change":"2023-08-18T20:45:35.898466+0000","last_active":"2023-08-18T20:45:50.250433+0000","last_peered":"2023-08-18T20:45:50.250433+0000","last_clean":"2023-08-18T20:45:50.250433+0000","last_became_active":"2023-08-18T20:45:35.898171+0000","last_became_peered":"2023-08-18T20:45:35.898171+0000","last_unstale":"2023-08-18T20:45:50.250433+0000","last_undegraded":"2023-08-18T20:45:50.250433+0000","last_fullsized":"2023-08-18T20:45:50.250433+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:16:04.608368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"51'4","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475341+0000","last_change":"2023-08-18T20:45:34.973966+0000","last_active":"2023-08-18T20:45:50.475341+0000","last_peered":"2023-08-18T20:45:50.475341+0000","last_clean":"2023-08-18T20:45:50.475341+0000","last_became_active":"2023-08-18T20:45:34.973275+0000","last_became_peered":"2023-08-18T20:45:34.973275+0000","last_unstale":"2023-08-18T20:45:50.475341+0000","last_undegraded":"2023-08-18T20:45:50.475341+0000","last_fullsized":"2023-08-18T20:45:50.475341+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:34.969516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475672+0000","last_change":"2023-08-18T20:45:49.104855+0000","last_active":"2023-08-18T20:45:50.475672+0000","last_peered":"2023-08-18T20:45:50.475672+0000","last_clean":"2023-08-18T20:45:50.475672+0000","last_became_active":"2023-08-18T20:45:49.101466+0000","last_became_peered":"2023-08-18T20:45:49.101466+0000","last_unstale":"2023-08-18T20:45:50.475672+0000","last_undegraded":"2023-08-18T20:45:50.475672+0000","last_fullsized":"2023-08-18T20:45:50.475672+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:03:39.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251027+0000","last_change":"2023-08-18T20:45:48.097618+0000","last_active":"2023-08-18T20:45:50.251027+0000","last_peered":"2023-08-18T20:45:50.251027+0000","last_clean":"2023-08-18T20:45:50.251027+0000","last_became_active":"2023-08-18T20:45:48.097347+0000","last_became_peered":"2023-08-18T20:45:48.097347+0000","last_unstale":"2023-08-18T20:45:50.251027+0000","last_undegraded":"2023-08-18T20:45:50.251027+0000","last_fullsized":"2023-08-18T20:45:50.251027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475953+0000","last_change":"2023-08-18T20:45:35.905614+0000","last_active":"2023-08-18T20:45:50.475953+0000","last_peered":"2023-08-18T20:45:50.475953+0000","last_clean":"2023-08-18T20:45:50.475953+0000","last_became_active":"2023-08-18T20:45:35.905300+0000","last_became_peered":"2023-08-18T20:45:35.905300+0000","last_unstale":"2023-08-18T20:45:50.475953+0000","last_undegraded":"2023-08-18T20:45:50.475953+0000","last_fullsized":"2023-08-18T20:45:50.475953+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:58:33.811946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220826+0000","last_change":"2023-08-18T20:45:34.974441+0000","last_active":"2023-08-18T20:45:50.220826+0000","last_peered":"2023-08-18T20:45:50.220826+0000","last_clean":"2023-08-18T20:45:50.220826+0000","last_became_active":"2023-08-18T20:45:34.974160+0000","last_became_peered":"2023-08-18T20:45:34.974160+0000","last_unstale":"2023-08-18T20:45:50.220826+0000","last_undegraded":"2023-08-18T20:45:50.220826+0000","last_fullsized":"2023-08-18T20:45:50.220826+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:05:07.579774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474548+0000","last_change":"2023-08-18T20:45:49.107063+0000","last_active":"2023-08-18T20:45:50.474548+0000","last_peered":"2023-08-18T20:45:50.474548+0000","last_clean":"2023-08-18T20:45:50.474548+0000","last_became_active":"2023-08-18T20:45:49.106796+0000","last_became_peered":"2023-08-18T20:45:49.106796+0000","last_unstale":"2023-08-18T20:45:50.474548+0000","last_undegraded":"2023-08-18T20:45:50.474548+0000","last_fullsized":"2023-08-18T20:45:50.474548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:03:40.931566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"55'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084754+0000","last_change":"2023-08-18T20:45:48.100506+0000","last_active":"2023-08-18T20:45:50.084754+0000","last_peered":"2023-08-18T20:45:50.084754+0000","last_clean":"2023-08-18T20:45:50.084754+0000","last_became_active":"2023-08-18T20:45:48.100217+0000","last_became_peered":"2023-08-18T20:45:48.100217+0000","last_unstale":"2023-08-18T20:45:50.084754+0000","last_undegraded":"2023-08-18T20:45:50.084754+0000","last_fullsized":"2023-08-18T20:45:50.084754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:36:37.988740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220833+0000","last_change":"2023-08-18T20:45:35.901281+0000","last_active":"2023-08-18T20:45:50.220833+0000","last_peered":"2023-08-18T20:45:50.220833+0000","last_clean":"2023-08-18T20:45:50.220833+0000","last_became_active":"2023-08-18T20:45:35.900941+0000","last_became_peered":"2023-08-18T20:45:35.900941+0000","last_unstale":"2023-08-18T20:45:50.220833+0000","last_undegraded":"2023-08-18T20:45:50.220833+0000","last_fullsized":"2023-08-18T20:45:50.220833+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:50:45.348529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220563+0000","last_change":"2023-08-18T20:45:34.972508+0000","last_active":"2023-08-18T20:45:50.220563+0000","last_peered":"2023-08-18T20:45:50.220563+0000","last_clean":"2023-08-18T20:45:50.220563+0000","last_became_active":"2023-08-18T20:45:34.972220+0000","last_became_peered":"2023-08-18T20:45:34.972220+0000","last_unstale":"2023-08-18T20:45:50.220563+0000","last_undegraded":"2023-08-18T20:45:50.220563+0000","last_fullsized":"2023-08-18T20:45:50.220563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:52:15.257091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.219907+0000","last_change":"2023-08-18T20:45:49.107174+0000","last_active":"2023-08-18T20:45:50.219907+0000","last_peered":"2023-08-18T20:45:50.219907+0000","last_clean":"2023-08-18T20:45:50.219907+0000","last_became_active":"2023-08-18T20:45:49.106234+0000","last_became_peered":"2023-08-18T20:45:49.106234+0000","last_unstale":"2023-08-18T20:45:50.219907+0000","last_undegraded":"2023-08-18T20:45:50.219907+0000","last_fullsized":"2023-08-18T20:45:50.219907+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:43.124577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087547+0000","last_change":"2023-08-18T20:45:48.100285+0000","last_active":"2023-08-18T20:45:50.087547+0000","last_peered":"2023-08-18T20:45:50.087547+0000","last_clean":"2023-08-18T20:45:50.087547+0000","last_became_active":"2023-08-18T20:45:48.100014+0000","last_became_peered":"2023-08-18T20:45:48.100014+0000","last_unstale":"2023-08-18T20:45:50.087547+0000","last_undegraded":"2023-08-18T20:45:50.087547+0000","last_fullsized":"2023-08-18T20:45:50.087547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:51:07.879781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087667+0000","last_change":"2023-08-18T20:45:35.904462+0000","last_active":"2023-08-18T20:45:50.087667+0000","last_peered":"2023-08-18T20:45:50.087667+0000","last_clean":"2023-08-18T20:45:50.087667+0000","last_became_active":"2023-08-18T20:45:35.904204+0000","last_became_peered":"2023-08-18T20:45:35.904204+0000","last_unstale":"2023-08-18T20:45:50.087667+0000","last_undegraded":"2023-08-18T20:45:50.087667+0000","last_fullsized":"2023-08-18T20:45:50.087667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:47:00.258977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220501+0000","last_change":"2023-08-18T20:45:34.963794+0000","last_active":"2023-08-18T20:45:50.220501+0000","last_peered":"2023-08-18T20:45:50.220501+0000","last_clean":"2023-08-18T20:45:50.220501+0000","last_became_active":"2023-08-18T20:45:34.963499+0000","last_became_peered":"2023-08-18T20:45:34.963499+0000","last_unstale":"2023-08-18T20:45:50.220501+0000","last_undegraded":"2023-08-18T20:45:50.220501+0000","last_fullsized":"2023-08-18T20:45:50.220501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:12.774743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476053+0000","last_change":"2023-08-18T20:45:49.110555+0000","last_active":"2023-08-18T20:45:50.476053+0000","last_peered":"2023-08-18T20:45:50.476053+0000","last_clean":"2023-08-18T20:45:50.476053+0000","last_became_active":"2023-08-18T20:45:49.110271+0000","last_became_peered":"2023-08-18T20:45:49.110271+0000","last_unstale":"2023-08-18T20:45:50.476053+0000","last_undegraded":"2023-08-18T20:45:50.476053+0000","last_fullsized":"2023-08-18T20:45:50.476053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:41.464763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.219931+0000","last_change":"2023-08-18T20:45:48.102940+0000","last_active":"2023-08-18T20:45:50.219931+0000","last_peered":"2023-08-18T20:45:50.219931+0000","last_clean":"2023-08-18T20:45:50.219931+0000","last_became_active":"2023-08-18T20:45:48.102612+0000","last_became_peered":"2023-08-18T20:45:48.102612+0000","last_unstale":"2023-08-18T20:45:50.219931+0000","last_undegraded":"2023-08-18T20:45:50.219931+0000","last_fullsized":"2023-08-18T20:45:50.219931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:34:11.385755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083950+0000","last_change":"2023-08-18T20:45:35.891246+0000","last_active":"2023-08-18T20:45:50.083950+0000","last_peered":"2023-08-18T20:45:50.083950+0000","last_clean":"2023-08-18T20:45:50.083950+0000","last_became_active":"2023-08-18T20:45:35.890993+0000","last_became_peered":"2023-08-18T20:45:35.890993+0000","last_unstale":"2023-08-18T20:45:50.083950+0000","last_undegraded":"2023-08-18T20:45:50.083950+0000","last_fullsized":"2023-08-18T20:45:50.083950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:16:51.270223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295009+0000","last_change":"2023-08-18T20:45:34.977145+0000","last_active":"2023-08-18T20:45:50.295009+0000","last_peered":"2023-08-18T20:45:50.295009+0000","last_clean":"2023-08-18T20:45:50.295009+0000","last_became_active":"2023-08-18T20:45:34.976889+0000","last_became_peered":"2023-08-18T20:45:34.976889+0000","last_unstale":"2023-08-18T20:45:50.295009+0000","last_undegraded":"2023-08-18T20:45:50.295009+0000","last_fullsized":"2023-08-18T20:45:50.295009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:04:15.017419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250791+0000","last_change":"2023-08-18T20:45:49.097091+0000","last_active":"2023-08-18T20:45:50.250791+0000","last_peered":"2023-08-18T20:45:50.250791+0000","last_clean":"2023-08-18T20:45:50.250791+0000","last_became_active":"2023-08-18T20:45:49.096825+0000","last_became_peered":"2023-08-18T20:45:49.096825+0000","last_unstale":"2023-08-18T20:45:50.250791+0000","last_undegraded":"2023-08-18T20:45:50.250791+0000","last_fullsized":"2023-08-18T20:45:50.250791+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:13:21.448708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083942+0000","last_change":"2023-08-18T20:45:48.099311+0000","last_active":"2023-08-18T20:45:50.083942+0000","last_peered":"2023-08-18T20:45:50.083942+0000","last_clean":"2023-08-18T20:45:50.083942+0000","last_became_active":"2023-08-18T20:45:48.098996+0000","last_became_peered":"2023-08-18T20:45:48.098996+0000","last_unstale":"2023-08-18T20:45:50.083942+0000","last_undegraded":"2023-08-18T20:45:50.083942+0000","last_fullsized":"2023-08-18T20:45:50.083942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:25.615098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474736+0000","last_change":"2023-08-18T20:45:35.907867+0000","last_active":"2023-08-18T20:45:50.474736+0000","last_peered":"2023-08-18T20:45:50.474736+0000","last_clean":"2023-08-18T20:45:50.474736+0000","last_became_active":"2023-08-18T20:45:35.907577+0000","last_became_peered":"2023-08-18T20:45:35.907577+0000","last_unstale":"2023-08-18T20:45:50.474736+0000","last_undegraded":"2023-08-18T20:45:50.474736+0000","last_fullsized":"2023-08-18T20:45:50.474736+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:19.233819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295082+0000","last_change":"2023-08-18T20:45:34.976208+0000","last_active":"2023-08-18T20:45:50.295082+0000","last_peered":"2023-08-18T20:45:50.295082+0000","last_clean":"2023-08-18T20:45:50.295082+0000","last_became_active":"2023-08-18T20:45:34.975809+0000","last_became_peered":"2023-08-18T20:45:34.975809+0000","last_unstale":"2023-08-18T20:45:50.295082+0000","last_undegraded":"2023-08-18T20:45:50.295082+0000","last_fullsized":"2023-08-18T20:45:50.295082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:51:15.359929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220189+0000","last_change":"2023-08-18T20:45:49.106835+0000","last_active":"2023-08-18T20:45:50.220189+0000","last_peered":"2023-08-18T20:45:50.220189+0000","last_clean":"2023-08-18T20:45:50.220189+0000","last_became_active":"2023-08-18T20:45:49.106517+0000","last_became_peered":"2023-08-18T20:45:49.106517+0000","last_unstale":"2023-08-18T20:45:50.220189+0000","last_undegraded":"2023-08-18T20:45:50.220189+0000","last_fullsized":"2023-08-18T20:45:50.220189+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:50:05.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475902+0000","last_change":"2023-08-18T20:45:48.098856+0000","last_active":"2023-08-18T20:45:50.475902+0000","last_peered":"2023-08-18T20:45:50.475902+0000","last_clean":"2023-08-18T20:45:50.475902+0000","last_became_active":"2023-08-18T20:45:48.098540+0000","last_became_peered":"2023-08-18T20:45:48.098540+0000","last_unstale":"2023-08-18T20:45:50.475902+0000","last_undegraded":"2023-08-18T20:45:50.475902+0000","last_fullsized":"2023-08-18T20:45:50.475902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:46:22.839300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250091+0000","last_change":"2023-08-18T20:45:35.901449+0000","last_active":"2023-08-18T20:45:50.250091+0000","last_peered":"2023-08-18T20:45:50.250091+0000","last_clean":"2023-08-18T20:45:50.250091+0000","last_became_active":"2023-08-18T20:45:35.901106+0000","last_became_peered":"2023-08-18T20:45:35.901106+0000","last_unstale":"2023-08-18T20:45:50.250091+0000","last_undegraded":"2023-08-18T20:45:50.250091+0000","last_fullsized":"2023-08-18T20:45:50.250091+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:44:59.645343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294658+0000","last_change":"2023-08-18T20:45:34.977662+0000","last_active":"2023-08-18T20:45:50.294658+0000","last_peered":"2023-08-18T20:45:50.294658+0000","last_clean":"2023-08-18T20:45:50.294658+0000","last_became_active":"2023-08-18T20:45:34.977395+0000","last_became_peered":"2023-08-18T20:45:34.977395+0000","last_unstale":"2023-08-18T20:45:50.294658+0000","last_undegraded":"2023-08-18T20:45:50.294658+0000","last_fullsized":"2023-08-18T20:45:50.294658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:28:49.488764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220789+0000","last_change":"2023-08-18T20:45:49.112748+0000","last_active":"2023-08-18T20:45:50.220789+0000","last_peered":"2023-08-18T20:45:50.220789+0000","last_clean":"2023-08-18T20:45:50.220789+0000","last_became_active":"2023-08-18T20:45:49.112444+0000","last_became_peered":"2023-08-18T20:45:49.112444+0000","last_unstale":"2023-08-18T20:45:50.220789+0000","last_undegraded":"2023-08-18T20:45:50.220789+0000","last_fullsized":"2023-08-18T20:45:50.220789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:20:02.757611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085800+0000","last_change":"2023-08-18T20:45:48.094431+0000","last_active":"2023-08-18T20:45:50.085800+0000","last_peered":"2023-08-18T20:45:50.085800+0000","last_clean":"2023-08-18T20:45:50.085800+0000","last_became_active":"2023-08-18T20:45:48.094172+0000","last_became_peered":"2023-08-18T20:45:48.094172+0000","last_unstale":"2023-08-18T20:45:50.085800+0000","last_undegraded":"2023-08-18T20:45:50.085800+0000","last_fullsized":"2023-08-18T20:45:50.085800+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:55:40.675240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294910+0000","last_change":"2023-08-18T20:45:35.902649+0000","last_active":"2023-08-18T20:45:50.294910+0000","last_peered":"2023-08-18T20:45:50.294910+0000","last_clean":"2023-08-18T20:45:50.294910+0000","last_became_active":"2023-08-18T20:45:35.902336+0000","last_became_peered":"2023-08-18T20:45:35.902336+0000","last_unstale":"2023-08-18T20:45:50.294910+0000","last_undegraded":"2023-08-18T20:45:50.294910+0000","last_fullsized":"2023-08-18T20:45:50.294910+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:28:06.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250116+0000","last_change":"2023-08-18T20:45:34.974043+0000","last_active":"2023-08-18T20:45:50.250116+0000","last_peered":"2023-08-18T20:45:50.250116+0000","last_clean":"2023-08-18T20:45:50.250116+0000","last_became_active":"2023-08-18T20:45:34.973763+0000","last_became_peered":"2023-08-18T20:45:34.973763+0000","last_unstale":"2023-08-18T20:45:50.250116+0000","last_undegraded":"2023-08-18T20:45:50.250116+0000","last_fullsized":"2023-08-18T20:45:50.250116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:35:59.149839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294861+0000","last_change":"2023-08-18T20:45:49.099815+0000","last_active":"2023-08-18T20:45:50.294861+0000","last_peered":"2023-08-18T20:45:50.294861+0000","last_clean":"2023-08-18T20:45:50.294861+0000","last_became_active":"2023-08-18T20:45:49.099519+0000","last_became_peered":"2023-08-18T20:45:49.099519+0000","last_unstale":"2023-08-18T20:45:50.294861+0000","last_undegraded":"2023-08-18T20:45:50.294861+0000","last_fullsized":"2023-08-18T20:45:50.294861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:28:04.062016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"55'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084859+0000","last_change":"2023-08-18T20:45:48.097288+0000","last_active":"2023-08-18T20:45:50.084859+0000","last_peered":"2023-08-18T20:45:50.084859+0000","last_clean":"2023-08-18T20:45:50.084859+0000","last_became_active":"2023-08-18T20:45:48.095327+0000","last_became_peered":"2023-08-18T20:45:48.095327+0000","last_unstale":"2023-08-18T20:45:50.084859+0000","last_undegraded":"2023-08-18T20:45:50.084859+0000","last_fullsized":"2023-08-18T20:45:50.084859+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:16:04.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475003+0000","last_change":"2023-08-18T20:45:35.888678+0000","last_active":"2023-08-18T20:45:50.475003+0000","last_peered":"2023-08-18T20:45:50.475003+0000","last_clean":"2023-08-18T20:45:50.475003+0000","last_became_active":"2023-08-18T20:45:35.888415+0000","last_became_peered":"2023-08-18T20:45:35.888415+0000","last_unstale":"2023-08-18T20:45:50.475003+0000","last_undegraded":"2023-08-18T20:45:50.475003+0000","last_fullsized":"2023-08-18T20:45:50.475003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:03:26.507636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087421+0000","last_change":"2023-08-18T20:45:34.977639+0000","last_active":"2023-08-18T20:45:50.087421+0000","last_peered":"2023-08-18T20:45:50.087421+0000","last_clean":"2023-08-18T20:45:50.087421+0000","last_became_active":"2023-08-18T20:45:34.977299+0000","last_became_peered":"2023-08-18T20:45:34.977299+0000","last_unstale":"2023-08-18T20:45:50.087421+0000","last_undegraded":"2023-08-18T20:45:50.087421+0000","last_fullsized":"2023-08-18T20:45:50.087421+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:22:30.302588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475068+0000","last_change":"2023-08-18T20:45:49.117823+0000","last_active":"2023-08-18T20:45:50.475068+0000","last_peered":"2023-08-18T20:45:50.475068+0000","last_clean":"2023-08-18T20:45:50.475068+0000","last_became_active":"2023-08-18T20:45:49.117514+0000","last_became_peered":"2023-08-18T20:45:49.117514+0000","last_unstale":"2023-08-18T20:45:50.475068+0000","last_undegraded":"2023-08-18T20:45:50.475068+0000","last_fullsized":"2023-08-18T20:45:50.475068+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:54:16.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"55'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250899+0000","last_change":"2023-08-18T20:45:48.096185+0000","last_active":"2023-08-18T20:45:50.250899+0000","last_peered":"2023-08-18T20:45:50.250899+0000","last_clean":"2023-08-18T20:45:50.250899+0000","last_became_active":"2023-08-18T20:45:48.095929+0000","last_became_peered":"2023-08-18T20:45:48.095929+0000","last_unstale":"2023-08-18T20:45:50.250899+0000","last_undegraded":"2023-08-18T20:45:50.250899+0000","last_fullsized":"2023-08-18T20:45:50.250899+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:54:09.318242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294963+0000","last_change":"2023-08-18T20:45:35.903372+0000","last_active":"2023-08-18T20:45:50.294963+0000","last_peered":"2023-08-18T20:45:50.294963+0000","last_clean":"2023-08-18T20:45:50.294963+0000","last_became_active":"2023-08-18T20:45:35.903163+0000","last_became_peered":"2023-08-18T20:45:35.903163+0000","last_unstale":"2023-08-18T20:45:50.294963+0000","last_undegraded":"2023-08-18T20:45:50.294963+0000","last_fullsized":"2023-08-18T20:45:50.294963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:54:49.007390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476335+0000","last_change":"2023-08-18T20:45:34.965192+0000","last_active":"2023-08-18T20:45:50.476335+0000","last_peered":"2023-08-18T20:45:50.476335+0000","last_clean":"2023-08-18T20:45:50.476335+0000","last_became_active":"2023-08-18T20:45:34.964736+0000","last_became_peered":"2023-08-18T20:45:34.964736+0000","last_unstale":"2023-08-18T20:45:50.476335+0000","last_undegraded":"2023-08-18T20:45:50.476335+0000","last_fullsized":"2023-08-18T20:45:50.476335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:40.842282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220052+0000","last_change":"2023-08-18T20:45:49.106995+0000","last_active":"2023-08-18T20:45:50.220052+0000","last_peered":"2023-08-18T20:45:50.220052+0000","last_clean":"2023-08-18T20:45:50.220052+0000","last_became_active":"2023-08-18T20:45:49.106744+0000","last_became_peered":"2023-08-18T20:45:49.106744+0000","last_unstale":"2023-08-18T20:45:50.220052+0000","last_undegraded":"2023-08-18T20:45:50.220052+0000","last_fullsized":"2023-08-18T20:45:50.220052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:55.601013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087421+0000","last_change":"2023-08-18T20:45:48.100732+0000","last_active":"2023-08-18T20:45:50.087421+0000","last_peered":"2023-08-18T20:45:50.087421+0000","last_clean":"2023-08-18T20:45:50.087421+0000","last_became_active":"2023-08-18T20:45:48.100461+0000","last_became_peered":"2023-08-18T20:45:48.100461+0000","last_unstale":"2023-08-18T20:45:50.087421+0000","last_undegraded":"2023-08-18T20:45:50.087421+0000","last_fullsized":"2023-08-18T20:45:50.087421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:44.238945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250942+0000","last_change":"2023-08-18T20:45:35.905230+0000","last_active":"2023-08-18T20:45:50.250942+0000","last_peered":"2023-08-18T20:45:50.250942+0000","last_clean":"2023-08-18T20:45:50.250942+0000","last_became_active":"2023-08-18T20:45:35.904679+0000","last_became_peered":"2023-08-18T20:45:35.904679+0000","last_unstale":"2023-08-18T20:45:50.250942+0000","last_undegraded":"2023-08-18T20:45:50.250942+0000","last_fullsized":"2023-08-18T20:45:50.250942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:42.481956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"51'3","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087457+0000","last_change":"2023-08-18T20:45:34.977643+0000","last_active":"2023-08-18T20:45:50.087457+0000","last_peered":"2023-08-18T20:45:50.087457+0000","last_clean":"2023-08-18T20:45:50.087457+0000","last_became_active":"2023-08-18T20:45:34.977323+0000","last_became_peered":"2023-08-18T20:45:34.977323+0000","last_unstale":"2023-08-18T20:45:50.087457+0000","last_undegraded":"2023-08-18T20:45:50.087457+0000","last_fullsized":"2023-08-18T20:45:50.087457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:44:37.596930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085636+0000","last_change":"2023-08-18T20:45:49.102200+0000","last_active":"2023-08-18T20:45:50.085636+0000","last_peered":"2023-08-18T20:45:50.085636+0000","last_clean":"2023-08-18T20:45:50.085636+0000","last_became_active":"2023-08-18T20:45:49.101926+0000","last_became_peered":"2023-08-18T20:45:49.101926+0000","last_unstale":"2023-08-18T20:45:50.085636+0000","last_undegraded":"2023-08-18T20:45:50.085636+0000","last_fullsized":"2023-08-18T20:45:50.085636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:42:07.052522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086833+0000","last_change":"2023-08-18T20:45:48.096876+0000","last_active":"2023-08-18T20:45:50.086833+0000","last_peered":"2023-08-18T20:45:50.086833+0000","last_clean":"2023-08-18T20:45:50.086833+0000","last_became_active":"2023-08-18T20:45:48.096577+0000","last_became_peered":"2023-08-18T20:45:48.096577+0000","last_unstale":"2023-08-18T20:45:50.086833+0000","last_undegraded":"2023-08-18T20:45:50.086833+0000","last_fullsized":"2023-08-18T20:45:50.086833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:50:35.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476256+0000","last_change":"2023-08-18T20:45:35.907868+0000","last_active":"2023-08-18T20:45:50.476256+0000","last_peered":"2023-08-18T20:45:50.476256+0000","last_clean":"2023-08-18T20:45:50.476256+0000","last_became_active":"2023-08-18T20:45:35.907562+0000","last_became_peered":"2023-08-18T20:45:35.907562+0000","last_unstale":"2023-08-18T20:45:50.476256+0000","last_undegraded":"2023-08-18T20:45:50.476256+0000","last_fullsized":"2023-08-18T20:45:50.476256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:48:03.888126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"52'9","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474998+0000","last_change":"2023-08-18T20:45:34.967721+0000","last_active":"2023-08-18T20:45:50.474998+0000","last_peered":"2023-08-18T20:45:50.474998+0000","last_clean":"2023-08-18T20:45:50.474998+0000","last_became_active":"2023-08-18T20:45:34.967000+0000","last_became_peered":"2023-08-18T20:45:34.967000+0000","last_unstale":"2023-08-18T20:45:50.474998+0000","last_undegraded":"2023-08-18T20:45:50.474998+0000","last_fullsized":"2023-08-18T20:45:50.474998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:33:30.678774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250557+0000","last_change":"2023-08-18T20:45:49.108242+0000","last_active":"2023-08-18T20:45:50.250557+0000","last_peered":"2023-08-18T20:45:50.250557+0000","last_clean":"2023-08-18T20:45:50.250557+0000","last_became_active":"2023-08-18T20:45:49.107980+0000","last_became_peered":"2023-08-18T20:45:49.107980+0000","last_unstale":"2023-08-18T20:45:50.250557+0000","last_undegraded":"2023-08-18T20:45:50.250557+0000","last_fullsized":"2023-08-18T20:45:50.250557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:34:53.009014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083749+0000","last_change":"2023-08-18T20:45:48.096964+0000","last_active":"2023-08-18T20:45:50.083749+0000","last_peered":"2023-08-18T20:45:50.083749+0000","last_clean":"2023-08-18T20:45:50.083749+0000","last_became_active":"2023-08-18T20:45:48.096687+0000","last_became_peered":"2023-08-18T20:45:48.096687+0000","last_unstale":"2023-08-18T20:45:50.083749+0000","last_undegraded":"2023-08-18T20:45:50.083749+0000","last_fullsized":"2023-08-18T20:45:50.083749+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:22:17.896828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475247+0000","last_change":"2023-08-18T20:45:35.905432+0000","last_active":"2023-08-18T20:45:50.475247+0000","last_peered":"2023-08-18T20:45:50.475247+0000","last_clean":"2023-08-18T20:45:50.475247+0000","last_became_active":"2023-08-18T20:45:35.905124+0000","last_became_peered":"2023-08-18T20:45:35.905124+0000","last_unstale":"2023-08-18T20:45:50.475247+0000","last_undegraded":"2023-08-18T20:45:50.475247+0000","last_fullsized":"2023-08-18T20:45:50.475247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:08:19.233819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087499+0000","last_change":"2023-08-18T20:45:34.979922+0000","last_active":"2023-08-18T20:45:50.087499+0000","last_peered":"2023-08-18T20:45:50.087499+0000","last_clean":"2023-08-18T20:45:50.087499+0000","last_became_active":"2023-08-18T20:45:34.979663+0000","last_became_peered":"2023-08-18T20:45:34.979663+0000","last_unstale":"2023-08-18T20:45:50.087499+0000","last_undegraded":"2023-08-18T20:45:50.087499+0000","last_fullsized":"2023-08-18T20:45:50.087499+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:36:03.595891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251024+0000","last_change":"2023-08-18T20:45:49.093062+0000","last_active":"2023-08-18T20:45:50.251024+0000","last_peered":"2023-08-18T20:45:50.251024+0000","last_clean":"2023-08-18T20:45:50.251024+0000","last_became_active":"2023-08-18T20:45:49.092763+0000","last_became_peered":"2023-08-18T20:45:49.092763+0000","last_unstale":"2023-08-18T20:45:50.251024+0000","last_undegraded":"2023-08-18T20:45:50.251024+0000","last_fullsized":"2023-08-18T20:45:50.251024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:19:42.006590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"55'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220013+0000","last_change":"2023-08-18T20:45:48.102117+0000","last_active":"2023-08-18T20:45:50.220013+0000","last_peered":"2023-08-18T20:45:50.220013+0000","last_clean":"2023-08-18T20:45:50.220013+0000","last_became_active":"2023-08-18T20:45:48.101829+0000","last_became_peered":"2023-08-18T20:45:48.101829+0000","last_unstale":"2023-08-18T20:45:50.220013+0000","last_undegraded":"2023-08-18T20:45:50.220013+0000","last_fullsized":"2023-08-18T20:45:50.220013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085179+0000","last_change":"2023-08-18T20:45:35.905734+0000","last_active":"2023-08-18T20:45:50.085179+0000","last_peered":"2023-08-18T20:45:50.085179+0000","last_clean":"2023-08-18T20:45:50.085179+0000","last_became_active":"2023-08-18T20:45:35.903295+0000","last_became_peered":"2023-08-18T20:45:35.903295+0000","last_unstale":"2023-08-18T20:45:50.085179+0000","last_undegraded":"2023-08-18T20:45:50.085179+0000","last_fullsized":"2023-08-18T20:45:50.085179+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:54:42.481956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085414+0000","last_change":"2023-08-18T20:45:34.976533+0000","last_active":"2023-08-18T20:45:50.085414+0000","last_peered":"2023-08-18T20:45:50.085414+0000","last_clean":"2023-08-18T20:45:50.085414+0000","last_became_active":"2023-08-18T20:45:34.975963+0000","last_became_peered":"2023-08-18T20:45:34.975963+0000","last_unstale":"2023-08-18T20:45:50.085414+0000","last_undegraded":"2023-08-18T20:45:50.085414+0000","last_fullsized":"2023-08-18T20:45:50.085414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:28.998973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086469+0000","last_change":"2023-08-18T20:45:49.107232+0000","last_active":"2023-08-18T20:45:50.086469+0000","last_peered":"2023-08-18T20:45:50.086469+0000","last_clean":"2023-08-18T20:45:50.086469+0000","last_became_active":"2023-08-18T20:45:49.106955+0000","last_became_peered":"2023-08-18T20:45:49.106955+0000","last_unstale":"2023-08-18T20:45:50.086469+0000","last_undegraded":"2023-08-18T20:45:50.086469+0000","last_fullsized":"2023-08-18T20:45:50.086469+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:37.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085348+0000","last_change":"2023-08-18T20:45:48.099995+0000","last_active":"2023-08-18T20:45:50.085348+0000","last_peered":"2023-08-18T20:45:50.085348+0000","last_clean":"2023-08-18T20:45:50.085348+0000","last_became_active":"2023-08-18T20:45:48.099720+0000","last_became_peered":"2023-08-18T20:45:48.099720+0000","last_unstale":"2023-08-18T20:45:50.085348+0000","last_undegraded":"2023-08-18T20:45:50.085348+0000","last_fullsized":"2023-08-18T20:45:50.085348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:41.818030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250160+0000","last_change":"2023-08-18T20:45:35.901127+0000","last_active":"2023-08-18T20:45:50.250160+0000","last_peered":"2023-08-18T20:45:50.250160+0000","last_clean":"2023-08-18T20:45:50.250160+0000","last_became_active":"2023-08-18T20:45:35.900148+0000","last_became_peered":"2023-08-18T20:45:35.900148+0000","last_unstale":"2023-08-18T20:45:50.250160+0000","last_undegraded":"2023-08-18T20:45:50.250160+0000","last_fullsized":"2023-08-18T20:45:50.250160+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T20:48:03.888126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086274+0000","last_change":"2023-08-18T20:45:34.978720+0000","last_active":"2023-08-18T20:45:50.086274+0000","last_peered":"2023-08-18T20:45:50.086274+0000","last_clean":"2023-08-18T20:45:50.086274+0000","last_became_active":"2023-08-18T20:45:34.978408+0000","last_became_peered":"2023-08-18T20:45:34.978408+0000","last_unstale":"2023-08-18T20:45:50.086274+0000","last_undegraded":"2023-08-18T20:45:50.086274+0000","last_fullsized":"2023-08-18T20:45:50.086274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:30:09.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250812+0000","last_change":"2023-08-18T20:45:49.099417+0000","last_active":"2023-08-18T20:45:50.250812+0000","last_peered":"2023-08-18T20:45:50.250812+0000","last_clean":"2023-08-18T20:45:50.250812+0000","last_became_active":"2023-08-18T20:45:49.099130+0000","last_became_peered":"2023-08-18T20:45:49.099130+0000","last_unstale":"2023-08-18T20:45:50.250812+0000","last_undegraded":"2023-08-18T20:45:50.250812+0000","last_fullsized":"2023-08-18T20:45:50.250812+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:43:47.967029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086472+0000","last_change":"2023-08-18T20:45:48.104030+0000","last_active":"2023-08-18T20:45:50.086472+0000","last_peered":"2023-08-18T20:45:50.086472+0000","last_clean":"2023-08-18T20:45:50.086472+0000","last_became_active":"2023-08-18T20:45:48.103769+0000","last_became_peered":"2023-08-18T20:45:48.103769+0000","last_unstale":"2023-08-18T20:45:50.086472+0000","last_undegraded":"2023-08-18T20:45:50.086472+0000","last_fullsized":"2023-08-18T20:45:50.086472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:51:04.480711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474879+0000","last_change":"2023-08-18T20:45:35.904813+0000","last_active":"2023-08-18T20:45:50.474879+0000","last_peered":"2023-08-18T20:45:50.474879+0000","last_clean":"2023-08-18T20:45:50.474879+0000","last_became_active":"2023-08-18T20:45:35.904395+0000","last_became_peered":"2023-08-18T20:45:35.904395+0000","last_unstale":"2023-08-18T20:45:50.474879+0000","last_undegraded":"2023-08-18T20:45:50.474879+0000","last_fullsized":"2023-08-18T20:45:50.474879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:31:28.984964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"51'8","reported_seq":29,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475357+0000","last_change":"2023-08-18T20:45:34.973681+0000","last_active":"2023-08-18T20:45:50.475357+0000","last_peered":"2023-08-18T20:45:50.475357+0000","last_clean":"2023-08-18T20:45:50.475357+0000","last_became_active":"2023-08-18T20:45:34.973398+0000","last_became_peered":"2023-08-18T20:45:34.973398+0000","last_unstale":"2023-08-18T20:45:50.475357+0000","last_undegraded":"2023-08-18T20:45:50.475357+0000","last_fullsized":"2023-08-18T20:45:50.475357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:55:56.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475534+0000","last_change":"2023-08-18T20:45:49.111615+0000","last_active":"2023-08-18T20:45:50.475534+0000","last_peered":"2023-08-18T20:45:50.475534+0000","last_clean":"2023-08-18T20:45:50.475534+0000","last_became_active":"2023-08-18T20:45:49.111310+0000","last_became_peered":"2023-08-18T20:45:49.111310+0000","last_unstale":"2023-08-18T20:45:50.475534+0000","last_undegraded":"2023-08-18T20:45:50.475534+0000","last_fullsized":"2023-08-18T20:45:50.475534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:31:42.104021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087345+0000","last_change":"2023-08-18T20:45:48.099054+0000","last_active":"2023-08-18T20:45:50.087345+0000","last_peered":"2023-08-18T20:45:50.087345+0000","last_clean":"2023-08-18T20:45:50.087345+0000","last_became_active":"2023-08-18T20:45:48.098788+0000","last_became_peered":"2023-08-18T20:45:48.098788+0000","last_unstale":"2023-08-18T20:45:50.087345+0000","last_undegraded":"2023-08-18T20:45:50.087345+0000","last_fullsized":"2023-08-18T20:45:50.087345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:59:14.591791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220376+0000","last_change":"2023-08-18T20:45:35.907903+0000","last_active":"2023-08-18T20:45:50.220376+0000","last_peered":"2023-08-18T20:45:50.220376+0000","last_clean":"2023-08-18T20:45:50.220376+0000","last_became_active":"2023-08-18T20:45:35.907569+0000","last_became_peered":"2023-08-18T20:45:35.907569+0000","last_unstale":"2023-08-18T20:45:50.220376+0000","last_undegraded":"2023-08-18T20:45:50.220376+0000","last_fullsized":"2023-08-18T20:45:50.220376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:28:48.224775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086731+0000","last_change":"2023-08-18T20:45:34.978323+0000","last_active":"2023-08-18T20:45:50.086731+0000","last_peered":"2023-08-18T20:45:50.086731+0000","last_clean":"2023-08-18T20:45:50.086731+0000","last_became_active":"2023-08-18T20:45:34.978045+0000","last_became_peered":"2023-08-18T20:45:34.978045+0000","last_unstale":"2023-08-18T20:45:50.086731+0000","last_undegraded":"2023-08-18T20:45:50.086731+0000","last_fullsized":"2023-08-18T20:45:50.086731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:22.200601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220245+0000","last_change":"2023-08-18T20:45:49.108898+0000","last_active":"2023-08-18T20:45:50.220245+0000","last_peered":"2023-08-18T20:45:50.220245+0000","last_clean":"2023-08-18T20:45:50.220245+0000","last_became_active":"2023-08-18T20:45:49.108625+0000","last_became_peered":"2023-08-18T20:45:49.108625+0000","last_unstale":"2023-08-18T20:45:50.220245+0000","last_undegraded":"2023-08-18T20:45:50.220245+0000","last_fullsized":"2023-08-18T20:45:50.220245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:02:10.855415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087101+0000","last_change":"2023-08-18T20:45:48.100079+0000","last_active":"2023-08-18T20:45:50.087101+0000","last_peered":"2023-08-18T20:45:50.087101+0000","last_clean":"2023-08-18T20:45:50.087101+0000","last_became_active":"2023-08-18T20:45:48.099791+0000","last_became_peered":"2023-08-18T20:45:48.099791+0000","last_unstale":"2023-08-18T20:45:50.087101+0000","last_undegraded":"2023-08-18T20:45:50.087101+0000","last_fullsized":"2023-08-18T20:45:50.087101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:56:45.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085058+0000","last_change":"2023-08-18T20:45:35.900572+0000","last_active":"2023-08-18T20:45:50.085058+0000","last_peered":"2023-08-18T20:45:50.085058+0000","last_clean":"2023-08-18T20:45:50.085058+0000","last_became_active":"2023-08-18T20:45:35.900283+0000","last_became_peered":"2023-08-18T20:45:35.900283+0000","last_unstale":"2023-08-18T20:45:50.085058+0000","last_undegraded":"2023-08-18T20:45:50.085058+0000","last_fullsized":"2023-08-18T20:45:50.085058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:03:18.764268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"52'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086888+0000","last_change":"2023-08-18T20:45:34.976456+0000","last_active":"2023-08-18T20:45:50.086888+0000","last_peered":"2023-08-18T20:45:50.086888+0000","last_clean":"2023-08-18T20:45:50.086888+0000","last_became_active":"2023-08-18T20:45:34.976025+0000","last_became_peered":"2023-08-18T20:45:34.976025+0000","last_unstale":"2023-08-18T20:45:50.086888+0000","last_undegraded":"2023-08-18T20:45:50.086888+0000","last_fullsized":"2023-08-18T20:45:50.086888+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:22.093838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475239+0000","last_change":"2023-08-18T20:45:49.107952+0000","last_active":"2023-08-18T20:45:50.475239+0000","last_peered":"2023-08-18T20:45:50.475239+0000","last_clean":"2023-08-18T20:45:50.475239+0000","last_became_active":"2023-08-18T20:45:49.107330+0000","last_became_peered":"2023-08-18T20:45:49.107330+0000","last_unstale":"2023-08-18T20:45:50.475239+0000","last_undegraded":"2023-08-18T20:45:50.475239+0000","last_fullsized":"2023-08-18T20:45:50.475239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:23:31.185569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086562+0000","last_change":"2023-08-18T20:45:48.098058+0000","last_active":"2023-08-18T20:45:50.086562+0000","last_peered":"2023-08-18T20:45:50.086562+0000","last_clean":"2023-08-18T20:45:50.086562+0000","last_became_active":"2023-08-18T20:45:48.097827+0000","last_became_peered":"2023-08-18T20:45:48.097827+0000","last_unstale":"2023-08-18T20:45:50.086562+0000","last_undegraded":"2023-08-18T20:45:50.086562+0000","last_fullsized":"2023-08-18T20:45:50.086562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:20:14.773116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086774+0000","last_change":"2023-08-18T20:45:35.903676+0000","last_active":"2023-08-18T20:45:50.086774+0000","last_peered":"2023-08-18T20:45:50.086774+0000","last_clean":"2023-08-18T20:45:50.086774+0000","last_became_active":"2023-08-18T20:45:35.902862+0000","last_became_peered":"2023-08-18T20:45:35.902862+0000","last_unstale":"2023-08-18T20:45:50.086774+0000","last_undegraded":"2023-08-18T20:45:50.086774+0000","last_fullsized":"2023-08-18T20:45:50.086774+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:52:16.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220423+0000","last_change":"2023-08-18T20:45:34.972345+0000","last_active":"2023-08-18T20:45:50.220423+0000","last_peered":"2023-08-18T20:45:50.220423+0000","last_clean":"2023-08-18T20:45:50.220423+0000","last_became_active":"2023-08-18T20:45:34.971833+0000","last_became_peered":"2023-08-18T20:45:34.971833+0000","last_unstale":"2023-08-18T20:45:50.220423+0000","last_undegraded":"2023-08-18T20:45:50.220423+0000","last_fullsized":"2023-08-18T20:45:50.220423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:53:53.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250169+0000","last_change":"2023-08-18T20:45:49.100112+0000","last_active":"2023-08-18T20:45:50.250169+0000","last_peered":"2023-08-18T20:45:50.250169+0000","last_clean":"2023-08-18T20:45:50.250169+0000","last_became_active":"2023-08-18T20:45:49.099827+0000","last_became_peered":"2023-08-18T20:45:49.099827+0000","last_unstale":"2023-08-18T20:45:50.250169+0000","last_undegraded":"2023-08-18T20:45:50.250169+0000","last_fullsized":"2023-08-18T20:45:50.250169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:41:49.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220595+0000","last_change":"2023-08-18T20:45:48.104128+0000","last_active":"2023-08-18T20:45:50.220595+0000","last_peered":"2023-08-18T20:45:50.220595+0000","last_clean":"2023-08-18T20:45:50.220595+0000","last_became_active":"2023-08-18T20:45:48.103849+0000","last_became_peered":"2023-08-18T20:45:48.103849+0000","last_unstale":"2023-08-18T20:45:50.220595+0000","last_undegraded":"2023-08-18T20:45:50.220595+0000","last_fullsized":"2023-08-18T20:45:50.220595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:44:35.322510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250941+0000","last_change":"2023-08-18T20:45:35.898724+0000","last_active":"2023-08-18T20:45:50.250941+0000","last_peered":"2023-08-18T20:45:50.250941+0000","last_clean":"2023-08-18T20:45:50.250941+0000","last_became_active":"2023-08-18T20:45:35.898443+0000","last_became_peered":"2023-08-18T20:45:35.898443+0000","last_unstale":"2023-08-18T20:45:50.250941+0000","last_undegraded":"2023-08-18T20:45:50.250941+0000","last_fullsized":"2023-08-18T20:45:50.250941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:41:53.933466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474882+0000","last_change":"2023-08-18T20:45:34.967849+0000","last_active":"2023-08-18T20:45:50.474882+0000","last_peered":"2023-08-18T20:45:50.474882+0000","last_clean":"2023-08-18T20:45:50.474882+0000","last_became_active":"2023-08-18T20:45:34.967588+0000","last_became_peered":"2023-08-18T20:45:34.967588+0000","last_unstale":"2023-08-18T20:45:50.474882+0000","last_undegraded":"2023-08-18T20:45:50.474882+0000","last_fullsized":"2023-08-18T20:45:50.474882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:34:02.953170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475277+0000","last_change":"2023-08-18T20:45:49.102492+0000","last_active":"2023-08-18T20:45:50.475277+0000","last_peered":"2023-08-18T20:45:50.475277+0000","last_clean":"2023-08-18T20:45:50.475277+0000","last_became_active":"2023-08-18T20:45:49.102141+0000","last_became_peered":"2023-08-18T20:45:49.102141+0000","last_unstale":"2023-08-18T20:45:50.475277+0000","last_undegraded":"2023-08-18T20:45:50.475277+0000","last_fullsized":"2023-08-18T20:45:50.475277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:58:46.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250611+0000","last_change":"2023-08-18T20:45:48.091171+0000","last_active":"2023-08-18T20:45:50.250611+0000","last_peered":"2023-08-18T20:45:50.250611+0000","last_clean":"2023-08-18T20:45:50.250611+0000","last_became_active":"2023-08-18T20:45:48.090499+0000","last_became_peered":"2023-08-18T20:45:48.090499+0000","last_unstale":"2023-08-18T20:45:50.250611+0000","last_undegraded":"2023-08-18T20:45:50.250611+0000","last_fullsized":"2023-08-18T20:45:50.250611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:56:06.440689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250101+0000","last_change":"2023-08-18T20:45:35.897819+0000","last_active":"2023-08-18T20:45:50.250101+0000","last_peered":"2023-08-18T20:45:50.250101+0000","last_clean":"2023-08-18T20:45:50.250101+0000","last_became_active":"2023-08-18T20:45:35.897534+0000","last_became_peered":"2023-08-18T20:45:35.897534+0000","last_unstale":"2023-08-18T20:45:50.250101+0000","last_undegraded":"2023-08-18T20:45:50.250101+0000","last_fullsized":"2023-08-18T20:45:50.250101+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:06.165927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087634+0000","last_change":"2023-08-18T20:45:34.979956+0000","last_active":"2023-08-18T20:45:50.087634+0000","last_peered":"2023-08-18T20:45:50.087634+0000","last_clean":"2023-08-18T20:45:50.087634+0000","last_became_active":"2023-08-18T20:45:34.979674+0000","last_became_peered":"2023-08-18T20:45:34.979674+0000","last_unstale":"2023-08-18T20:45:50.087634+0000","last_undegraded":"2023-08-18T20:45:50.087634+0000","last_fullsized":"2023-08-18T20:45:50.087634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:38:43.424408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475328+0000","last_change":"2023-08-18T20:45:49.102682+0000","last_active":"2023-08-18T20:45:50.475328+0000","last_peered":"2023-08-18T20:45:50.475328+0000","last_clean":"2023-08-18T20:45:50.475328+0000","last_became_active":"2023-08-18T20:45:49.102234+0000","last_became_peered":"2023-08-18T20:45:49.102234+0000","last_unstale":"2023-08-18T20:45:50.475328+0000","last_undegraded":"2023-08-18T20:45:50.475328+0000","last_fullsized":"2023-08-18T20:45:50.475328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:41.464763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474598+0000","last_change":"2023-08-18T20:45:48.091909+0000","last_active":"2023-08-18T20:45:50.474598+0000","last_peered":"2023-08-18T20:45:50.474598+0000","last_clean":"2023-08-18T20:45:50.474598+0000","last_became_active":"2023-08-18T20:45:48.091657+0000","last_became_peered":"2023-08-18T20:45:48.091657+0000","last_unstale":"2023-08-18T20:45:50.474598+0000","last_undegraded":"2023-08-18T20:45:50.474598+0000","last_fullsized":"2023-08-18T20:45:50.474598+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:31:57.749029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.475467+0000","last_change":"2023-08-18T20:45:35.905583+0000","last_active":"2023-08-18T20:45:50.475467+0000","last_peered":"2023-08-18T20:45:50.475467+0000","last_clean":"2023-08-18T20:45:50.475467+0000","last_became_active":"2023-08-18T20:45:35.905306+0000","last_became_peered":"2023-08-18T20:45:35.905306+0000","last_unstale":"2023-08-18T20:45:50.475467+0000","last_undegraded":"2023-08-18T20:45:50.475467+0000","last_fullsized":"2023-08-18T20:45:50.475467+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:33:31.685321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294944+0000","last_change":"2023-08-18T20:45:34.976273+0000","last_active":"2023-08-18T20:45:50.294944+0000","last_peered":"2023-08-18T20:45:50.294944+0000","last_clean":"2023-08-18T20:45:50.294944+0000","last_became_active":"2023-08-18T20:45:34.975767+0000","last_became_peered":"2023-08-18T20:45:34.975767+0000","last_unstale":"2023-08-18T20:45:50.294944+0000","last_undegraded":"2023-08-18T20:45:50.294944+0000","last_fullsized":"2023-08-18T20:45:50.294944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:50:26.231804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250681+0000","last_change":"2023-08-18T20:45:49.093195+0000","last_active":"2023-08-18T20:45:50.250681+0000","last_peered":"2023-08-18T20:45:50.250681+0000","last_clean":"2023-08-18T20:45:50.250681+0000","last_became_active":"2023-08-18T20:45:49.092909+0000","last_became_peered":"2023-08-18T20:45:49.092909+0000","last_unstale":"2023-08-18T20:45:50.250681+0000","last_undegraded":"2023-08-18T20:45:50.250681+0000","last_fullsized":"2023-08-18T20:45:50.250681+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:23:00.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250704+0000","last_change":"2023-08-18T20:45:48.096855+0000","last_active":"2023-08-18T20:45:50.250704+0000","last_peered":"2023-08-18T20:45:50.250704+0000","last_clean":"2023-08-18T20:45:50.250704+0000","last_became_active":"2023-08-18T20:45:48.096595+0000","last_became_peered":"2023-08-18T20:45:48.096595+0000","last_unstale":"2023-08-18T20:45:50.250704+0000","last_undegraded":"2023-08-18T20:45:50.250704+0000","last_fullsized":"2023-08-18T20:45:50.250704+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:33:49.552446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474802+0000","last_change":"2023-08-18T20:45:35.902727+0000","last_active":"2023-08-18T20:45:50.474802+0000","last_peered":"2023-08-18T20:45:50.474802+0000","last_clean":"2023-08-18T20:45:50.474802+0000","last_became_active":"2023-08-18T20:45:35.902454+0000","last_became_peered":"2023-08-18T20:45:35.902454+0000","last_unstale":"2023-08-18T20:45:50.474802+0000","last_undegraded":"2023-08-18T20:45:50.474802+0000","last_fullsized":"2023-08-18T20:45:50.474802+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:35:16.773417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294607+0000","last_change":"2023-08-18T20:45:34.977507+0000","last_active":"2023-08-18T20:45:50.294607+0000","last_peered":"2023-08-18T20:45:50.294607+0000","last_clean":"2023-08-18T20:45:50.294607+0000","last_became_active":"2023-08-18T20:45:34.977042+0000","last_became_peered":"2023-08-18T20:45:34.977042+0000","last_unstale":"2023-08-18T20:45:50.294607+0000","last_undegraded":"2023-08-18T20:45:50.294607+0000","last_fullsized":"2023-08-18T20:45:50.294607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:13:41.724053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250410+0000","last_change":"2023-08-18T20:45:49.096842+0000","last_active":"2023-08-18T20:45:50.250410+0000","last_peered":"2023-08-18T20:45:50.250410+0000","last_clean":"2023-08-18T20:45:50.250410+0000","last_became_active":"2023-08-18T20:45:49.096559+0000","last_became_peered":"2023-08-18T20:45:49.096559+0000","last_unstale":"2023-08-18T20:45:50.250410+0000","last_undegraded":"2023-08-18T20:45:50.250410+0000","last_fullsized":"2023-08-18T20:45:50.250410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:01:24.061777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083780+0000","last_change":"2023-08-18T20:45:48.100547+0000","last_active":"2023-08-18T20:45:50.083780+0000","last_peered":"2023-08-18T20:45:50.083780+0000","last_clean":"2023-08-18T20:45:50.083780+0000","last_became_active":"2023-08-18T20:45:48.100239+0000","last_became_peered":"2023-08-18T20:45:48.100239+0000","last_unstale":"2023-08-18T20:45:50.083780+0000","last_undegraded":"2023-08-18T20:45:50.083780+0000","last_fullsized":"2023-08-18T20:45:50.083780+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:04:40.336594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084039+0000","last_change":"2023-08-18T20:45:35.904814+0000","last_active":"2023-08-18T20:45:50.084039+0000","last_peered":"2023-08-18T20:45:50.084039+0000","last_clean":"2023-08-18T20:45:50.084039+0000","last_became_active":"2023-08-18T20:45:35.904550+0000","last_became_peered":"2023-08-18T20:45:35.904550+0000","last_unstale":"2023-08-18T20:45:50.084039+0000","last_undegraded":"2023-08-18T20:45:50.084039+0000","last_fullsized":"2023-08-18T20:45:50.084039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:03:07.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474686+0000","last_change":"2023-08-18T20:45:34.973010+0000","last_active":"2023-08-18T20:45:50.474686+0000","last_peered":"2023-08-18T20:45:50.474686+0000","last_clean":"2023-08-18T20:45:50.474686+0000","last_became_active":"2023-08-18T20:45:34.972735+0000","last_became_peered":"2023-08-18T20:45:34.972735+0000","last_unstale":"2023-08-18T20:45:50.474686+0000","last_undegraded":"2023-08-18T20:45:50.474686+0000","last_fullsized":"2023-08-18T20:45:50.474686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T00:33:25.564444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083745+0000","last_change":"2023-08-18T20:45:49.101885+0000","last_active":"2023-08-18T20:45:50.083745+0000","last_peered":"2023-08-18T20:45:50.083745+0000","last_clean":"2023-08-18T20:45:50.083745+0000","last_became_active":"2023-08-18T20:45:49.101609+0000","last_became_peered":"2023-08-18T20:45:49.101609+0000","last_unstale":"2023-08-18T20:45:50.083745+0000","last_undegraded":"2023-08-18T20:45:50.083745+0000","last_fullsized":"2023-08-18T20:45:50.083745+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:45:50.918567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.084718+0000","last_change":"2023-08-18T20:45:48.095569+0000","last_active":"2023-08-18T20:45:50.084718+0000","last_peered":"2023-08-18T20:45:50.084718+0000","last_clean":"2023-08-18T20:45:50.084718+0000","last_became_active":"2023-08-18T20:45:48.095017+0000","last_became_peered":"2023-08-18T20:45:48.095017+0000","last_unstale":"2023-08-18T20:45:50.084718+0000","last_undegraded":"2023-08-18T20:45:50.084718+0000","last_fullsized":"2023-08-18T20:45:50.084718+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:39:22.082008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087191+0000","last_change":"2023-08-18T20:45:35.910372+0000","last_active":"2023-08-18T20:45:50.087191+0000","last_peered":"2023-08-18T20:45:50.087191+0000","last_clean":"2023-08-18T20:45:50.087191+0000","last_became_active":"2023-08-18T20:45:35.907965+0000","last_became_peered":"2023-08-18T20:45:35.907965+0000","last_unstale":"2023-08-18T20:45:50.087191+0000","last_undegraded":"2023-08-18T20:45:50.087191+0000","last_fullsized":"2023-08-18T20:45:50.087191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:29:32.362055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086676+0000","last_change":"2023-08-18T20:45:34.976242+0000","last_active":"2023-08-18T20:45:50.086676+0000","last_peered":"2023-08-18T20:45:50.086676+0000","last_clean":"2023-08-18T20:45:50.086676+0000","last_became_active":"2023-08-18T20:45:34.975953+0000","last_became_peered":"2023-08-18T20:45:34.975953+0000","last_unstale":"2023-08-18T20:45:50.086676+0000","last_undegraded":"2023-08-18T20:45:50.086676+0000","last_fullsized":"2023-08-18T20:45:50.086676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:25:18.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250834+0000","last_change":"2023-08-18T20:43:38.550371+0000","last_active":"2023-08-18T20:45:50.250834+0000","last_peered":"2023-08-18T20:45:50.250834+0000","last_clean":"2023-08-18T20:45:50.250834+0000","last_became_active":"2023-08-18T20:43:38.550034+0000","last_became_peered":"2023-08-18T20:43:38.550034+0000","last_unstale":"2023-08-18T20:45:50.250834+0000","last_undegraded":"2023-08-18T20:45:50.250834+0000","last_fullsized":"2023-08-18T20:45:50.250834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:58:23.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294821+0000","last_change":"2023-08-18T20:45:49.103360+0000","last_active":"2023-08-18T20:45:50.294821+0000","last_peered":"2023-08-18T20:45:50.294821+0000","last_clean":"2023-08-18T20:45:50.294821+0000","last_became_active":"2023-08-18T20:45:49.103059+0000","last_became_peered":"2023-08-18T20:45:49.103059+0000","last_unstale":"2023-08-18T20:45:50.294821+0000","last_undegraded":"2023-08-18T20:45:50.294821+0000","last_fullsized":"2023-08-18T20:45:50.294821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:49:34.858707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474829+0000","last_change":"2023-08-18T20:45:48.094558+0000","last_active":"2023-08-18T20:45:50.474829+0000","last_peered":"2023-08-18T20:45:50.474829+0000","last_clean":"2023-08-18T20:45:50.474829+0000","last_became_active":"2023-08-18T20:45:48.094090+0000","last_became_peered":"2023-08-18T20:45:48.094090+0000","last_unstale":"2023-08-18T20:45:50.474829+0000","last_undegraded":"2023-08-18T20:45:50.474829+0000","last_fullsized":"2023-08-18T20:45:50.474829+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:25:17.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250882+0000","last_change":"2023-08-18T20:45:35.907483+0000","last_active":"2023-08-18T20:45:50.250882+0000","last_peered":"2023-08-18T20:45:50.250882+0000","last_clean":"2023-08-18T20:45:50.250882+0000","last_became_active":"2023-08-18T20:45:35.906686+0000","last_became_peered":"2023-08-18T20:45:35.906686+0000","last_unstale":"2023-08-18T20:45:50.250882+0000","last_undegraded":"2023-08-18T20:45:50.250882+0000","last_fullsized":"2023-08-18T20:45:50.250882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:37.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087817+0000","last_change":"2023-08-18T20:45:34.978091+0000","last_active":"2023-08-18T20:45:50.087817+0000","last_peered":"2023-08-18T20:45:50.087817+0000","last_clean":"2023-08-18T20:45:50.087817+0000","last_became_active":"2023-08-18T20:45:34.977812+0000","last_became_peered":"2023-08-18T20:45:34.977812+0000","last_unstale":"2023-08-18T20:45:50.087817+0000","last_undegraded":"2023-08-18T20:45:50.087817+0000","last_fullsized":"2023-08-18T20:45:50.087817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:08:01.923345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250942+0000","last_change":"2023-08-18T20:43:38.574508+0000","last_active":"2023-08-18T20:45:50.250942+0000","last_peered":"2023-08-18T20:45:50.250942+0000","last_clean":"2023-08-18T20:45:50.250942+0000","last_became_active":"2023-08-18T20:43:38.574212+0000","last_became_peered":"2023-08-18T20:43:38.574212+0000","last_unstale":"2023-08-18T20:45:50.250942+0000","last_undegraded":"2023-08-18T20:45:50.250942+0000","last_fullsized":"2023-08-18T20:45:50.250942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:44:17.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220517+0000","last_change":"2023-08-18T20:45:49.107055+0000","last_active":"2023-08-18T20:45:50.220517+0000","last_peered":"2023-08-18T20:45:50.220517+0000","last_clean":"2023-08-18T20:45:50.220517+0000","last_became_active":"2023-08-18T20:45:49.106793+0000","last_became_peered":"2023-08-18T20:45:49.106793+0000","last_unstale":"2023-08-18T20:45:50.220517+0000","last_undegraded":"2023-08-18T20:45:50.220517+0000","last_fullsized":"2023-08-18T20:45:50.220517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:48:20.528110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294917+0000","last_change":"2023-08-18T20:45:48.098230+0000","last_active":"2023-08-18T20:45:50.294917+0000","last_peered":"2023-08-18T20:45:50.294917+0000","last_clean":"2023-08-18T20:45:50.294917+0000","last_became_active":"2023-08-18T20:45:48.097967+0000","last_became_peered":"2023-08-18T20:45:48.097967+0000","last_unstale":"2023-08-18T20:45:50.294917+0000","last_undegraded":"2023-08-18T20:45:50.294917+0000","last_fullsized":"2023-08-18T20:45:50.294917+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:03:41.873552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250296+0000","last_change":"2023-08-18T20:45:35.901362+0000","last_active":"2023-08-18T20:45:50.250296+0000","last_peered":"2023-08-18T20:45:50.250296+0000","last_clean":"2023-08-18T20:45:50.250296+0000","last_became_active":"2023-08-18T20:45:35.900540+0000","last_became_peered":"2023-08-18T20:45:35.900540+0000","last_unstale":"2023-08-18T20:45:50.250296+0000","last_undegraded":"2023-08-18T20:45:50.250296+0000","last_fullsized":"2023-08-18T20:45:50.250296+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:28.907738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220410+0000","last_change":"2023-08-18T20:45:34.974454+0000","last_active":"2023-08-18T20:45:50.220410+0000","last_peered":"2023-08-18T20:45:50.220410+0000","last_clean":"2023-08-18T20:45:50.220410+0000","last_became_active":"2023-08-18T20:45:34.974193+0000","last_became_peered":"2023-08-18T20:45:34.974193+0000","last_unstale":"2023-08-18T20:45:50.220410+0000","last_undegraded":"2023-08-18T20:45:50.220410+0000","last_fullsized":"2023-08-18T20:45:50.220410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:20:01.651207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085572+0000","last_change":"2023-08-18T20:43:38.573872+0000","last_active":"2023-08-18T20:45:50.085572+0000","last_peered":"2023-08-18T20:45:50.085572+0000","last_clean":"2023-08-18T20:45:50.085572+0000","last_became_active":"2023-08-18T20:43:38.573457+0000","last_became_peered":"2023-08-18T20:43:38.573457+0000","last_unstale":"2023-08-18T20:45:50.085572+0000","last_undegraded":"2023-08-18T20:45:50.085572+0000","last_fullsized":"2023-08-18T20:45:50.085572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:34:29.107120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087192+0000","last_change":"2023-08-18T20:45:49.102167+0000","last_active":"2023-08-18T20:45:50.087192+0000","last_peered":"2023-08-18T20:45:50.087192+0000","last_clean":"2023-08-18T20:45:50.087192+0000","last_became_active":"2023-08-18T20:45:49.101893+0000","last_became_peered":"2023-08-18T20:45:49.101893+0000","last_unstale":"2023-08-18T20:45:50.087192+0000","last_undegraded":"2023-08-18T20:45:50.087192+0000","last_fullsized":"2023-08-18T20:45:50.087192+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:06:15.693695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295178+0000","last_change":"2023-08-18T20:45:48.092956+0000","last_active":"2023-08-18T20:45:50.295178+0000","last_peered":"2023-08-18T20:45:50.295178+0000","last_clean":"2023-08-18T20:45:50.295178+0000","last_became_active":"2023-08-18T20:45:48.092647+0000","last_became_peered":"2023-08-18T20:45:48.092647+0000","last_unstale":"2023-08-18T20:45:50.295178+0000","last_undegraded":"2023-08-18T20:45:50.295178+0000","last_fullsized":"2023-08-18T20:45:50.295178+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:31:40.877512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.250459+0000","last_change":"2023-08-18T20:45:35.900789+0000","last_active":"2023-08-18T20:45:50.250459+0000","last_peered":"2023-08-18T20:45:50.250459+0000","last_clean":"2023-08-18T20:45:50.250459+0000","last_became_active":"2023-08-18T20:45:35.900218+0000","last_became_peered":"2023-08-18T20:45:35.900218+0000","last_unstale":"2023-08-18T20:45:50.250459+0000","last_undegraded":"2023-08-18T20:45:50.250459+0000","last_fullsized":"2023-08-18T20:45:50.250459+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:04:54.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294644+0000","last_change":"2023-08-18T20:45:34.976358+0000","last_active":"2023-08-18T20:45:50.294644+0000","last_peered":"2023-08-18T20:45:50.294644+0000","last_clean":"2023-08-18T20:45:50.294644+0000","last_became_active":"2023-08-18T20:45:34.976019+0000","last_became_peered":"2023-08-18T20:45:34.976019+0000","last_unstale":"2023-08-18T20:45:50.294644+0000","last_undegraded":"2023-08-18T20:45:50.294644+0000","last_fullsized":"2023-08-18T20:45:50.294644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:51:53.467255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086599+0000","last_change":"2023-08-18T20:43:38.574567+0000","last_active":"2023-08-18T20:45:50.086599+0000","last_peered":"2023-08-18T20:45:50.086599+0000","last_clean":"2023-08-18T20:45:50.086599+0000","last_became_active":"2023-08-18T20:43:38.574239+0000","last_became_peered":"2023-08-18T20:43:38.574239+0000","last_unstale":"2023-08-18T20:45:50.086599+0000","last_undegraded":"2023-08-18T20:45:50.086599+0000","last_fullsized":"2023-08-18T20:45:50.086599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:45:55.305453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251123+0000","last_change":"2023-08-18T20:45:49.102540+0000","last_active":"2023-08-18T20:45:50.251123+0000","last_peered":"2023-08-18T20:45:50.251123+0000","last_clean":"2023-08-18T20:45:50.251123+0000","last_became_active":"2023-08-18T20:45:49.102269+0000","last_became_peered":"2023-08-18T20:45:49.102269+0000","last_unstale":"2023-08-18T20:45:50.251123+0000","last_undegraded":"2023-08-18T20:45:50.251123+0000","last_fullsized":"2023-08-18T20:45:50.251123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:34:12.389449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294555+0000","last_change":"2023-08-18T20:45:48.093876+0000","last_active":"2023-08-18T20:45:50.294555+0000","last_peered":"2023-08-18T20:45:50.294555+0000","last_clean":"2023-08-18T20:45:50.294555+0000","last_became_active":"2023-08-18T20:45:48.093609+0000","last_became_peered":"2023-08-18T20:45:48.093609+0000","last_unstale":"2023-08-18T20:45:50.294555+0000","last_undegraded":"2023-08-18T20:45:50.294555+0000","last_fullsized":"2023-08-18T20:45:50.294555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:01:57.366750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085430+0000","last_change":"2023-08-18T20:45:35.903258+0000","last_active":"2023-08-18T20:45:50.085430+0000","last_peered":"2023-08-18T20:45:50.085430+0000","last_clean":"2023-08-18T20:45:50.085430+0000","last_became_active":"2023-08-18T20:45:35.902942+0000","last_became_peered":"2023-08-18T20:45:35.902942+0000","last_unstale":"2023-08-18T20:45:50.085430+0000","last_undegraded":"2023-08-18T20:45:50.085430+0000","last_fullsized":"2023-08-18T20:45:50.085430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:33:59.270393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.085733+0000","last_change":"2023-08-18T20:45:34.975679+0000","last_active":"2023-08-18T20:45:50.085733+0000","last_peered":"2023-08-18T20:45:50.085733+0000","last_clean":"2023-08-18T20:45:50.085733+0000","last_became_active":"2023-08-18T20:45:34.975369+0000","last_became_peered":"2023-08-18T20:45:34.975369+0000","last_unstale":"2023-08-18T20:45:50.085733+0000","last_undegraded":"2023-08-18T20:45:50.085733+0000","last_fullsized":"2023-08-18T20:45:50.085733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T21:51:28.574638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086049+0000","last_change":"2023-08-18T20:43:38.574609+0000","last_active":"2023-08-18T20:45:50.086049+0000","last_peered":"2023-08-18T20:45:50.086049+0000","last_clean":"2023-08-18T20:45:50.086049+0000","last_became_active":"2023-08-18T20:43:38.574264+0000","last_became_peered":"2023-08-18T20:43:38.574264+0000","last_unstale":"2023-08-18T20:45:50.086049+0000","last_undegraded":"2023-08-18T20:45:50.086049+0000","last_fullsized":"2023-08-18T20:45:50.086049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T05:42:40.730655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220737+0000","last_change":"2023-08-18T20:45:49.115470+0000","last_active":"2023-08-18T20:45:50.220737+0000","last_peered":"2023-08-18T20:45:50.220737+0000","last_clean":"2023-08-18T20:45:50.220737+0000","last_became_active":"2023-08-18T20:45:49.115109+0000","last_became_peered":"2023-08-18T20:45:49.115109+0000","last_unstale":"2023-08-18T20:45:50.220737+0000","last_undegraded":"2023-08-18T20:45:50.220737+0000","last_fullsized":"2023-08-18T20:45:50.220737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:42:36.219442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295095+0000","last_change":"2023-08-18T20:45:48.091236+0000","last_active":"2023-08-18T20:45:50.295095+0000","last_peered":"2023-08-18T20:45:50.295095+0000","last_clean":"2023-08-18T20:45:50.295095+0000","last_became_active":"2023-08-18T20:45:48.090997+0000","last_became_peered":"2023-08-18T20:45:48.090997+0000","last_unstale":"2023-08-18T20:45:50.295095+0000","last_undegraded":"2023-08-18T20:45:50.295095+0000","last_fullsized":"2023-08-18T20:45:50.295095+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T01:48:13.578398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220376+0000","last_change":"2023-08-18T20:45:35.901239+0000","last_active":"2023-08-18T20:45:50.220376+0000","last_peered":"2023-08-18T20:45:50.220376+0000","last_clean":"2023-08-18T20:45:50.220376+0000","last_became_active":"2023-08-18T20:45:35.900850+0000","last_became_peered":"2023-08-18T20:45:35.900850+0000","last_unstale":"2023-08-18T20:45:50.220376+0000","last_undegraded":"2023-08-18T20:45:50.220376+0000","last_fullsized":"2023-08-18T20:45:50.220376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:23:24.757067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"51'2","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.220487+0000","last_change":"2023-08-18T20:45:34.970857+0000","last_active":"2023-08-18T20:45:50.220487+0000","last_peered":"2023-08-18T20:45:50.220487+0000","last_clean":"2023-08-18T20:45:50.220487+0000","last_became_active":"2023-08-18T20:45:34.970218+0000","last_became_peered":"2023-08-18T20:45:34.970218+0000","last_unstale":"2023-08-18T20:45:50.220487+0000","last_undegraded":"2023-08-18T20:45:50.220487+0000","last_fullsized":"2023-08-18T20:45:50.220487+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T06:09:06.586449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.086320+0000","last_change":"2023-08-18T20:43:38.550964+0000","last_active":"2023-08-18T20:45:50.086320+0000","last_peered":"2023-08-18T20:45:50.086320+0000","last_clean":"2023-08-18T20:45:50.086320+0000","last_became_active":"2023-08-18T20:43:38.549723+0000","last_became_peered":"2023-08-18T20:43:38.549723+0000","last_unstale":"2023-08-18T20:45:50.086320+0000","last_undegraded":"2023-08-18T20:45:50.086320+0000","last_fullsized":"2023-08-18T20:45:50.086320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:09:12.095253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.474818+0000","last_change":"2023-08-18T20:43:38.548369+0000","last_active":"2023-08-18T20:45:50.474818+0000","last_peered":"2023-08-18T20:45:50.474818+0000","last_clean":"2023-08-18T20:45:50.474818+0000","last_became_active":"2023-08-18T20:43:38.548132+0000","last_became_peered":"2023-08-18T20:43:38.548132+0000","last_unstale":"2023-08-18T20:45:50.474818+0000","last_undegraded":"2023-08-18T20:45:50.474818+0000","last_fullsized":"2023-08-18T20:45:50.474818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:53:59.891577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.083700+0000","last_change":"2023-08-18T20:45:49.095928+0000","last_active":"2023-08-18T20:45:50.083700+0000","last_peered":"2023-08-18T20:45:50.083700+0000","last_clean":"2023-08-18T20:45:50.083700+0000","last_became_active":"2023-08-18T20:45:49.094918+0000","last_became_peered":"2023-08-18T20:45:49.094918+0000","last_unstale":"2023-08-18T20:45:50.083700+0000","last_undegraded":"2023-08-18T20:45:50.083700+0000","last_fullsized":"2023-08-18T20:45:50.083700+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T22:46:36.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"55'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476131+0000","last_change":"2023-08-18T20:45:48.097543+0000","last_active":"2023-08-18T20:45:50.476131+0000","last_peered":"2023-08-18T20:45:50.476131+0000","last_clean":"2023-08-18T20:45:50.476131+0000","last_became_active":"2023-08-18T20:45:48.095231+0000","last_became_peered":"2023-08-18T20:45:48.095231+0000","last_unstale":"2023-08-18T20:45:50.476131+0000","last_undegraded":"2023-08-18T20:45:50.476131+0000","last_fullsized":"2023-08-18T20:45:50.476131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:11:18.281289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.251084+0000","last_change":"2023-08-18T20:45:35.898795+0000","last_active":"2023-08-18T20:45:50.251084+0000","last_peered":"2023-08-18T20:45:50.251084+0000","last_clean":"2023-08-18T20:45:50.251084+0000","last_became_active":"2023-08-18T20:45:35.898518+0000","last_became_peered":"2023-08-18T20:45:35.898518+0000","last_unstale":"2023-08-18T20:45:50.251084+0000","last_undegraded":"2023-08-18T20:45:50.251084+0000","last_fullsized":"2023-08-18T20:45:50.251084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T08:27:30.005520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295030+0000","last_change":"2023-08-18T20:45:34.977122+0000","last_active":"2023-08-18T20:45:50.295030+0000","last_peered":"2023-08-18T20:45:50.295030+0000","last_clean":"2023-08-18T20:45:50.295030+0000","last_became_active":"2023-08-18T20:45:34.976575+0000","last_became_peered":"2023-08-18T20:45:34.976575+0000","last_unstale":"2023-08-18T20:45:50.295030+0000","last_undegraded":"2023-08-18T20:45:50.295030+0000","last_fullsized":"2023-08-18T20:45:50.295030+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:12:05.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.295081+0000","last_change":"2023-08-18T20:43:38.551858+0000","last_active":"2023-08-18T20:45:50.295081+0000","last_peered":"2023-08-18T20:45:50.295081+0000","last_clean":"2023-08-18T20:45:50.295081+0000","last_became_active":"2023-08-18T20:43:38.551544+0000","last_became_peered":"2023-08-18T20:43:38.551544+0000","last_unstale":"2023-08-18T20:45:50.295081+0000","last_undegraded":"2023-08-18T20:45:50.295081+0000","last_fullsized":"2023-08-18T20:45:50.295081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T02:20:20.746890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.294549+0000","last_change":"2023-08-18T20:45:49.101258+0000","last_active":"2023-08-18T20:45:50.294549+0000","last_peered":"2023-08-18T20:45:50.294549+0000","last_clean":"2023-08-18T20:45:50.294549+0000","last_became_active":"2023-08-18T20:45:49.101034+0000","last_became_peered":"2023-08-18T20:45:49.101034+0000","last_unstale":"2023-08-18T20:45:50.294549+0000","last_undegraded":"2023-08-18T20:45:50.294549+0000","last_fullsized":"2023-08-18T20:45:50.294549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:48.073792+0000","last_clean_scrub_stamp":"2023-08-18T20:45:48.073792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:56:31.807173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"55'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087770+0000","last_change":"2023-08-18T20:45:48.100631+0000","last_active":"2023-08-18T20:45:50.087770+0000","last_peered":"2023-08-18T20:45:50.087770+0000","last_clean":"2023-08-18T20:45:50.087770+0000","last_became_active":"2023-08-18T20:45:48.100331+0000","last_became_peered":"2023-08-18T20:45:48.100331+0000","last_unstale":"2023-08-18T20:45:50.087770+0000","last_undegraded":"2023-08-18T20:45:50.087770+0000","last_fullsized":"2023-08-18T20:45:50.087770+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:47.070098+0000","last_clean_scrub_stamp":"2023-08-18T20:45:47.070098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T04:59:31.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476246+0000","last_change":"2023-08-18T20:45:35.905894+0000","last_active":"2023-08-18T20:45:50.476246+0000","last_peered":"2023-08-18T20:45:50.476246+0000","last_clean":"2023-08-18T20:45:50.476246+0000","last_became_active":"2023-08-18T20:45:35.905198+0000","last_became_peered":"2023-08-18T20:45:35.905198+0000","last_unstale":"2023-08-18T20:45:50.476246+0000","last_undegraded":"2023-08-18T20:45:50.476246+0000","last_fullsized":"2023-08-18T20:45:50.476246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:34.954736+0000","last_clean_scrub_stamp":"2023-08-18T20:45:34.954736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T07:44:59.645343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"51'1","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.087611+0000","last_change":"2023-08-18T20:45:34.978547+0000","last_active":"2023-08-18T20:45:50.087611+0000","last_peered":"2023-08-18T20:45:50.087611+0000","last_clean":"2023-08-18T20:45:50.087611+0000","last_became_active":"2023-08-18T20:45:34.977631+0000","last_became_peered":"2023-08-18T20:45:34.977631+0000","last_unstale":"2023-08-18T20:45:50.087611+0000","last_undegraded":"2023-08-18T20:45:50.087611+0000","last_fullsized":"2023-08-18T20:45:50.087611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:45:33.948189+0000","last_clean_scrub_stamp":"2023-08-18T20:45:33.948189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-20T03:27:48.352619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-08-18T20:45:50.476006+0000","last_change":"2023-08-18T20:43:38.551292+0000","last_active":"2023-08-18T20:45:50.476006+0000","last_peered":"2023-08-18T20:45:50.476006+0000","last_clean":"2023-08-18T20:45:50.476006+0000","last_became_active":"2023-08-18T20:43:38.550943+0000","last_became_peered":"2023-08-18T20:43:38.550943+0000","last_unstale":"2023-08-18T20:45:50.476006+0000","last_undegraded":"2023-08-18T20:45:50.476006+0000","last_fullsized":"2023-08-18T20:45:50.476006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-18T20:43:37.536669+0000","last_clean_scrub_stamp":"2023-08-18T20:43:37.536669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-19T23:52:34.056355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1282048,"data_stored":895202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.505},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.33400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68000000000000005,"5min":1.101,"15min":1.101},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":1.159,"15min":1.159},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Aug 18 20:45:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79100000000000004,"5min":1.373,"15min":1.373},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":305682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":7.6059999999999999,"15min":7.6059999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77900000000000003,"5min":7.5739999999999998,"15min":7.5739999999999998},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.81299999999999994,"15min":0.86099999999999999},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.755,"5min":9.6649999999999991,"15min":9.6649999999999991},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.82999999999999996,"15min":0.877},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":9.6959999999999997,"15min":9.6959999999999997},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82599999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83299999999999996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.74099999999999999,"15min":0.77500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80400000000000005,"5min":6.548,"15min":6.548},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76100000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.39800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.86299999999999999,"5min":1.101,"15min":1.101},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.875,"5min":1.123,"15min":1.123},"last":0.497}]},{"osd":7,"last update":"Fri Aug 18 20:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.435}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1286144,"data_stored":890889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.216,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.45400000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.307},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.71999999999999997,"15min":0.77900000000000003},"min":{"1min":0.218,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.6930000000000001,"5min":12.057,"15min":12.057},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.377,"15min":0.38500000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.629,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41099999999999998},"min":{"1min":0.27400000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.76200000000000001,"15min":0.81899999999999995},"min":{"1min":0.25700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.7190000000000001,"5min":11.927,"15min":11.927},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.44700000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.355,"5min":11.967000000000001,"15min":11.967000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":1.329,"15min":1.329},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.621,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":1.3,"15min":1.3},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6399999999999999,"5min":12.029,"15min":12.029},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38100000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.9700000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.97999999999999998,"15min":1.0389999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.669,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.47499999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":304036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.42199999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.313},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.44800000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23000000000000001}]},{"osd":2,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.37},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28599999999999998}]},{"osd":3,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.247},{"interface":"front","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.621},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Aug 18 20:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31,"15min":0.308},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":0.27100000000000002}]},{"osd":1,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.314},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.34300000000000003},"min":{"1min":0.29199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.34399999999999997},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.222},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.65100000000000002,"15min":0.61099999999999999},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":6.6429999999999998,"5min":6.6429999999999998,"15min":6.6429999999999998},"last":0.33000000000000002}]},{"osd":7,"last update":"Fri Aug 18 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.64300000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":5.7039999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.505}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":304618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.41599999999999998,"15min":0.435},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.40400000000000003,"5min":1.599,"15min":1.599},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.311,"5min":1.391,"15min":1.571},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.41099999999999998,"5min":21.048999999999999,"15min":21.048999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47099999999999997,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":1.125,"15min":1.2569999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45800000000000002,"5min":13.94,"15min":13.94},"last":0.438}]},{"osd":2,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":1.3740000000000001,"15min":1.5469999999999999},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.40300000000000002,"5min":10.375,"15min":10.375},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.44500000000000001,"5min":1.643,"15min":1.643},"last":0.373}]},{"osd":4,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":1.589,"15min":1.764},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.087,"15min":1.175},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77000000000000002,"5min":10.313000000000001,"15min":10.313000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.64700000000000002,"15min":0.66600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.619,"15min":1.7889999999999999},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":21.018000000000001,"15min":21.018000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.1040000000000001,"15min":1.194},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.745,"5min":10.260999999999999,"15min":10.260999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":1.704,"15min":1.704},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.643,"15min":1.819},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":20.943000000000001,"15min":20.943000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.139,"15min":1.2310000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71599999999999997,"5min":10.345000000000001,"15min":10.345000000000001},"last":0.61199999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":308871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.30199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.40799999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75900000000000001,"5min":0.875,"15min":0.875},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.45400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.314},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.77400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.26700000000000002}]},{"osd":6,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.371},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.495}]},{"osd":7,"last update":"Fri Aug 18 20:45:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.71099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47699999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":304092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.40899999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64700000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.62},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70699999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.745,"15min":0.745},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Aug 18 20:45:39 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-18T20:45:53.595 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-18T20:45:53.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-08-18T20:45:53.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.749+0000 7efd8d51f700 1 Processor -- start 2023-08-18T20:45:53.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.749+0000 7efd8d51f700 1 -- start start 2023-08-18T20:45:53.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd8d51f700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efd880c7ca0 0x7efd881543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd8d51f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd88154900 0x7efd8815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd8d51f700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd880ca4a0 con 0x7efd88151b10 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd8d51f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8806c0f0 con 0x7efd88154900 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd8d51f700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd88158540 con 0x7efd880c7ca0 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd88154900 0x7efd8815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd88154900 0x7efd8815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44192/0 (socket says 172.21.15.121:44192) 2023-08-18T20:45:53.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 -- 172.21.15.121:0/509678076 learned_addr learned my addr 172.21.15.121:0/509678076 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd867fc700 1 --2- 172.21.15.121:0/509678076 >> v2:172.21.15.122:3300/0 conn(0x7efd880c7ca0 0x7efd881543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 -- 172.21.15.121:0/509678076 >> v2:172.21.15.122:3300/0 conn(0x7efd880c7ca0 msgr2=0x7efd881543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 --2- 172.21.15.121:0/509678076 >> v2:172.21.15.122:3300/0 conn(0x7efd880c7ca0 0x7efd881543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 -- 172.21.15.121:0/509678076 >> v1:172.21.15.122:6789/0 conn(0x7efd88151b10 legacy=0x7efd880c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 -- 172.21.15.121:0/509678076 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88158820 con 0x7efd88154900 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd877fe700 1 --2- 172.21.15.121:0/509678076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88154900 0x7efd8815ed40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efd880c5710 tx=0x7efd8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7954e88f87e36b server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd85ffb700 1 -- 172.21.15.121:0/509678076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000e070 con 0x7efd88154900 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd85ffb700 1 -- 172.21.15.121:0/509678076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd80003a20 con 0x7efd88154900 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.750+0000 7efd85ffb700 1 -- 172.21.15.121:0/509678076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80003dd0 con 0x7efd88154900 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 -- 172.21.15.121:0/509678076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88154900 msgr2=0x7efd8815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 --2- 172.21.15.121:0/509678076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88154900 0x7efd8815ed40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efd880c5710 tx=0x7efd8000b330 comp rx=0 tx=0).stop 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 -- 172.21.15.121:0/509678076 shutdown_connections 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 --2- 172.21.15.121:0/509678076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88154900 0x7efd8815ed40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 --2- 172.21.15.121:0/509678076 >> v2:172.21.15.122:3300/0 conn(0x7efd880c7ca0 0x7efd881543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 -- 172.21.15.121:0/509678076 >> 172.21.15.121:0/509678076 conn(0x7efd88071bb0 msgr2=0x7efd88071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 -- 172.21.15.121:0/509678076 shutdown_connections 2023-08-18T20:45:53.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.751+0000 7efd8d51f700 1 -- 172.21.15.121:0/509678076 wait complete. 2023-08-18T20:45:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.752+0000 7efd8d51f700 1 Processor -- start 2023-08-18T20:45:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.752+0000 7efd8d51f700 1 -- start start 2023-08-18T20:45:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 0x7efd881ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 0x7efd880abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd881ea640 con 0x7efd88151b10 2023-08-18T20:45:53.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880bd7d0 con 0x7efd88154900 2023-08-18T20:45:53.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd880bdd90 con 0x7efd880c7ca0 2023-08-18T20:45:53.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44196/0 (socket says 172.21.15.121:44196) 2023-08-18T20:45:53.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 -- 172.21.15.121:0/3360615771 learned_addr learned my addr 172.21.15.121:0/3360615771 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:53.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd877fe700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 0x7efd880abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd86ffd700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 0x7efd881ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 -- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 msgr2=0x7efd881ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 0x7efd881ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 -- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 msgr2=0x7efd880abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 0x7efd880abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 -- 172.21.15.121:0/3360615771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80009b30 con 0x7efd88151b10 2023-08-18T20:45:53.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd86ffd700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 0x7efd881ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:53.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd877fe700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 0x7efd880abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:53.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd867fc700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efd7800d830 tx=0x7efd7800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780125f0 con 0x7efd88151b10 2023-08-18T20:45:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78012750 con 0x7efd88151b10 2023-08-18T20:45:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880c07c0 con 0x7efd88151b10 2023-08-18T20:45:53.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.753+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78012ae0 con 0x7efd88151b10 2023-08-18T20:45:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.754+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88156f70 con 0x7efd88151b10 2023-08-18T20:45:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.754+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88074730 con 0x7efd88151b10 2023-08-18T20:45:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.755+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd78012c40 con 0x7efd88151b10 2023-08-18T20:45:53.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.755+0000 7efd6f7fe700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 0x7efd7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.755+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7efd78088ce0 con 0x7efd88151b10 2023-08-18T20:45:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.755+0000 7efd86ffd700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 0x7efd7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:53.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.756+0000 7efd86ffd700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 0x7efd7406c5a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efd7c003f40 tx=0x7efd7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:53.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:53.760+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efd7808f080 con 0x7efd88151b10 2023-08-18T20:45:54.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.026+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7efd880ca910 con 0x7efd88151b10 2023-08-18T20:45:54.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.029+0000 7efd6f7fe700 1 -- 172.21.15.121:0/3360615771 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7efd880ca910 con 0x7efd88151b10 2023-08-18T20:45:54.030 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2023-08-18T20:45:54.030 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDM199kgqNNBRAAU35KLP2Dfx5mCBhBw6xy5A== 2023-08-18T20:45:54.030 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2023-08-18T20:45:54.030 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2023-08-18T20:45:54.030 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-08-18T20:45:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 msgr2=0x7efd7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 0x7efd7406c5a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efd7c003f40 tx=0x7efd7c009040 comp rx=0 tx=0).stop 2023-08-18T20:45:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 msgr2=0x7efd88154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efd7800d830 tx=0x7efd7800dbf0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 shutdown_connections 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88154900 0x7efd880abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd880c7ca0 0x7efd881ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7efd7406a0e0 0x7efd7406c5a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 --2- 172.21.15.121:0/3360615771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd88151b10 0x7efd88154100 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 >> 172.21.15.121:0/3360615771 conn(0x7efd88071bb0 msgr2=0x7efd880c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 shutdown_connections 2023-08-18T20:45:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.031+0000 7efd8d51f700 1 -- 172.21.15.121:0/3360615771 wait complete. 2023-08-18T20:45:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.1 2023-08-18T20:45:54.044 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:54.044 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:54.065 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:54.066 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:54.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-18T20:45:54.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.245+0000 7f98de812700 1 Processor -- start 2023-08-18T20:45:54.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.245+0000 7f98de812700 1 -- start start 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98de812700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98d806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98de812700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c4f40 con 0x7f98d806a7e0 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98de812700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c6120 con 0x7f98d80c5ae0 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98de812700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81551f0 con 0x7f98d80c0c50 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98d77fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f98d806a7e0 0x7f98d80c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50786/0 (socket says 172.21.15.121:50786) 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98d77fe700 1 -- 172.21.15.121:0/1233734117 learned_addr learned my addr 172.21.15.121:0/1233734117 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994199150 0 0) 0x7f98d80c4f40 con 0x7f98d806a7e0 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c00035b0 con 0x7f98d806a7e0 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.246+0000 7f98d7fff700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98d806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075057556 0 0) 0x7f98c00035b0 con 0x7f98d806a7e0 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 msgr2=0x7f98d806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98d806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 >> v1:172.21.15.122:6789/0 conn(0x7f98d80c5ae0 legacy=0x7f98d8071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80c63a0 con 0x7f98d806a7e0 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7f98c8001670 con 0x7f98d806a7e0 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 >> v1:172.21.15.121:6789/0 conn(0x7f98d806a7e0 legacy=0x7f98d80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c0003aa0 0x7f98c0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98c0004850 0x7f98c0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81551f0 con 0x7f98c0003aa0 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c000bb10 con 0x7f98c0004850 2023-08-18T20:45:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c000bcd0 con 0x7f98d80c0c50 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c0003aa0 0x7f98c0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d77fe700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98c0004850 0x7f98c0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98dcdaf700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 -- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 msgr2=0x7f98c0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98c0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 -- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98c0004850 msgr2=0x7f98c0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98c0004850 0x7f98c0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 -- 172.21.15.121:0/1233734117 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00035b0 con 0x7f98c0003aa0 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98dcdaf700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d80c0c50 0x7f98c0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d7fff700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c0003aa0 0x7f98c0003ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009b60 tx=0x7f98c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e0a160d385a931 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00e6c0 con 0x7f98c0003aa0 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00e820 con 0x7f98c0003aa0 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.247+0000 7f98d6ffd700 1 -- 172.21.15.121:0/1233734117 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00eb90 con 0x7f98c0003aa0 2023-08-18T20:45:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 -- 172.21.15.121:0/1233734117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c0003aa0 msgr2=0x7f98c0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 --2- 172.21.15.121:0/1233734117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c0003aa0 0x7f98c0003ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009b60 tx=0x7f98c0005880 comp rx=0 tx=0).stop 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98dcdaf700 1 -- 172.21.15.121:0/1233734117 reap_dead start 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 -- 172.21.15.121:0/1233734117 shutdown_connections 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 -- 172.21.15.121:0/1233734117 >> 172.21.15.121:0/1233734117 conn(0x7f98d80c6b10 msgr2=0x7f98d80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 -- 172.21.15.121:0/1233734117 shutdown_connections 2023-08-18T20:45:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.248+0000 7f98de812700 1 -- 172.21.15.121:0/1233734117 wait complete. 2023-08-18T20:45:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.249+0000 7f98de812700 1 Processor -- start 2023-08-18T20:45:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.249+0000 7f98de812700 1 -- start start 2023-08-18T20:45:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d8156150 0x7f98d81e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d8153430 0x7f98d81e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81569d0 con 0x7f98d8153050 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80ab690 con 0x7f98d8156150 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98de812700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80abbc0 con 0x7f98d8153430 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44214/0 (socket says 172.21.15.121:44214) 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 -- 172.21.15.121:0/3103452937 learned_addr learned my addr 172.21.15.121:0/3103452937 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d77fe700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d8156150 0x7f98d81e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98dcdaf700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d8153430 0x7f98d81e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 -- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d8153430 msgr2=0x7f98d81e6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d8153430 0x7f98d81e6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 -- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d8156150 msgr2=0x7f98d81e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d8156150 0x7f98d81e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.250+0000 7f98d7fff700 1 -- 172.21.15.121:0/3103452937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d81e9b50 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98d7fff700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f98cc016000 tx=0x7f98cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00e6c0 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc003ad0 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc003e80 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d81ed170 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.251+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80ab8e0 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.252+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d8074730 con 0x7f98d8153050 2023-08-18T20:45:54.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.252+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98cc013470 con 0x7f98d8153050 2023-08-18T20:45:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.252+0000 7f98d4ff9700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 0x7f98c406c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.253+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f98cc08a130 con 0x7f98d8153050 2023-08-18T20:45:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.253+0000 7f98d77fe700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 0x7f98c406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.253+0000 7f98d77fe700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 0x7f98c406c570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001050 tx=0x7f98c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.257+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f98cc055670 con 0x7f98d8153050 2023-08-18T20:45:54.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.446+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98d80c4a10 con 0x7f98d8153050 2023-08-18T20:45:54.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.448+0000 7f98d4ff9700 1 -- 172.21.15.121:0/3103452937 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f98cc058c90 con 0x7f98d8153050 2023-08-18T20:45:54.449 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-18T20:45:54.449 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":56,"fsid":"4755cd5f-6734-4b3f-8f96-cd10dcf8d04c","created":"2023-08-18T20:43:25.082151+0000","modified":"2023-08-18T20:45:50.080280+0000","last_up_change":"2023-08-18T20:43:35.533896+0000","last_in_change":"2023-08-18T20:43:27.759189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-18T20:43:36.568925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-18T20:43:36.949368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-18T20:45:33.488863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-18T20:45:34.322674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-08-18T20:45:47.019972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-08-18T20:45:47.444147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"68cf284e-0eab-40a0-9196-194f72b9b014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6801","nonce":2890813306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6803","nonce":2890813306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6807","nonce":2890813306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2890813306},{"type":"v1","addr":"172.21.15.121:6805","nonce":2890813306}]},"public_addr":"172.21.15.121:6801/2890813306","cluster_addr":"172.21.15.121:6803/2890813306","heartbeat_back_addr":"172.21.15.121:6807/2890813306","heartbeat_front_addr":"172.21.15.121:6805/2890813306","state":["exists","up"]},{"osd":1,"uuid":"6bc4b43d-7f85-4f82-91b5-fcd06f1c2abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6809","nonce":2230245635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6811","nonce":2230245635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6815","nonce":2230245635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2230245635},{"type":"v1","addr":"172.21.15.121:6813","nonce":2230245635}]},"public_addr":"172.21.15.121:6809/2230245635","cluster_addr":"172.21.15.121:6811/2230245635","heartbeat_back_addr":"172.21.15.121:6815/2230245635","heartbeat_front_addr":"172.21.15.121:6813/2230245635","state":["exists","up"]},{"osd":2,"uuid":"973df490-20df-445d-9f34-acbb13cf0efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6825","nonce":1983537111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6827","nonce":1983537111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6831","nonce":1983537111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1983537111},{"type":"v1","addr":"172.21.15.121:6829","nonce":1983537111}]},"public_addr":"172.21.15.121:6825/1983537111","cluster_addr":"172.21.15.121:6827/1983537111","heartbeat_back_addr":"172.21.15.121:6831/1983537111","heartbeat_front_addr":"172.21.15.121:6829/1983537111","state":["exists","up"]},{"osd":3,"uuid":"eadba227-ddaf-40d9-992c-6d0802e5f8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6817","nonce":2510933558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6819","nonce":2510933558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6823","nonce":2510933558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2510933558},{"type":"v1","addr":"172.21.15.121:6821","nonce":2510933558}]},"public_addr":"172.21.15.121:6817/2510933558","cluster_addr":"172.21.15.121:6819/2510933558","heartbeat_back_addr":"172.21.15.121:6823/2510933558","heartbeat_front_addr":"172.21.15.121:6821/2510933558","state":["exists","up"]},{"osd":4,"uuid":"212a15bb-faa9-470a-8e9f-e4a62d5029c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6809","nonce":1370819564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6811","nonce":1370819564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6815","nonce":1370819564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1370819564},{"type":"v1","addr":"172.21.15.122:6813","nonce":1370819564}]},"public_addr":"172.21.15.122:6809/1370819564","cluster_addr":"172.21.15.122:6811/1370819564","heartbeat_back_addr":"172.21.15.122:6815/1370819564","heartbeat_front_addr":"172.21.15.122:6813/1370819564","state":["exists","up"]},{"osd":5,"uuid":"f06ac81e-679b-4ad5-86a7-17e5bb4fc3ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6801","nonce":1102381785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6803","nonce":1102381785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6807","nonce":1102381785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1102381785},{"type":"v1","addr":"172.21.15.122:6805","nonce":1102381785}]},"public_addr":"172.21.15.122:6801/1102381785","cluster_addr":"172.21.15.122:6803/1102381785","heartbeat_back_addr":"172.21.15.122:6807/1102381785","heartbeat_front_addr":"172.21.15.122:6805/1102381785","state":["exists","up"]},{"osd":6,"uuid":"5a5b13ad-b2f8-4499-85dc-070cd36fb752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6817","nonce":2654167309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6819","nonce":2654167309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6823","nonce":2654167309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2654167309},{"type":"v1","addr":"172.21.15.122:6821","nonce":2654167309}]},"public_addr":"172.21.15.122:6817/2654167309","cluster_addr":"172.21.15.122:6819/2654167309","heartbeat_back_addr":"172.21.15.122:6823/2654167309","heartbeat_front_addr":"172.21.15.122:6821/2654167309","state":["exists","up"]},{"osd":7,"uuid":"872749f0-a678-4b59-b4a7-766fc52aceae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6825","nonce":629546232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6827","nonce":629546232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6831","nonce":629546232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":629546232},{"type":"v1","addr":"172.21.15.122:6829","nonce":629546232}]},"public_addr":"172.21.15.122:6825/629546232","cluster_addr":"172.21.15.122:6827/629546232","heartbeat_back_addr":"172.21.15.122:6831/629546232","heartbeat_front_addr":"172.21.15.122:6829/629546232","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.656064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.908549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.919374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:33.011090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.748637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.610924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.895026+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-18T20:43:32.950937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-18T20:45:54.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 msgr2=0x7f98c406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 0x7f98c406c570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001050 tx=0x7f98c8009040 comp rx=0 tx=0).stop 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 msgr2=0x7f98d81ecc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f98cc016000 tx=0x7f98cc0047c0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 shutdown_connections 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f98d8153430 0x7f98d81e6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f98c406a0b0 0x7f98c406c570 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d8153050 0x7f98d81ecc30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 --2- 172.21.15.121:0/3103452937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98d8156150 0x7f98d81e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 >> 172.21.15.121:0/3103452937 conn(0x7f98d80c6b10 msgr2=0x7f98d80a6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 shutdown_connections 2023-08-18T20:45:54.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.450+0000 7f98de812700 1 -- 172.21.15.121:0/3103452937 wait complete. 2023-08-18T20:45:54.463 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-18T20:43:36.568925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-18T20:43:36.949368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-18T20:45:33.488863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-18T20:45:34.322674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-18T20:45:47.019972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-18T20:45:47.444147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-18T20:45:54.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-18T20:45:54.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 Processor -- start 2023-08-18T20:45:54.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 -- start start 2023-08-18T20:45:54.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba00a6290 0x7f5ba00c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 0x7f5ba00c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba00c4f40 con 0x7f5ba00c0c50 2023-08-18T20:45:54.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba00c5e50 con 0x7f5ba00a6290 2023-08-18T20:45:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.588+0000 7f5ba74cc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00c6120 con 0x7f5ba00c1b10 2023-08-18T20:45:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba00a6290 0x7f5ba00c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba5a69700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 0x7f5ba00c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba5a69700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 0x7f5ba00c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40636/0 (socket says 172.21.15.121:40636) 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba00a6290 0x7f5ba00c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:54062/0 (socket says 172.21.15.121:54062) 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba5a69700 1 -- 172.21.15.121:0/2569248296 learned_addr learned my addr 172.21.15.121:0/2569248296 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 -- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 msgr2=0x7f5ba00c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 --2- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 0x7f5ba00c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 -- 172.21.15.121:0/2569248296 >> v1:172.21.15.122:6789/0 conn(0x7f5ba00c0c50 legacy=0x7f5ba006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 -- 172.21.15.121:0/2569248296 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba01551f0 con 0x7f5ba00a6290 2023-08-18T20:45:54.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5b97fff700 1 -- 172.21.15.121:0/2569248296 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273704296 0 0) 0x7f5ba00c4f40 con 0x7f5ba00c0c50 2023-08-18T20:45:54.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5ba4a67700 1 --2- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00a6290 0x7f5ba00c53d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009840 tx=0x7f5b9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=388a20288662c280 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5b97fff700 1 -- 172.21.15.121:0/2569248296 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c011830 con 0x7f5ba00a6290 2023-08-18T20:45:54.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5b97fff700 1 -- 172.21.15.121:0/2569248296 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c011990 con 0x7f5ba00a6290 2023-08-18T20:45:54.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.589+0000 7f5b97fff700 1 -- 172.21.15.121:0/2569248296 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c011d20 con 0x7f5ba00a6290 2023-08-18T20:45:54.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00a6290 msgr2=0x7f5ba00c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00a6290 0x7f5ba00c53d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009840 tx=0x7f5b9c009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:54.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2569248296 shutdown_connections 2023-08-18T20:45:54.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c1b10 0x7f5ba00c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2569248296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00a6290 0x7f5ba00c53d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2569248296 >> 172.21.15.121:0/2569248296 conn(0x7f5ba00c6b10 msgr2=0x7f5ba00c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2569248296 shutdown_connections 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.590+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2569248296 wait complete. 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.591+0000 7f5ba74cc700 1 Processor -- start 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.591+0000 7f5ba74cc700 1 -- start start 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c0c50 0x7f5ba014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00c1b10 0x7f5ba014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00aa4c0 con 0x7f5ba00a6290 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00ac440 con 0x7f5ba00c1b10 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba74cc700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00aacc0 con 0x7f5ba00c0c50 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44230/0 (socket says 172.21.15.121:44230) 2023-08-18T20:45:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 -- 172.21.15.121:0/2202037494 learned_addr learned my addr 172.21.15.121:0/2202037494 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5a69700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00c1b10 0x7f5ba014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba4a67700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c0c50 0x7f5ba014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 -- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c0c50 msgr2=0x7f5ba014bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c0c50 0x7f5ba014bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 -- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00c1b10 msgr2=0x7f5ba014c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00c1b10 0x7f5ba014c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.592+0000 7f5ba5268700 1 -- 172.21.15.121:0/2202037494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0094a0 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5ba5268700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c750 tx=0x7f5b9000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900054e0 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b90003680 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba00aa6b0 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90003a30 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.593+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba00aa950 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.594+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba0074730 con 0x7f5ba00a6290 2023-08-18T20:45:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.594+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b90003b90 con 0x7f5ba00a6290 2023-08-18T20:45:54.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.595+0000 7f5b95ffb700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 0x7f5b8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.595+0000 7f5ba4a67700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 0x7f5b8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.595+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f5b90087dd0 con 0x7f5ba00a6290 2023-08-18T20:45:54.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.595+0000 7f5ba4a67700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 0x7f5b8406c5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c000c00 tx=0x7f5b9c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.599+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5b900531f0 con 0x7f5ba00a6290 2023-08-18T20:45:54.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.789+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ba00c4a10 con 0x7f5ba00a6290 2023-08-18T20:45:54.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.789+0000 7f5b95ffb700 1 -- 172.21.15.121:0/2202037494 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b90089020 con 0x7f5ba00a6290 2023-08-18T20:45:54.790 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2023-08-18T20:45:54.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 msgr2=0x7f5b8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 0x7f5b8406c5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c000c00 tx=0x7f5b9c01c040 comp rx=0 tx=0).stop 2023-08-18T20:45:54.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 msgr2=0x7f5ba01ea5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c750 tx=0x7f5b9000cb10 comp rx=0 tx=0).stop 2023-08-18T20:45:54.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 shutdown_connections 2023-08-18T20:45:54.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba00c1b10 0x7f5ba014c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f5b8406a0e0 0x7f5b8406c5a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ba00a6290 0x7f5ba01ea5c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 --2- 172.21.15.121:0/2202037494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ba00c0c50 0x7f5ba014bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 >> 172.21.15.121:0/2202037494 conn(0x7f5ba00c6b10 msgr2=0x7f5ba00a6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 shutdown_connections 2023-08-18T20:45:54.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.791+0000 7f5ba74cc700 1 -- 172.21.15.121:0/2202037494 wait complete. 2023-08-18T20:45:54.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-18T20:45:54.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.927+0000 7fd857ebd700 1 Processor -- start 2023-08-18T20:45:54.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.928+0000 7fd857ebd700 1 -- start start 2023-08-18T20:45:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd857ebd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd85014e950 0x7fd8500c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd857ebd700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd85014ed30 0x7fd8500c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd857ebd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500c2260 con 0x7fd8500c19d0 2023-08-18T20:45:54.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd857ebd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8500a6630 con 0x7fd85014e950 2023-08-18T20:45:54.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd857ebd700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850151d90 con 0x7fd85014ed30 2023-08-18T20:45:54.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd85014e950 0x7fd8500c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd85014e950 0x7fd8500c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44236/0 (socket says 172.21.15.121:44236) 2023-08-18T20:45:54.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd85645a700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd8500c19d0 0x7fd8500c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50822/0 (socket says 172.21.15.121:50822) 2023-08-18T20:45:54.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 -- 172.21.15.121:0/3318074827 learned_addr learned my addr 172.21.15.121:0/3318074827 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:54.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855458700 1 --2- 172.21.15.121:0/3318074827 >> v2:172.21.15.122:3300/0 conn(0x7fd85014ed30 0x7fd8500c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 -- 172.21.15.121:0/3318074827 >> v2:172.21.15.122:3300/0 conn(0x7fd85014ed30 msgr2=0x7fd8500c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:54.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 --2- 172.21.15.121:0/3318074827 >> v2:172.21.15.122:3300/0 conn(0x7fd85014ed30 0x7fd8500c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 -- 172.21.15.121:0/3318074827 >> v1:172.21.15.121:6789/0 conn(0x7fd8500c19d0 legacy=0x7fd8500c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd854c57700 1 -- 172.21.15.121:0/3318074827 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761060707 0 0) 0x7fd8500c2260 con 0x7fd8500c19d0 2023-08-18T20:45:54.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 -- 172.21.15.121:0/3318074827 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850152070 con 0x7fd85014e950 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd855c59700 1 --2- 172.21.15.121:0/3318074827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014e950 0x7fd8500c2ed0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd8500c7ba0 tx=0x7fd840009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89399ff0278263ad server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd854c57700 1 -- 172.21.15.121:0/3318074827 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000b870 con 0x7fd85014e950 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd854c57700 1 -- 172.21.15.121:0/3318074827 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000b9d0 con 0x7fd85014e950 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.929+0000 7fd854c57700 1 -- 172.21.15.121:0/3318074827 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000bd60 con 0x7fd85014e950 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 -- 172.21.15.121:0/3318074827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014e950 msgr2=0x7fd8500c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3318074827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014e950 0x7fd8500c2ed0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd8500c7ba0 tx=0x7fd840009bd0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 -- 172.21.15.121:0/3318074827 shutdown_connections 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3318074827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014e950 0x7fd8500c2ed0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3318074827 >> v2:172.21.15.122:3300/0 conn(0x7fd85014ed30 0x7fd8500c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 -- 172.21.15.121:0/3318074827 >> 172.21.15.121:0/3318074827 conn(0x7fd8500c6b10 msgr2=0x7fd8500c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 -- 172.21.15.121:0/3318074827 shutdown_connections 2023-08-18T20:45:54.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.930+0000 7fd857ebd700 1 -- 172.21.15.121:0/3318074827 wait complete. 2023-08-18T20:45:54.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.931+0000 7fd857ebd700 1 Processor -- start 2023-08-18T20:45:54.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 -- start start 2023-08-18T20:45:54.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 0x7fd85013df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd85014e950 0x7fd85013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500aa480 con 0x7fd85014ed30 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501400d0 con 0x7fd8500c19d0 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.932+0000 7fd857ebd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85013fdf0 con 0x7fd85014e950 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44246/0 (socket says 172.21.15.121:44246) 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 -- 172.21.15.121:0/3078046040 learned_addr learned my addr 172.21.15.121:0/3078046040 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd855c59700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 0x7fd85013df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd855458700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd85014e950 0x7fd85013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 -- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd85014e950 msgr2=0x7fd85013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd85014e950 0x7fd85013e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 -- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 msgr2=0x7fd85013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 0x7fd85013df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 -- 172.21.15.121:0/3078046040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009550 con 0x7fd85014ed30 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd855c59700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 0x7fd85013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd85645a700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd84800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800ac20 con 0x7fd85014ed30 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84800ada0 con 0x7fd85014ed30 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850144250 con 0x7fd85014ed30 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848007310 con 0x7fd85014ed30 2023-08-18T20:45:54.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.933+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8500c0e80 con 0x7fd85014ed30 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.934+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85006d230 con 0x7fd85014ed30 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.934+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd848007470 con 0x7fd85014ed30 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.935+0000 7fd8467fc700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 0x7fd83406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.935+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fd8480886f0 con 0x7fd85014ed30 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.935+0000 7fd855c59700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 0x7fd83406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.935+0000 7fd855c59700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 0x7fd83406c5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd840000c00 tx=0x7fd840008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:54.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:54.939+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd848053b10 con 0x7fd85014ed30 2023-08-18T20:45:55.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.131+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8500a7bd0 con 0x7fd85014ed30 2023-08-18T20:45:55.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.132+0000 7fd8467fc700 1 -- 172.21.15.121:0/3078046040 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd848057130 con 0x7fd85014ed30 2023-08-18T20:45:55.132 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2023-08-18T20:45:55.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 msgr2=0x7fd83406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 0x7fd83406c5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd840000c00 tx=0x7fd840008030 comp rx=0 tx=0).stop 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 msgr2=0x7fd8501eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd84800a060 comp rx=0 tx=0).stop 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 shutdown_connections 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd83406a0e0 0x7fd83406c5a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd85014ed30 0x7fd8501eae30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8500c19d0 0x7fd85013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 --2- 172.21.15.121:0/3078046040 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd85014e950 0x7fd85013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 >> 172.21.15.121:0/3078046040 conn(0x7fd8500c6b10 msgr2=0x7fd85006cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 shutdown_connections 2023-08-18T20:45:55.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.134+0000 7fd857ebd700 1 -- 172.21.15.121:0/3078046040 wait complete. 2023-08-18T20:45:55.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-18T20:45:55.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.268+0000 7f691b898700 1 Processor -- start 2023-08-18T20:45:55.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 -- start start 2023-08-18T20:45:55.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 0x7f69141585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69140a6ed0 0x7f691406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6914158ae0 con 0x7f691406feb0 2023-08-18T20:45:55.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6914155370 con 0x7f69140a6ed0 2023-08-18T20:45:55.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.269+0000 7f691b898700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69140c7760 con 0x7f69140c7380 2023-08-18T20:45:55.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69140a6ed0 0x7f691406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69140a6ed0 0x7f691406f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44252/0 (socket says 172.21.15.121:44252) 2023-08-18T20:45:55.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 -- 172.21.15.121:0/3291857024 learned_addr learned my addr 172.21.15.121:0/3291857024 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6919634700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 0x7f69141585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 -- 172.21.15.121:0/3291857024 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 msgr2=0x7f69141585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:55.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 0x7f69141585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 -- 172.21.15.121:0/3291857024 >> v1:172.21.15.122:6789/0 conn(0x7f691406feb0 legacy=0x7f69140c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 -- 172.21.15.121:0/3291857024 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914154760 con 0x7f69140a6ed0 2023-08-18T20:45:55.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6919634700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 0x7f69141585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:55.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f6918e33700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140a6ed0 0x7f691406f970 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f69100098f0 tx=0x7f6910009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c49fe086a642367 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f690bfff700 1 -- 172.21.15.121:0/3291857024 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000b8a0 con 0x7f69140a6ed0 2023-08-18T20:45:55.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f690bfff700 1 -- 172.21.15.121:0/3291857024 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000ba00 con 0x7f69140a6ed0 2023-08-18T20:45:55.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.270+0000 7f690bfff700 1 -- 172.21.15.121:0/3291857024 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000bd90 con 0x7f69140a6ed0 2023-08-18T20:45:55.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 -- 172.21.15.121:0/3291857024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140a6ed0 msgr2=0x7f691406f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140a6ed0 0x7f691406f970 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f69100098f0 tx=0x7f6910009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 -- 172.21.15.121:0/3291857024 shutdown_connections 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140c7380 0x7f69141585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 --2- 172.21.15.121:0/3291857024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140a6ed0 0x7f691406f970 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 -- 172.21.15.121:0/3291857024 >> 172.21.15.121:0/3291857024 conn(0x7f69140c7bf0 msgr2=0x7f69140c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 -- 172.21.15.121:0/3291857024 shutdown_connections 2023-08-18T20:45:55.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.271+0000 7f691b898700 1 -- 172.21.15.121:0/3291857024 wait complete. 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.272+0000 7f691b898700 1 Processor -- start 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.272+0000 7f691b898700 1 -- start start 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 0x7f69140a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140a6ed0 0x7f691414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140c0d10 con 0x7f69140c7380 2023-08-18T20:45:55.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140c1a40 con 0x7f691406feb0 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69141e9a90 con 0x7f69140a6ed0 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919634700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 0x7f69140a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6918e33700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140a6ed0 0x7f691414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919634700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 0x7f69140a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:54094/0 (socket says 172.21.15.121:54094) 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919634700 1 -- 172.21.15.121:0/1992531293 learned_addr learned my addr 172.21.15.121:0/1992531293 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44260/0 (socket says 172.21.15.121:44260) 2023-08-18T20:45:55.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 -- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140a6ed0 msgr2=0x7f691414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140a6ed0 0x7f691414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 -- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 msgr2=0x7f69140a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 0x7f69140a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 -- 172.21.15.121:0/1992531293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910009550 con 0x7f69140c7380 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6919e35700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f690c00cae0 tx=0x7f690c00cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c003c00 con 0x7f69140c7380 2023-08-18T20:45:55.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c003d60 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00aa20 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.273+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69140a76f0 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.274+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69140a7cb0 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.275+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69140c52a0 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.275+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f690c00ab80 con 0x7f69140c7380 2023-08-18T20:45:55.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.275+0000 7f6909ffb700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.275+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f690c088500 con 0x7f69140c7380 2023-08-18T20:45:55.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.275+0000 7f6919634700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.276+0000 7f6919634700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f69140c2070 tx=0x7f6904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.280+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f690c053920 con 0x7f69140c7380 2023-08-18T20:45:55.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.468+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6914158ae0 con 0x7f69140c7380 2023-08-18T20:45:55.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.469+0000 7f6909ffb700 1 -- 172.21.15.121:0/1992531293 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6914158ae0 con 0x7f69140c7380 2023-08-18T20:45:55.469 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:55.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 msgr2=0x7f68f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f69140c2070 tx=0x7f6904008040 comp rx=0 tx=0).stop 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 msgr2=0x7f691414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f690c00cae0 tx=0x7f690c00cdf0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 shutdown_connections 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69140c7380 0x7f691414efd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691406feb0 0x7f69140a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 --2- 172.21.15.121:0/1992531293 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69140a6ed0 0x7f691414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 >> 172.21.15.121:0/1992531293 conn(0x7f69140c7bf0 msgr2=0x7f69140c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 shutdown_connections 2023-08-18T20:45:55.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.471+0000 7f691b898700 1 -- 172.21.15.121:0/1992531293 wait complete. 2023-08-18T20:45:55.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-18T20:45:55.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 Processor -- start 2023-08-18T20:45:55.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 -- start start 2023-08-18T20:45:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffabc0c0c50 0x7ffabc06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 0x7ffabc0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0c4f40 con 0x7ffabc0a6290 2023-08-18T20:45:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0c6120 con 0x7ffabc0c0c50 2023-08-18T20:45:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.607+0000 7ffac203b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1551f0 con 0x7ffabc06a7e0 2023-08-18T20:45:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffabc0c0c50 0x7ffabc06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffabc0c0c50 0x7ffabc06a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44264/0 (socket says 172.21.15.121:44264) 2023-08-18T20:45:55.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabbfff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ffabc0a6290 0x7ffabc071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50850/0 (socket says 172.21.15.121:50850) 2023-08-18T20:45:55.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 -- 172.21.15.121:0/2102880410 learned_addr learned my addr 172.21.15.121:0/2102880410 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabaffd700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 0x7ffabc0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 -- 172.21.15.121:0/2102880410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 msgr2=0x7ffabc0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:55.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 0x7ffabc0c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 -- 172.21.15.121:0/2102880410 >> v1:172.21.15.121:6789/0 conn(0x7ffabc0a6290 legacy=0x7ffabc071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffaba7fc700 1 -- 172.21.15.121:0/2102880410 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099224743 0 0) 0x7ffabc0c4f40 con 0x7ffabc0a6290 2023-08-18T20:45:55.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 -- 172.21.15.121:0/2102880410 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0c63a0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabaffd700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 0x7ffabc0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:55.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc06a2a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098f0 tx=0x7ffaac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d05f54bb072545 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffaba7fc700 1 -- 172.21.15.121:0/2102880410 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00b8a0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffaba7fc700 1 -- 172.21.15.121:0/2102880410 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00ba00 con 0x7ffabc0c0c50 2023-08-18T20:45:55.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.608+0000 7ffaba7fc700 1 -- 172.21.15.121:0/2102880410 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00bd90 con 0x7ffabc0c0c50 2023-08-18T20:45:55.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 -- 172.21.15.121:0/2102880410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 msgr2=0x7ffabc06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc06a2a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098f0 tx=0x7ffaac009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:55.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 -- 172.21.15.121:0/2102880410 shutdown_connections 2023-08-18T20:45:55.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc06a2a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 --2- 172.21.15.121:0/2102880410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc06a7e0 0x7ffabc0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 -- 172.21.15.121:0/2102880410 >> 172.21.15.121:0/2102880410 conn(0x7ffabc0c6b10 msgr2=0x7ffabc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 -- 172.21.15.121:0/2102880410 shutdown_connections 2023-08-18T20:45:55.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.609+0000 7ffac203b700 1 -- 172.21.15.121:0/2102880410 wait complete. 2023-08-18T20:45:55.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.610+0000 7ffac203b700 1 Processor -- start 2023-08-18T20:45:55.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.610+0000 7ffac203b700 1 -- start start 2023-08-18T20:45:55.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 0x7ffabc0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 0x7ffabc157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1e96a0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1e9940 con 0x7ffabc06a7e0 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffac203b700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1e9c20 con 0x7ffabc0a6290 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44274/0 (socket says 172.21.15.121:44274) 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 -- 172.21.15.121:0/385731781 learned_addr learned my addr 172.21.15.121:0/385731781 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabaffd700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 0x7ffabc157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 0x7ffabc0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 -- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 msgr2=0x7ffabc157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 0x7ffabc157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 -- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 msgr2=0x7ffabc0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 0x7ffabc0ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabbfff700 1 -- 172.21.15.121:0/385731781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009550 con 0x7ffabc0c0c50 2023-08-18T20:45:55.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabaffd700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 0x7ffabc157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:55.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.611+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 0x7ffabc0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-18T20:45:55.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffabbfff700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ffab4002230 tx=0x7ffab400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400ac20 con 0x7ffabc0c0c50 2023-08-18T20:45:55.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400ada0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4007310 con 0x7ffabc0c0c50 2023-08-18T20:45:55.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc1e9f00 con 0x7ffabc0c0c50 2023-08-18T20:45:55.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.612+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc1ea420 con 0x7ffabc0c0c50 2023-08-18T20:45:55.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.613+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc1ea120 con 0x7ffabc0c0c50 2023-08-18T20:45:55.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.613+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffab4007470 con 0x7ffabc0c0c50 2023-08-18T20:45:55.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.613+0000 7ffaa3fff700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 0x7ffaa806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.613+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ffab4088380 con 0x7ffabc0c0c50 2023-08-18T20:45:55.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.614+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 0x7ffaa806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.614+0000 7ffabb7fe700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 0x7ffaa806c5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009c40 tx=0x7ffaac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.618+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ffab40537a0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.806+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffabc074730 con 0x7ffabc0c0c50 2023-08-18T20:45:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.806+0000 7ffaa3fff700 1 -- 172.21.15.121:0/385731781 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffab4056dc0 con 0x7ffabc0c0c50 2023-08-18T20:45:55.807 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 msgr2=0x7ffaa806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 0x7ffaa806c5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009c40 tx=0x7ffaac008030 comp rx=0 tx=0).stop 2023-08-18T20:45:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 msgr2=0x7ffabc071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ffab4002230 tx=0x7ffab400a060 comp rx=0 tx=0).stop 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 shutdown_connections 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7ffaa806a0e0 0x7ffaa806c5a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffabc0c0c50 0x7ffabc071c10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffabc06a7e0 0x7ffabc0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 --2- 172.21.15.121:0/385731781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffabc0a6290 0x7ffabc157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 >> 172.21.15.121:0/385731781 conn(0x7ffabc0c6b10 msgr2=0x7ffabc06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.808+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 shutdown_connections 2023-08-18T20:45:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.809+0000 7ffac203b700 1 -- 172.21.15.121:0/385731781 wait complete. 2023-08-18T20:45:55.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-18T20:45:55.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.945+0000 7fbfd0ca1700 1 Processor -- start 2023-08-18T20:45:55.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.945+0000 7fbfd0ca1700 1 -- start start 2023-08-18T20:45:55.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfd0ca1700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbfcc06a510 0x7fbfcc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfd0ca1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfd0ca1700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc0c21f0 con 0x7fbfcc151ec0 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfd0ca1700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c2ba0 con 0x7fbfcc06a510 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfd0ca1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c6300 con 0x7fbfcc0c1cf0 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfc9d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbfcc06a510 0x7fbfcc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbfcc06a510 0x7fbfcc0c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:54116/0 (socket says 172.21.15.121:54116) 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfc9d9b700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40690/0 (socket says 172.21.15.121:40690) 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 -- 172.21.15.121:0/4170776628 learned_addr learned my addr 172.21.15.121:0/4170776628 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 -- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 msgr2=0x7fbfcc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 --2- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 -- 172.21.15.121:0/4170776628 >> v1:172.21.15.122:6789/0 conn(0x7fbfcc151ec0 legacy=0x7fbfcc157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 -- 172.21.15.121:0/4170776628 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc0c5b20 con 0x7fbfcc06a510 2023-08-18T20:45:55.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.946+0000 7fbfca59c700 1 --2- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc06a510 0x7fbfcc0c5490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0098f0 tx=0x7fbfbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2977d7c8501065a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfc959a700 1 -- 172.21.15.121:0/4170776628 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011830 con 0x7fbfcc06a510 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfc959a700 1 -- 172.21.15.121:0/4170776628 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc011990 con 0x7fbfcc06a510 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfc959a700 1 -- 172.21.15.121:0/4170776628 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011d20 con 0x7fbfcc06a510 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc06a510 msgr2=0x7fbfcc0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc06a510 0x7fbfcc0c5490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0098f0 tx=0x7fbfbc009c00 comp rx=0 tx=0).stop 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/4170776628 shutdown_connections 2023-08-18T20:45:55.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc06a510 0x7fbfcc0c5490 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/4170776628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/4170776628 >> 172.21.15.121:0/4170776628 conn(0x7fbfcc0c6b10 msgr2=0x7fbfcc0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/4170776628 shutdown_connections 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.947+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/4170776628 wait complete. 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 Processor -- start 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 -- start start 2023-08-18T20:45:55.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc151ec0 0x7fbfcc1ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1550a0 con 0x7fbfcc06a510 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c0c90 con 0x7fbfcc151ec0 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfd0ca1700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0ace40 con 0x7fbfcc0c1cf0 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfca59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfca59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44284/0 (socket says 172.21.15.121:44284) 2023-08-18T20:45:55.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.949+0000 7fbfca59c700 1 -- 172.21.15.121:0/1629106153 learned_addr learned my addr 172.21.15.121:0/1629106153 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfc9d9b700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfcad9d700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc151ec0 0x7fbfcc1ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 -- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 msgr2=0x7fbfcc154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 -- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc151ec0 msgr2=0x7fbfcc1ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc151ec0 0x7fbfcc1ecff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 -- 172.21.15.121:0/1629106153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc009550 con 0x7fbfcc06a510 2023-08-18T20:45:55.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfca59c700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009c40 tx=0x7fbfbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004510 con 0x7fbfcc06a510 2023-08-18T20:45:55.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc01e070 con 0x7fbfcc06a510 2023-08-18T20:45:55.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc0ac880 con 0x7fbfcc06a510 2023-08-18T20:45:55.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0038e0 con 0x7fbfcc06a510 2023-08-18T20:45:55.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.950+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc06e5b0 con 0x7fbfcc06a510 2023-08-18T20:45:55.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.951+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc06e410 con 0x7fbfcc06a510 2023-08-18T20:45:55.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.951+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfbc003a40 con 0x7fbfcc06a510 2023-08-18T20:45:55.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.952+0000 7fbfbaffd700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 0x7fbfac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:55.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.952+0000 7fbfc9d9b700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 0x7fbfac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:55.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.952+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fbfbc0896d0 con 0x7fbfcc06a510 2023-08-18T20:45:55.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.952+0000 7fbfc9d9b700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 0x7fbfac06c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc156b60 tx=0x7fbfc0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:55.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:55.956+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbfcc06e410 con 0x7fbfcc06a510 2023-08-18T20:45:56.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.150+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfcc06e410 con 0x7fbfcc06a510 2023-08-18T20:45:56.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.150+0000 7fbfbaffd700 1 -- 172.21.15.121:0/1629106153 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbfcc06e410 con 0x7fbfcc06a510 2023-08-18T20:45:56.151 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2023-08-18T20:45:56.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 msgr2=0x7fbfac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 0x7fbfac06c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc156b60 tx=0x7fbfc0009210 comp rx=0 tx=0).stop 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 msgr2=0x7fbfcc154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009c40 tx=0x7fbfbc004750 comp rx=0 tx=0).stop 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 shutdown_connections 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfcc151ec0 0x7fbfcc1ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbfac06a0e0 0x7fbfac06c5a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfcc06a510 0x7fbfcc154140 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 --2- 172.21.15.121:0/1629106153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbfcc0c1cf0 0x7fbfcc154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 >> 172.21.15.121:0/1629106153 conn(0x7fbfcc0c6b10 msgr2=0x7fbfcc157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:56.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 shutdown_connections 2023-08-18T20:45:56.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.153+0000 7fbfd0ca1700 1 -- 172.21.15.121:0/1629106153 wait complete. 2023-08-18T20:45:56.165 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-18T20:45:56.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.287+0000 7f6589c6e700 1 Processor -- start 2023-08-18T20:45:56.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.287+0000 7f6589c6e700 1 -- start start 2023-08-18T20:45:56.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.288+0000 7f6589c6e700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f658414e950 0x7f65840c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6589c6e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6589c6e700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840c2260 con 0x7f658414ed30 2023-08-18T20:45:56.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6589c6e700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840a6630 con 0x7f658414e950 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6589c6e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584151d90 con 0x7f6584070950 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f658414e950 0x7f65840c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6583fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6583fff700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.121:40706/0 (socket says 172.21.15.121:40706) 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6583fff700 1 -- 172.21.15.121:0/1956616029 learned_addr learned my addr 172.21.15.121:0/1956616029 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:56.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f658414e950 0x7f65840c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.121:54130/0 (socket says 172.21.15.121:54130) 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 -- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 msgr2=0x7f65840c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 -- 172.21.15.121:0/1956616029 >> v1:172.21.15.122:6789/0 conn(0x7f658414ed30 legacy=0x7f65840c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 -- 172.21.15.121:0/1956616029 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584152070 con 0x7f658414e950 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f6583fff700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-18T20:45:56.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.289+0000 7f65837fe700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c2ed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6578009840 tx=0x7f6578009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87f2c44a86a13407 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f65827fc700 1 -- 172.21.15.121:0/1956616029 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578011830 con 0x7f658414e950 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f65827fc700 1 -- 172.21.15.121:0/1956616029 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578011990 con 0x7f658414e950 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f65827fc700 1 -- 172.21.15.121:0/1956616029 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578011d20 con 0x7f658414e950 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 -- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 msgr2=0x7f65840c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c2ed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6578009840 tx=0x7f6578009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 -- 172.21.15.121:0/1956616029 shutdown_connections 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6584070950 0x7f65840c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 --2- 172.21.15.121:0/1956616029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c2ed0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 -- 172.21.15.121:0/1956616029 >> 172.21.15.121:0/1956616029 conn(0x7f65840c6b10 msgr2=0x7f65840c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:56.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 -- 172.21.15.121:0/1956616029 shutdown_connections 2023-08-18T20:45:56.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.290+0000 7f6589c6e700 1 -- 172.21.15.121:0/1956616029 wait complete. 2023-08-18T20:45:56.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.291+0000 7f6589c6e700 1 Processor -- start 2023-08-18T20:45:56.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.291+0000 7f6589c6e700 1 -- start start 2023-08-18T20:45:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f658414ed30 0x7f65841da210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840aa250 con 0x7f6584070950 2023-08-18T20:45:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65841d9d80 con 0x7f658414e950 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6589c6e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65841db0a0 con 0x7f658414ed30 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f65837fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f65837fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44298/0 (socket says 172.21.15.121:44298) 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f65837fe700 1 -- 172.21.15.121:0/3158689780 learned_addr learned my addr 172.21.15.121:0/3158689780 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6582ffd700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.292+0000 7f6583fff700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f658414ed30 0x7f65841da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 -- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f658414ed30 msgr2=0x7f65841da210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f658414ed30 0x7f65841da210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 -- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 msgr2=0x7f65840c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 -- 172.21.15.121:0/3158689780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c009b30 con 0x7f6584070950 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f65837fe700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f65780090b0 tx=0x7f6578004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780036a0 con 0x7f6584070950 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657801f070 con 0x7f6584070950 2023-08-18T20:45:56.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65780094a0 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578003a60 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.293+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65841db2f0 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.294+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65841da060 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.294+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6578003bc0 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.295+0000 7f656bfff700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 0x7f657006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.295+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6578021070 con 0x7f6584070950 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.295+0000 7f6582ffd700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 0x7f657006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.295+0000 7f6582ffd700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 0x7f657006c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.299+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6578055460 con 0x7f6584070950 2023-08-18T20:45:56.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.488+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6584074730 con 0x7f6584070950 2023-08-18T20:45:56.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.488+0000 7f656bfff700 1 -- 172.21.15.121:0/3158689780 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7f65780150a0 con 0x7f6584070950 2023-08-18T20:45:56.489 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2023-08-18T20:45:56.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 msgr2=0x7f657006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 0x7f657006c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6574007fd0 tx=0x7f6574009040 comp rx=0 tx=0).stop 2023-08-18T20:45:56.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 msgr2=0x7f65840a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f65780090b0 tx=0x7f6578004750 comp rx=0 tx=0).stop 2023-08-18T20:45:56.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 shutdown_connections 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f658414ed30 0x7f65841da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f657006a0e0 0x7f657006c5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584070950 0x7f65840a9d10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 --2- 172.21.15.121:0/3158689780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f658414e950 0x7f65840c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.490+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 >> 172.21.15.121:0/3158689780 conn(0x7f65840c6b10 msgr2=0x7f65840c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.491+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 shutdown_connections 2023-08-18T20:45:56.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.491+0000 7f6589c6e700 1 -- 172.21.15.121:0/3158689780 wait complete. 2023-08-18T20:45:56.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-18T20:45:56.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.623+0000 7fbec7f7c700 1 Processor -- start 2023-08-18T20:45:56.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.623+0000 7fbec7f7c700 1 -- start start 2023-08-18T20:45:56.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec7f7c700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbec0070150 0x7fbec006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec7f7c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec0150d80 con 0x7fbec00c37c0 2023-08-18T20:45:56.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec7f7c700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec00c2510 con 0x7fbec014a8c0 2023-08-18T20:45:56.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec7f7c700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec00c2a90 con 0x7fbec0070150 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec5517700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbec00c37c0 0x7fbec0151210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50888/0 (socket says 172.21.15.121:50888) 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec5517700 1 -- 172.21.15.121:0/3798710887 learned_addr learned my addr 172.21.15.121:0/3798710887 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec6519700 1 --2- 172.21.15.121:0/3798710887 >> v2:172.21.15.122:3300/0 conn(0x7fbec0070150 0x7fbec006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788119831 0 0) 0x7fbec0150d80 con 0x7fbec00c37c0 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeac0046c0 con 0x7fbec00c37c0 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 770422424 0 0) 0x7fbeac0046c0 con 0x7fbec00c37c0 2023-08-18T20:45:56.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 >> v2:172.21.15.122:3300/0 conn(0x7fbec0070150 msgr2=0x7fbec006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 --2- 172.21.15.121:0/3798710887 >> v2:172.21.15.122:3300/0 conn(0x7fbec0070150 0x7fbec006b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 >> v1:172.21.15.122:6789/0 conn(0x7fbec014a8c0 legacy=0x7fbec00c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0072630 con 0x7fbec00c37c0 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1774363193 0 0) 0x7fbeb00017f0 con 0x7fbec00c37c0 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec6519700 1 --2- 172.21.15.121:0/3798710887 >> v2:172.21.15.122:3300/0 conn(0x7fbec0070150 0x7fbec006b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 >> v1:172.21.15.121:6789/0 conn(0x7fbec00c37c0 legacy=0x7fbec0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbeac004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbeac005960 0x7fbeac005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbeac006520 0x7fbeac00cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec00c2a90 con 0x7fbeac004b80 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac00d400 con 0x7fbeac006520 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.624+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac00d5c0 con 0x7fbeac005960 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbeac004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5517700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbeac005960 0x7fbeac005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec6519700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbeac006520 0x7fbeac00cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 -- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbeac005960 msgr2=0x7fbeac005de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbeac005960 0x7fbeac005de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 -- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbeac006520 msgr2=0x7fbeac00cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbeac006520 0x7fbeac00cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 -- 172.21.15.121:0/3798710887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0046c0 con 0x7fbeac004b80 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec6519700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbeac006520 0x7fbeac00cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5517700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbeac005960 0x7fbeac005de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec6519700 1 -- 172.21.15.121:0/3798710887 reap_dead start 2023-08-18T20:45:56.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec5d18700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbeac004f80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbebc003eb0 tx=0x7fbeac006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e34c874bdd83ea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc016070 con 0x7fbeac004b80 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc006860 con 0x7fbeac004b80 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.625+0000 7fbec4d16700 1 -- 172.21.15.121:0/3798710887 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc003950 con 0x7fbeac004b80 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 -- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 msgr2=0x7fbeac004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbeac004f80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbebc003eb0 tx=0x7fbeac006990 comp rx=0 tx=0).stop 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 -- 172.21.15.121:0/3798710887 shutdown_connections 2023-08-18T20:45:56.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/3798710887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbeac004f80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 -- 172.21.15.121:0/3798710887 >> 172.21.15.121:0/3798710887 conn(0x7fbec00c2ca0 msgr2=0x7fbec00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:56.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 -- 172.21.15.121:0/3798710887 shutdown_connections 2023-08-18T20:45:56.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.626+0000 7fbec7f7c700 1 -- 172.21.15.121:0/3798710887 wait complete. 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.627+0000 7fbec7f7c700 1 Processor -- start 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.627+0000 7fbec7f7c700 1 -- start start 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbec01e9390 0x7fbec00a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbec00a96f0 0x7fbec0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01e9890 con 0x7fbeac004b80 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01e6370 con 0x7fbec00a96f0 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01e55b0 con 0x7fbec01e9390 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44318/0 (socket says 172.21.15.121:44318) 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 -- 172.21.15.121:0/287937429 learned_addr learned my addr 172.21.15.121:0/287937429 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec6519700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbec00a96f0 0x7fbec0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 -- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbec01e9390 msgr2=0x7fbec00a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbec01e9390 0x7fbec00a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 -- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbec00a96f0 msgr2=0x7fbec0153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbec00a96f0 0x7fbec0153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 -- 172.21.15.121:0/287937429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec01e5890 con 0x7fbeac004b80 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec5d18700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00d3d0 tx=0x7fbebc003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc016040 con 0x7fbeac004b80 2023-08-18T20:45:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc007530 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec01e5b70 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc012420 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.628+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec01524c0 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.629+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec01e6090 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.630+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbebc012580 con 0x7fbeac004b80 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.630+0000 7fbeb67fc700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 0x7fbea406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:56.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.630+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fbebc089680 con 0x7fbeac004b80 2023-08-18T20:45:56.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.630+0000 7fbec5517700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 0x7fbea406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:56.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.630+0000 7fbec5517700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 0x7fbea406c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0001150 tx=0x7fbeb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:56.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.634+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbec01e6090 con 0x7fbeac004b80 2023-08-18T20:45:56.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.838+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbec01e6090 con 0x7fbeac004b80 2023-08-18T20:45:56.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.838+0000 7fbeb67fc700 1 -- 172.21.15.121:0/287937429 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbec01e6090 con 0x7fbeac004b80 2023-08-18T20:45:56.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 msgr2=0x7fbea406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 0x7fbea406c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0001150 tx=0x7fbeb0009040 comp rx=0 tx=0).stop 2023-08-18T20:45:56.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 msgr2=0x7fbec0151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:56.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00d3d0 tx=0x7fbebc003780 comp rx=0 tx=0).stop 2023-08-18T20:45:56.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 shutdown_connections 2023-08-18T20:45:56.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbec00a96f0 0x7fbec0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fbea406a0e0 0x7fbea406c5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeac004b80 0x7fbec0151f80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 --2- 172.21.15.121:0/287937429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbec01e9390 0x7fbec00a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 >> 172.21.15.121:0/287937429 conn(0x7fbec00c2ca0 msgr2=0x7fbec006e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 shutdown_connections 2023-08-18T20:45:56.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:56.840+0000 7fbec7f7c700 1 -- 172.21.15.121:0/287937429 wait complete. 2023-08-18T20:45:56.844 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2023-08-18T20:45:56.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-18T20:45:56.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:56.853 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:56.898 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-08-18T20:45:56.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:56.899 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-18T20:45:56.920 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:56.920 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:56.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16734 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-18T20:45:56.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-18T20:45:57.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.103+0000 7fd9775cd700 1 Processor -- start 2023-08-18T20:45:57.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.103+0000 7fd9775cd700 1 -- start start 2023-08-18T20:45:57.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd9775cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 0x7fd9700c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd9775cd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700c4f40 con 0x7fd9700c1b10 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd9775cd700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700c6120 con 0x7fd9700c0c50 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd9775cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701551f0 con 0x7fd9700a6290 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd975b6a700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd9700c1b10 0x7fd970071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50912/0 (socket says 172.21.15.121:50912) 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd975b6a700 1 -- 172.21.15.121:0/2040873649 learned_addr learned my addr 172.21.15.121:0/2040873649 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:57.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd974b68700 1 --2- 172.21.15.121:0/2040873649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 0x7fd9700c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:57.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993364044 0 0) 0x7fd9700c4f40 con 0x7fd9700c1b10 2023-08-18T20:45:57.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c0035b0 con 0x7fd9700c1b10 2023-08-18T20:45:57.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202872095 0 0) 0x7fd9700c6120 con 0x7fd9700c0c50 2023-08-18T20:45:57.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9700c4f40 con 0x7fd9700c0c50 2023-08-18T20:45:57.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164658642 0 0) 0x7fd95c0035b0 con 0x7fd9700c1b10 2023-08-18T20:45:57.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd974b68700 1 -- 172.21.15.121:0/2040873649 >> v1:172.21.15.122:6789/0 conn(0x7fd9700c0c50 legacy=0x7fd97006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.104+0000 7fd974b68700 1 -- 172.21.15.121:0/2040873649 >> v1:172.21.15.121:6789/0 conn(0x7fd9700c1b10 legacy=0x7fd970071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.105+0000 7fd974b68700 1 -- 172.21.15.121:0/2040873649 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700c63a0 con 0x7fd9700a6290 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.105+0000 7fd974b68700 1 --2- 172.21.15.121:0/2040873649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 0x7fd9700c53d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd960009870 tx=0x7fd960009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db275541fa02dc5d server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.105+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680019f0 con 0x7fd9700a6290 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.105+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960004030 con 0x7fd9700a6290 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.105+0000 7fd967fff700 1 -- 172.21.15.121:0/2040873649 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600043a0 con 0x7fd9700a6290 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 -- 172.21.15.121:0/2040873649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 msgr2=0x7fd9700c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 --2- 172.21.15.121:0/2040873649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 0x7fd9700c53d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd960009870 tx=0x7fd960009b80 comp rx=0 tx=0).stop 2023-08-18T20:45:57.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 -- 172.21.15.121:0/2040873649 shutdown_connections 2023-08-18T20:45:57.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 --2- 172.21.15.121:0/2040873649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700a6290 0x7fd9700c53d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 -- 172.21.15.121:0/2040873649 >> 172.21.15.121:0/2040873649 conn(0x7fd9700c6b10 msgr2=0x7fd9700c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:57.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 -- 172.21.15.121:0/2040873649 shutdown_connections 2023-08-18T20:45:57.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.106+0000 7fd9775cd700 1 -- 172.21.15.121:0/2040873649 wait complete. 2023-08-18T20:45:57.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 Processor -- start 2023-08-18T20:45:57.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 -- start start 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700c0c50 0x7fd9701e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9700c1b10 0x7fd970152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970145ef0 con 0x7fd9700a6290 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701e9810 con 0x7fd9700c1b10 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.108+0000 7fd9775cd700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701538a0 con 0x7fd9700c0c50 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:57.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44332/0 (socket says 172.21.15.121:44332) 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 -- 172.21.15.121:0/999382280 learned_addr learned my addr 172.21.15.121:0/999382280 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd974b68700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700c0c50 0x7fd9701e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975b6a700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9700c1b10 0x7fd970152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 -- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700c0c50 msgr2=0x7fd9701e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700c0c50 0x7fd9701e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 -- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9700c1b10 msgr2=0x7fd970152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9700c1b10 0x7fd970152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 -- 172.21.15.121:0/999382280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600094a0 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd975369700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00c520 tx=0x7fd96c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0052d0 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c005430 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd970153b80 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0038c0 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.109+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97006e1e0 con 0x7fd9700a6290 2023-08-18T20:45:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970074730 con 0x7fd9700a6290 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd96c003a20 con 0x7fd9700a6290 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd965ffb700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 0x7fd95406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fd96c087c40 con 0x7fd9700a6290 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd974b68700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 0x7fd95406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.111+0000 7fd974b68700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 0x7fd95406c5a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd9600090b0 tx=0x7fd960008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:57.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.116+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd96c053060 con 0x7fd9700a6290 2023-08-18T20:45:57.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.351+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9700c4a10 con 0x7fd9700a6290 2023-08-18T20:45:57.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.351+0000 7fd965ffb700 1 -- 172.21.15.121:0/999382280 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd96c0170b0 con 0x7fd9700a6290 2023-08-18T20:45:57.352 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-18T20:45:57.352 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-08-18T20:45:57.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 msgr2=0x7fd95406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 0x7fd95406c5a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd9600090b0 tx=0x7fd960008030 comp rx=0 tx=0).stop 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 msgr2=0x7fd970152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00c520 tx=0x7fd96c00c830 comp rx=0 tx=0).stop 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 shutdown_connections 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9700c1b10 0x7fd970152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd95406a0e0 0x7fd95406c5a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9700a6290 0x7fd970152300 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 --2- 172.21.15.121:0/999382280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9700c0c50 0x7fd9701e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:57.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 >> 172.21.15.121:0/999382280 conn(0x7fd9700c6b10 msgr2=0x7fd970070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:57.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 shutdown_connections 2023-08-18T20:45:57.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:57.353+0000 7fd9775cd700 1 -- 172.21.15.121:0/999382280 wait complete. 2023-08-18T20:45:57.365 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-08-18T20:45:57.366 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-18T20:45:57.366 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-08-18T20:45:57.366 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-18T20:45:57.366 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:57.367 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-08-18T20:45:57.367 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-18T20:45:57.367 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-18T20:45:57.367 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:57.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.368 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-08-18T20:45:57.390 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:57.391 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42095sec preferred_lft 42095sec 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc56:1d53:8eb3:4926/64 scope link noprefixroute 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-18T20:45:57.392 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c41:ffff:fe33:4b6a/64 scope link 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether e6:bf:e4:4b:83:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::e4bf:e4ff:fe4b:8325/64 scope link 2023-08-18T20:45:57.393 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-08-18T20:45:57.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.394 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-18T20:45:57.461 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-08-18T20:45:57.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.463 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-08-18T20:45:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-08-18T20:45:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-18T20:45:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-18T20:45:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-18T20:45:57.525 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-18T20:45:57.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.526 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-08-18T20:45:57.526 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-08-18T20:45:57.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-18T20:45:57.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-18T20:45:57.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-18T20:45:57.528 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-08-18T20:45:57.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.645 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-08-18T20:45:57.666 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-18T20:45:57.666 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:57.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.667 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-08-18T20:45:57.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:57.739 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:57.800 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-18T20:45:57.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-18T20:45:57.801 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:57.860 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-08-18T20:45:57.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:57.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:57.954 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:57.955 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:57.986 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:57.986 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:58.014 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-18T20:45:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-18T20:45:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.122:3300,172.21.15.122:3301" 2023-08-18T20:45:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with new device syntax: 1@4755cd5f-6734-4b3f-8f96-cd10dcf8d04c.cephfs2=/ 2023-08-18T20:45:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.121:3300/172.21.15.122:3300/172.21.15.122:3301" will pass to kernel 2023-08-18T20:45:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: v2 mount support check returned 2 2023-08-18T20:45:58.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: kernel does not support v2 syntax 2023-08-18T20:45:58.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-18T20:45:58.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790" 2023-08-18T20:45:58.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.122:6789,172.21.15.122:6790:/ 2023-08-18T20:45:58.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs2,fsid=4755cd5f-6734-4b3f-8f96-cd10dcf8d04c" will pass to kernel 2023-08-18T20:45:58.017 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-18T20:45:58.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:58.018 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-18T20:45:58.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-18T20:45:58.054 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-18T20:45:58.147 INFO:teuthology.orchestra.run.smithi122.stdout:client5758 2023-08-18T20:45:58.147 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-08-18T20:45:58.147 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-18T20:45:58.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-08-18T20:45:58.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.304+0000 7f6911a22700 1 Processor -- start 2023-08-18T20:45:58.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.304+0000 7f6911a22700 1 -- start start 2023-08-18T20:45:58.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6911a22700 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f690c0c1030 0x7f690c066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6911a22700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c06cc30 con 0x7f690c1518e0 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6911a22700 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0c0b80 con 0x7f690c0bf550 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6911a22700 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c155260 con 0x7f690c0c1030 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f690affd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f690c1518e0 0x7f690c06b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50922/0 (socket says 172.21.15.121:50922) 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f690affd700 1 -- 172.21.15.121:0/2079373622 learned_addr learned my addr 172.21.15.121:0/2079373622 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f690a7fc700 1 --2- 172.21.15.121:0/2079373622 >> v2:172.21.15.122:3300/0 conn(0x7f690c0c1030 0x7f690c066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898895342 0 0) 0x7f690c06cc30 con 0x7f690c1518e0 2023-08-18T20:45:58.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.305+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f40035b0 con 0x7f690c1518e0 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f690a7fc700 1 -- 172.21.15.121:0/2079373622 >> v1:172.21.15.122:6789/0 conn(0x7f690c0bf550 legacy=0x7f690c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f690a7fc700 1 -- 172.21.15.121:0/2079373622 >> v1:172.21.15.121:6789/0 conn(0x7f690c1518e0 legacy=0x7f690c06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 <== mon.0 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389600137 0 0) 0x7f68f40035b0 con 0x7f690c1518e0 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f690a7fc700 1 -- 172.21.15.121:0/2079373622 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c06ce80 con 0x7f690c0c1030 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f690a7fc700 1 --2- 172.21.15.121:0/2079373622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c066340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009820 tx=0x7f68fc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebd5bd628bc6539 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900001670 con 0x7f690c0c1030 2023-08-18T20:45:58.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc005c30 con 0x7f690c0c1030 2023-08-18T20:45:58.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.306+0000 7f6909ffb700 1 -- 172.21.15.121:0/2079373622 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004030 con 0x7f690c0c1030 2023-08-18T20:45:58.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 -- 172.21.15.121:0/2079373622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 msgr2=0x7f690c066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 --2- 172.21.15.121:0/2079373622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c066340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009820 tx=0x7f68fc009b30 comp rx=0 tx=0).stop 2023-08-18T20:45:58.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 -- 172.21.15.121:0/2079373622 shutdown_connections 2023-08-18T20:45:58.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 --2- 172.21.15.121:0/2079373622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c066340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 -- 172.21.15.121:0/2079373622 >> 172.21.15.121:0/2079373622 conn(0x7f690c0c2ca0 msgr2=0x7f690c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 -- 172.21.15.121:0/2079373622 shutdown_connections 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.307+0000 7f6911a22700 1 -- 172.21.15.121:0/2079373622 wait complete. 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.308+0000 7f6911a22700 1 Processor -- start 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.308+0000 7f6911a22700 1 -- start start 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c1ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 0x7f690c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1edac0 con 0x7f690c0bf550 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1e9c30 con 0x7f690c0c1030 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c14d0c0 con 0x7f690c1518e0 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44346/0 (socket says 172.21.15.121:44346) 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 -- 172.21.15.121:0/651771359 learned_addr learned my addr 172.21.15.121:0/651771359 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690a7fc700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c1ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690b7fe700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 0x7f690c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 -- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 msgr2=0x7f690c14c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 0x7f690c14c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 -- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 msgr2=0x7f690c1ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c1ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 -- 172.21.15.121:0/651771359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc009430 con 0x7f690c0bf550 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690b7fe700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 0x7f690c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f690affd700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f690000c730 tx=0x7f690000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900004c80 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900004de0 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c1e9600 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900007310 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.309+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0c5410 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.310+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c074730 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.311+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6900007470 con 0x7f690c0bf550 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.311+0000 7f68f3fff700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.311+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6900088580 con 0x7f690c0bf550 2023-08-18T20:45:58.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.311+0000 7f690a7fc700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.311+0000 7f690a7fc700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f690c0c1440 tx=0x7f68fc008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.315+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f69000539a0 con 0x7f690c0bf550 2023-08-18T20:45:58.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.582+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f690c071cb0 con 0x7f690c0bf550 2023-08-18T20:45:58.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.586+0000 7f68f3fff700 1 -- 172.21.15.121:0/651771359 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v15) v1 ==== 291+0+0 (secure 0 0 0) 0x7f6900056fc0 con 0x7f690c0bf550 2023-08-18T20:45:58.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 msgr2=0x7f68f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f690c0c1440 tx=0x7f68fc008070 comp rx=0 tx=0).stop 2023-08-18T20:45:58.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 msgr2=0x7f690c1ea0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f690000c730 tx=0x7f690000ca40 comp rx=0 tx=0).stop 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 shutdown_connections 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f690c1518e0 0x7f690c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7f68f806a0e0 0x7f68f806c5a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f690c0bf550 0x7f690c1ea0c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 --2- 172.21.15.121:0/651771359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c0c1030 0x7f690c1ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 >> 172.21.15.121:0/651771359 conn(0x7f690c0c2ca0 msgr2=0x7f690c151cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 shutdown_connections 2023-08-18T20:45:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.588+0000 7f6911a22700 1 -- 172.21.15.121:0/651771359 wait complete. 2023-08-18T20:45:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:added key for client.testuser 2023-08-18T20:45:58.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-08-18T20:45:58.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.721+0000 7fd1fe12e700 1 Processor -- start 2023-08-18T20:45:58.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.721+0000 7fd1fe12e700 1 -- start start 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1fe12e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ed30 0x7fd1f80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1fe12e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1fe12e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f80c2260 con 0x7fd1f814e950 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1fe12e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80a6630 con 0x7fd1f814ed30 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1fe12e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8151d90 con 0x7fd1f8070950 2023-08-18T20:45:58.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f6ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ed30 0x7fd1f80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f77fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd1f814e950 0x7fd1f80c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50936/0 (socket says 172.21.15.121:50936) 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f77fe700 1 -- 172.21.15.121:0/1727858486 learned_addr learned my addr 172.21.15.121:0/1727858486 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f7fff700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f6ffd700 1 -- 172.21.15.121:0/1727858486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 msgr2=0x7fd1f80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f6ffd700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f6ffd700 1 -- 172.21.15.121:0/1727858486 >> v1:172.21.15.121:6789/0 conn(0x7fd1f814e950 legacy=0x7fd1f80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f6ffd700 1 -- 172.21.15.121:0/1727858486 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8152070 con 0x7fd1f814ed30 2023-08-18T20:45:58.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.722+0000 7fd1f67fc700 1 -- 172.21.15.121:0/1727858486 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477191299 0 0) 0x7fd1f80c2260 con 0x7fd1f814e950 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f7fff700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f6ffd700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f80c2ed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009840 tx=0x7fd1e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6c6c8afce4ee33 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f67fc700 1 -- 172.21.15.121:0/1727858486 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8011830 con 0x7fd1f814ed30 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f67fc700 1 -- 172.21.15.121:0/1727858486 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8011990 con 0x7fd1f814ed30 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1f67fc700 1 -- 172.21.15.121:0/1727858486 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8011d20 con 0x7fd1f814ed30 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 -- 172.21.15.121:0/1727858486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 msgr2=0x7fd1f80c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f80c2ed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009840 tx=0x7fd1e8009b50 comp rx=0 tx=0).stop 2023-08-18T20:45:58.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 -- 172.21.15.121:0/1727858486 shutdown_connections 2023-08-18T20:45:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/1727858486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f80c2ed0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 -- 172.21.15.121:0/1727858486 >> 172.21.15.121:0/1727858486 conn(0x7fd1f80c6b10 msgr2=0x7fd1f80c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 -- 172.21.15.121:0/1727858486 shutdown_connections 2023-08-18T20:45:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.723+0000 7fd1fe12e700 1 -- 172.21.15.121:0/1727858486 wait complete. 2023-08-18T20:45:58.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 Processor -- start 2023-08-18T20:45:58.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 -- start start 2023-08-18T20:45:58.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 0x7fd1f81ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f806e5e0 con 0x7fd1f814ed30 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f81da370 con 0x7fd1f814e950 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.725+0000 7fd1fe12e700 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f81eb0b0 con 0x7fd1f8070950 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44364/0 (socket says 172.21.15.121:44364) 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 -- 172.21.15.121:0/3195069940 learned_addr learned my addr 172.21.15.121:0/3195069940 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f77fe700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f6ffd700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 0x7fd1f81ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 -- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 msgr2=0x7fd1f80abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 -- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 msgr2=0x7fd1f81ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 0x7fd1f81ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 -- 172.21.15.121:0/3195069940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80094a0 con 0x7fd1f814ed30 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f77fe700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f6ffd700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 0x7fd1f81ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1f7fff700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0007ea0 tx=0x7fd1f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000de70 con 0x7fd1f814ed30 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000f040 con 0x7fd1f814ed30 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f81daae0 con 0x7fd1f814ed30 2023-08-18T20:45:58.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0003c60 con 0x7fd1f814ed30 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.726+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f806e7f0 con 0x7fd1f814ed30 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.727+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f806e9e0 con 0x7fd1f814ed30 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.728+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd1f0004030 con 0x7fd1f814ed30 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.728+0000 7fd1dffff700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 0x7fd1e406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.728+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fd1f0088960 con 0x7fd1f814ed30 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.728+0000 7fd1f77fe700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 0x7fd1e406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-18T20:45:58.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.728+0000 7fd1f77fe700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 0x7fd1e406c5d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec000f60 tx=0x7fd1ec007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-18T20:45:58.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:58.732+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd1f0053d80 con 0x7fd1f814ed30 2023-08-18T20:45:59.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.001+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fd1f8074730 con 0x7fd1f814ed30 2023-08-18T20:45:59.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.001+0000 7fd1dffff700 1 -- 172.21.15.121:0/3195069940 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v15) v1 ==== 85+0+245 (secure 0 0 0) 0x7fd1f00573a0 con 0x7fd1f814ed30 2023-08-18T20:45:59.002 INFO:teuthology.orchestra.run.smithi121.stdout:[client.testuser] 2023-08-18T20:45:59.003 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCG2N9k0nvVIhAA+MVBxzza35lcgkOpaFBCFA== 2023-08-18T20:45:59.003 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow rw fsname=cephfs" 2023-08-18T20:45:59.003 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-08-18T20:45:59.003 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-08-18T20:45:59.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.003+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 msgr2=0x7fd1e406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:59.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.003+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 0x7fd1e406c5d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec000f60 tx=0x7fd1ec007ca0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.003+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 msgr2=0x7fd1f81eab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-18T20:45:59.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.003+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0007ea0 tx=0x7fd1f000d3b0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 shutdown_connections 2023-08-18T20:45:59.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:6832/2511824978,v1:172.21.15.121:6833/2511824978] conn(0x7fd1e406a110 0x7fd1e406c5d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f814ed30 0x7fd1f81eab70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1f8070950 0x7fd1f80abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 --2- 172.21.15.121:0/3195069940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f814e950 0x7fd1f81ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-18T20:45:59.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 >> 172.21.15.121:0/3195069940 conn(0x7fd1f80c6b10 msgr2=0x7fd1f80c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-18T20:45:59.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 shutdown_connections 2023-08-18T20:45:59.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-18T20:45:59.004+0000 7fd1fe12e700 1 -- 172.21.15.121:0/3195069940 wait complete. 2023-08-18T20:45:59.016 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2023-08-18T20:45:59.034 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.t0vHPruQFh 2023-08-18T20:45:59.034 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-18T20:45:59.035 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/tmp/tmp.t0vHPruQFh 2023-08-18T20:45:59.079 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 309, in copy_and_close shutil.copyfileobj(src, fdst) File "/usr/lib/python3.8/shutil.py", line 199, in copyfileobj fsrc_read = fsrc.read AttributeError: 'RemoteProcess' object has no attribute 'read' 2023-08-18T20:46:19.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:46:19.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:46:49.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:46:49.336 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:47:19.406 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:47:19.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:47:49.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:47:49.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:48:19.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:48:19.572 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:48:49.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:48:49.643 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:49:19.714 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:49:19.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:49:49.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:49:49.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:50:19.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:50:19.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:50:49.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:50:49.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:51:20.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:51:20.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:51:50.104 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:51:50.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:52:20.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:52:20.198 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:52:50.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:52:50.276 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:53:20.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:53:20.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:53:50.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:53:50.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:54:20.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:54:20.517 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:54:50.617 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:54:50.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:55:20.698 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:55:20.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:55:50.814 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:55:50.816 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:56:20.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:56:20.881 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:56:50.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:56:50.990 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:57:21.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:57:21.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:57:51.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:57:51.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:58:21.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:58:21.234 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:58:51.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:58:51.311 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:59:21.408 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:59:21.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:59:51.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T20:59:51.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:00:21.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:00:21.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:00:51.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:00:51.667 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:01:21.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:01:21.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:01:51.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:01:51.830 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:02:21.916 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:02:21.919 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:02:51.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:02:51.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:03:22.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:03:22.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:03:52.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:03:52.162 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:04:22.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:04:22.234 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:04:52.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:04:52.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:05:22.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:05:22.371 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:05:52.432 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:05:52.435 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:06:22.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:06:22.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:06:52.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:06:52.632 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:07:22.697 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:07:22.700 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:07:52.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:07:52.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:08:22.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:08:22.839 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:08:52.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:08:52.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:09:22.999 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:09:23.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:09:53.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:09:53.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:10:23.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:10:23.181 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:10:53.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:10:53.262 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:11:23.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:11:23.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:11:53.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:11:53.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:12:23.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:12:23.472 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:12:53.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:12:53.559 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:13:23.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:13:23.626 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:13:53.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:13:53.724 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:14:23.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:14:23.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:14:53.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:14:53.893 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:15:23.955 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:15:23.958 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:15:54.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:15:54.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:16:24.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:16:24.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:16:54.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:16:54.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:17:24.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:17:24.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:17:54.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:17:54.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:18:24.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:18:24.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:18:54.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:18:54.594 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:19:24.670 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:19:24.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:19:54.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:19:54.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:20:24.824 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:20:24.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:20:54.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:20:54.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:21:24.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:21:24.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:21:55.040 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:21:55.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:22:25.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:22:25.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:22:55.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:22:55.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:23:25.260 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:23:25.263 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:23:55.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:23:55.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:24:25.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:24:25.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:24:55.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:24:55.514 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:25:25.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:25:25.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:25:55.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:25:55.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:26:25.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:26:25.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:26:55.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:26:55.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:27:25.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:27:25.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:27:55.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:27:55.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:28:26.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:28:26.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:28:56.226 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:28:56.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:29:26.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:29:26.352 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:29:56.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:29:56.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:30:26.528 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:30:26.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:30:56.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:30:56.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:31:26.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:31:26.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:31:56.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:31:56.965 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:32:27.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:32:27.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:32:57.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:32:57.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:33:27.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:33:27.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:33:57.420 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:33:57.423 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:34:27.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:34:27.579 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:34:57.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:34:57.710 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:35:27.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:35:27.782 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:35:57.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:35:57.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:36:28.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:36:28.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:36:58.299 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:36:58.302 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:37:28.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:37:28.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:37:58.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:37:58.515 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:38:28.582 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:38:28.585 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:38:58.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:38:58.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:39:28.884 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:39:28.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:39:59.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:39:59.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:40:29.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:40:29.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:40:59.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:40:59.372 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:41:29.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:41:29.504 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:41:59.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:41:59.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:42:29.817 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:42:29.819 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:43:00.118 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:43:00.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:43:30.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:43:30.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:44:00.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:44:00.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:44:30.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:44:30.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:45:00.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:45:00.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:45:30.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:45:30.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:46:00.895 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:46:00.898 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:46:31.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:46:31.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:47:01.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:47:01.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:47:31.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:47:31.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:48:01.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:48:01.422 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:48:31.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:48:31.548 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:49:01.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:49:01.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:49:31.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:49:31.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:50:02.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:50:02.061 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:50:32.192 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:50:32.195 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:51:02.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:51:02.348 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:51:32.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:51:32.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:52:02.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:52:02.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:52:32.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:52:32.774 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:53:03.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:53:03.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:53:33.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:53:33.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:54:03.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:54:03.299 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:54:33.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:54:33.444 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:55:03.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:55:03.580 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:55:33.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:55:33.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:56:03.879 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:56:03.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:56:34.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:56:34.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:57:04.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:57:04.094 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:57:34.214 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:57:34.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:58:04.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:58:04.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:58:34.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:58:34.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:59:04.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:59:04.718 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:59:34.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T21:59:34.865 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:00:04.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:00:04.997 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:00:35.116 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:00:35.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:01:05.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:01:05.272 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:01:35.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:01:35.434 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:02:05.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:02:05.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:02:35.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:02:35.722 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:03:05.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:03:05.864 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:03:36.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:03:36.025 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:04:06.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:04:06.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:04:36.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:04:36.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:05:06.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:05:06.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:05:36.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:05:36.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:06:06.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:06:06.670 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:06:36.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:06:36.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:07:07.000 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:07:07.003 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:07:37.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:07:37.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:08:07.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:08:07.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:08:37.356 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:08:37.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:09:07.528 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:09:07.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:09:37.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:09:37.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:10:07.824 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:10:07.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:10:38.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:10:38.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:11:08.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:11:08.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:11:38.424 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:11:38.427 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:12:08.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:12:08.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:12:38.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:12:38.714 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:13:08.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:13:08.870 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:13:39.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:13:39.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:14:09.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:14:09.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:14:39.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:14:39.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:15:09.427 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:15:09.430 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:15:39.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:15:39.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:16:09.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:16:09.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:16:39.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:16:39.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:17:10.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:17:10.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:17:40.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:17:40.201 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:18:10.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:18:10.326 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:18:40.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:18:40.478 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:19:10.620 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:19:10.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:19:40.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:19:40.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:20:10.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:20:10.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:20:41.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:20:41.047 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:21:11.184 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:21:11.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:21:41.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:21:41.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:22:11.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:22:11.437 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:22:41.566 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:22:41.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:23:11.879 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:23:11.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:23:42.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:23:42.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:24:12.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:24:12.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:24:42.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:24:42.286 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:25:12.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:25:12.355 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:25:42.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:25:42.498 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:26:12.642 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:26:12.645 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:26:42.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:26:42.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:27:12.930 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:27:12.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:27:43.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:27:43.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:28:13.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:28:13.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:28:43.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:28:43.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:29:13.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:29:13.472 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:29:43.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:29:44.061 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:30:14.182 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:30:14.186 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:30:44.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:30:44.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:31:14.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:31:14.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:31:44.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:31:44.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:32:14.768 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:32:14.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:32:44.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:32:44.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:33:15.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:33:15.088 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:33:45.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:33:45.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:34:15.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:34:15.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:34:45.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:34:45.690 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:35:15.818 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:35:15.821 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:35:45.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:35:45.919 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:36:16.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:36:16.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:36:46.149 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:36:46.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:37:16.311 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:37:16.314 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:37:46.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:37:46.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:38:16.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:38:16.596 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:38:46.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:38:46.667 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:39:16.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:39:16.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:39:46.884 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:39:46.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:40:17.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:40:17.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:40:47.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:40:47.142 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:41:17.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:41:17.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:41:47.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:41:47.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:42:17.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:42:17.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:42:47.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:42:47.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:43:17.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:43:17.811 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:43:47.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:43:47.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:44:18.084 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:44:18.087 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:44:48.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:44:48.250 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:45:18.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:45:18.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:45:48.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:45:48.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:46:18.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:46:18.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:46:48.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:46:48.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:47:18.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:47:18.970 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:47:49.103 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:47:49.110 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:48:19.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:48:19.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:48:49.394 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:48:49.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:49:19.553 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:49:19.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:49:49.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:49:49.710 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:50:20.010 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:50:20.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:50:50.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:50:51.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:51:21.107 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:51:21.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:51:51.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:51:51.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:52:21.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:52:21.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:52:51.484 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:52:51.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:53:21.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:53:21.634 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:53:51.695 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:53:51.698 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:54:21.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:54:21.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:54:51.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:54:51.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:55:22.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:55:22.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:55:52.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:55:52.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:56:22.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:56:22.370 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:56:52.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:56:52.517 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:57:22.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:57:22.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:57:52.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:57:52.769 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:58:22.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:58:22.932 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:58:53.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:58:53.067 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:59:23.201 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:59:23.204 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:59:53.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T22:59:53.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:00:23.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:00:23.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:00:53.604 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:00:53.608 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:01:23.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:01:23.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:01:53.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:01:53.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:02:24.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:02:24.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:02:54.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:02:54.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:03:24.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:03:24.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:03:54.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:03:54.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:04:24.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:04:24.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:04:54.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:04:54.730 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:05:24.884 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:05:24.887 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:05:55.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:05:55.038 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:06:25.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:06:25.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:06:55.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:06:55.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:07:25.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:07:25.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:07:55.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:07:55.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:08:25.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:08:25.713 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:08:55.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:08:55.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:09:25.958 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:09:25.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:09:56.104 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:09:56.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:10:26.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:10:26.205 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:10:56.327 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:10:56.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:11:26.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:11:26.488 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:11:56.620 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:11:56.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:12:26.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:12:26.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:12:56.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:12:56.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:13:26.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:13:26.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:13:57.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:13:57.140 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:14:27.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:14:27.428 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:14:57.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:14:57.584 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:15:27.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:15:27.710 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:15:57.842 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:15:57.845 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:16:27.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:16:27.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:16:58.146 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:16:58.149 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:17:28.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:17:28.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:17:58.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:17:58.420 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:18:28.558 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:18:28.561 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:18:58.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:18:58.707 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:19:28.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:19:28.875 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:19:59.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:19:59.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:20:29.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:20:29.148 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:20:59.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:20:59.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:21:29.485 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:21:29.489 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:21:59.625 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:21:59.629 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:22:29.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:22:29.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:22:59.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:22:59.926 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:23:30.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:23:30.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:24:00.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:24:00.254 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:24:30.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:24:30.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:25:00.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:25:00.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:25:30.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:25:30.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:26:00.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:26:00.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:26:31.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:26:31.045 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:27:01.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:27:01.128 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:27:31.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:27:31.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:28:01.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:28:01.377 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:28:31.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:28:31.517 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:29:01.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:29:01.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:29:31.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:29:31.794 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:30:01.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:30:01.926 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:30:32.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:30:32.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:31:02.289 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:31:02.292 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:31:32.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:31:32.375 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:32:02.529 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:32:02.534 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:32:32.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:32:32.688 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:33:02.843 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:33:02.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:33:32.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:33:32.985 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:34:03.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:34:03.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:34:33.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:34:33.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:35:03.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:35:03.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:35:33.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:35:33.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:36:03.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:36:03.649 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:36:33.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:36:33.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:37:03.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:37:03.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:37:34.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:37:34.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:38:04.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:38:04.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:38:34.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:38:34.256 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:39:04.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:39:04.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:39:34.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:39:34.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:40:04.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:40:04.629 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:40:34.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:40:34.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:41:04.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:41:04.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:41:35.079 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:41:35.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:42:05.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:42:05.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:42:35.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:42:35.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:43:05.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:43:05.465 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:43:35.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:43:35.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:44:05.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:44:05.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:44:35.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:44:35.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:45:05.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:45:05.972 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:45:36.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:45:36.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:46:06.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:46:06.244 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:46:36.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:46:36.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:47:06.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:47:06.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:47:36.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:47:36.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:48:06.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:48:06.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:48:36.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:48:36.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:49:07.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:49:07.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:49:37.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:49:37.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:50:07.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:50:07.384 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:50:37.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:50:37.448 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:51:07.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:51:08.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:51:38.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:51:38.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:52:08.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:52:08.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:52:38.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:52:38.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:53:08.553 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:53:08.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:53:38.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:53:38.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:54:08.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:54:08.841 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:54:38.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:54:38.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:55:09.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:55:09.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:55:39.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:55:39.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:56:09.614 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:56:09.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:56:39.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:56:39.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:57:09.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:57:09.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:57:40.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:57:40.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:58:10.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:58:10.409 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:58:40.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:58:40.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:59:10.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:59:10.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:59:40.814 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-18T23:59:40.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:00:10.881 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:00:10.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:00:41.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:00:41.048 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:01:11.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:01:11.201 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:01:41.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:01:41.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:02:11.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:02:11.515 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:02:41.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:02:41.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:03:11.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:03:11.873 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:03:41.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:03:41.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:04:12.142 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:04:12.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:04:42.310 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:04:42.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:05:12.450 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:05:12.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:05:42.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:05:42.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:06:12.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:06:12.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:06:42.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:06:42.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:07:12.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:07:12.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:07:43.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:07:43.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:08:13.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:08:13.259 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:08:43.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:08:43.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:09:13.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:09:13.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:09:43.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:09:43.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:10:13.831 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:10:13.834 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:10:43.892 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:10:43.895 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:11:14.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:11:14.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:11:44.288 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:11:44.291 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:12:14.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:12:14.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:12:44.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:12:44.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:13:14.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:13:14.710 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:13:44.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:13:44.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:14:14.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:14:14.963 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:14:45.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:14:45.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:15:15.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:15:15.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:15:45.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:15:45.437 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:16:15.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:16:15.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:16:45.714 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:16:45.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:17:15.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:17:15.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:17:45.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:17:45.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:18:16.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:18:16.036 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:18:46.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:18:46.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:19:16.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:19:16.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:19:46.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:19:46.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:20:16.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:20:16.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:20:46.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:20:46.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:21:16.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:21:16.967 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:21:47.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:21:47.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:22:17.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:22:17.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:22:47.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:22:47.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:23:17.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:23:17.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:23:47.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:23:47.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:24:17.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:24:17.585 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:24:47.750 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:24:47.755 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:25:17.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:25:17.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:25:48.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:25:48.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:26:18.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:26:18.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:26:48.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:26:48.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:27:18.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:27:18.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:27:48.586 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:27:48.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:28:18.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:28:18.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:28:48.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:28:48.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:29:18.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:29:18.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:29:49.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:29:49.082 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:30:19.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:30:19.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:30:49.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:30:49.391 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:31:19.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:31:19.529 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:31:49.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:31:49.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:32:19.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:32:19.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:32:49.886 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:32:49.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:33:19.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:33:19.972 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:33:50.115 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:33:50.117 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:34:20.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:34:20.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:34:50.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:34:50.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:35:20.551 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:35:20.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:35:50.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:35:50.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:36:20.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:36:20.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:36:50.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:36:50.920 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:37:21.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:37:21.053 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:37:51.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:37:51.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:38:21.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:38:21.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:38:51.410 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:38:51.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:39:21.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:39:21.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:39:51.672 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:39:51.676 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:40:21.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:40:21.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:40:51.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:40:51.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:41:22.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:41:22.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:41:52.398 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:41:52.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:42:22.526 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:42:22.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:42:52.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:42:52.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:43:22.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:43:22.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:43:52.976 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:43:52.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:44:23.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:44:23.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:44:53.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:44:53.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:45:23.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:45:23.391 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:45:53.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:45:53.514 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:46:23.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:46:23.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:46:53.856 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:46:53.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:47:24.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:47:24.004 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:47:54.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:47:54.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:48:24.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:48:24.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:48:54.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:48:54.344 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:49:24.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:49:24.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:49:54.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:49:54.688 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:50:24.820 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:50:24.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:50:54.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:50:54.980 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:51:25.114 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:51:25.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:51:55.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:51:55.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:52:25.372 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:52:25.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:52:55.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:52:55.537 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:53:25.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:53:25.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:53:55.817 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:53:55.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:54:25.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:54:25.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:54:56.101 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:54:56.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:55:26.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:55:26.247 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:55:56.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:55:56.377 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:56:26.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:56:26.520 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:56:56.646 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:56:56.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:57:26.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:57:26.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:57:56.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:57:56.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:58:27.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:58:27.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:58:57.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:58:57.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:59:27.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:59:27.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:59:57.456 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T00:59:57.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:00:27.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:00:27.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:00:57.788 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:00:57.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:01:27.959 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:01:27.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:01:58.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:01:58.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:02:28.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:02:28.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:02:58.260 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:02:58.263 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:03:28.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:03:28.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:03:58.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:03:58.481 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:04:28.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:04:28.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:04:58.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:04:58.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:05:28.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:05:28.829 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:05:59.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:05:59.061 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:06:29.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:06:29.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:06:59.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:06:59.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:07:29.552 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:07:29.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:07:59.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:07:59.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:08:29.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:08:29.830 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:08:59.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:08:59.968 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:09:30.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:09:30.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:10:00.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:10:00.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:10:30.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:10:30.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:11:00.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:11:00.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:11:30.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:11:30.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:12:00.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:12:00.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:12:30.930 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:12:30.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:13:01.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:13:01.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:13:31.196 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:13:31.199 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:14:01.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:14:01.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:14:31.410 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:14:31.413 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:15:01.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:15:01.548 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:15:31.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:15:31.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:16:01.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:16:01.823 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:16:31.882 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:16:31.885 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:17:02.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:17:02.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:17:32.096 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:17:32.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:18:02.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:18:02.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:18:32.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:18:32.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:19:02.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:19:02.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:19:32.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:19:32.536 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:20:02.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:20:02.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:20:32.782 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:20:32.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:21:02.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:21:02.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:21:32.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:21:32.966 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:22:03.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:22:03.038 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:22:33.106 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:22:33.109 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:23:03.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:23:03.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:23:33.335 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:23:33.338 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:24:03.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:24:03.482 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:24:33.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:24:33.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:25:03.751 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:25:03.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:25:33.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:25:33.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:26:04.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:26:04.028 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:26:34.153 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:26:34.156 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:27:04.306 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:27:04.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:27:34.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:27:34.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:28:04.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:28:04.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:28:34.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:28:34.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:29:04.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:29:04.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:29:34.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:29:34.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:30:05.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:30:05.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:30:35.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:30:35.090 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:31:05.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:31:05.210 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:31:35.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:31:35.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:32:05.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:32:05.489 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:32:35.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:32:35.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:33:05.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:33:05.786 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:33:35.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:33:35.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:34:05.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:34:05.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:34:36.118 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:34:36.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:35:06.291 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:35:06.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:35:36.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:35:36.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:36:06.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:36:06.559 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:36:36.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:36:36.713 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:37:06.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:37:06.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:37:36.907 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:37:36.910 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:38:07.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:38:07.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:38:37.107 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:38:37.110 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:39:07.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:39:07.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:39:37.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:39:37.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:40:07.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:40:07.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:40:37.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:40:37.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:41:07.630 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:41:07.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:41:37.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:41:37.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:42:07.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:42:07.845 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:42:37.913 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:42:37.916 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:43:08.052 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:43:08.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:43:38.138 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:43:38.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:44:08.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:44:08.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:44:38.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:44:38.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:45:08.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:45:08.552 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:45:38.711 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:45:38.741 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:46:08.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:46:08.891 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:46:38.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:46:38.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:47:09.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:47:09.088 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:47:39.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:47:39.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:48:09.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:48:09.324 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:48:39.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:48:39.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:49:09.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:49:09.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:49:39.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:49:39.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:50:09.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:50:09.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:50:39.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:50:39.995 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:51:10.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:51:10.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:51:40.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:51:40.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:52:10.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:52:10.448 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:52:40.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:52:40.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:53:10.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:53:10.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:53:40.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:53:40.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:54:11.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:54:11.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:54:41.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:54:41.316 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:55:11.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:55:11.392 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:55:41.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:55:41.574 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:56:11.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:56:11.727 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:56:41.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:56:41.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:57:12.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:57:12.007 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:57:42.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:57:42.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:58:12.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:58:12.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:58:42.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:58:42.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:59:12.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:59:12.526 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:59:42.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T01:59:42.790 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:00:12.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:00:12.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:00:43.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:00:43.031 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:01:13.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:01:13.148 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:01:43.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:01:43.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:02:13.426 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:02:13.429 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:02:43.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:02:43.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:03:13.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:03:13.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:03:43.961 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:03:43.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:04:14.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:04:14.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:04:44.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:04:44.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:05:14.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:05:14.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:05:44.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:05:44.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:06:14.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:06:14.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:06:44.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:06:44.782 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:07:14.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:07:14.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:07:45.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:07:45.086 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:08:15.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:08:15.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:08:45.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:08:45.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:09:15.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:09:15.380 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:09:45.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:09:45.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:10:15.547 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:10:15.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:10:45.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:10:45.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:11:15.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:11:15.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:11:45.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:11:45.743 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:12:15.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:12:15.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:12:45.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:12:45.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:13:15.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:13:15.970 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:13:46.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:13:46.027 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:14:16.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:14:16.089 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:14:46.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:14:46.166 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:15:16.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:15:16.227 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:15:46.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:15:46.296 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:16:16.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:16:16.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:16:46.426 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:16:46.429 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:17:16.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:17:16.494 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:17:46.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:17:46.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:18:16.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:18:16.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:18:46.690 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:18:46.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:19:16.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:19:16.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:19:46.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:19:46.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:20:16.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:20:16.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:20:46.983 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:20:46.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:21:17.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:21:17.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:21:47.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:21:47.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:22:17.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:22:17.166 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:22:47.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:22:47.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:23:17.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:23:17.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:23:47.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:23:47.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:24:17.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:24:17.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:24:47.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:24:47.485 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:25:17.555 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:25:17.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:25:47.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:25:47.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:26:17.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:26:17.702 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:26:47.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:26:47.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:27:18.053 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:27:18.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:27:48.192 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:27:48.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:28:18.283 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:28:18.286 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:28:48.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:28:48.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:29:18.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:29:18.498 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:29:48.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:29:48.661 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:30:18.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:30:18.818 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:30:48.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:30:48.889 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:31:18.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:31:18.980 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:31:49.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:31:49.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:32:19.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:32:19.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:32:49.246 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:32:49.249 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:33:19.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:33:19.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:33:49.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:33:49.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:34:19.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:34:19.451 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:34:49.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:34:49.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:35:19.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:35:19.586 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:35:49.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:35:49.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:36:19.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:36:19.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:36:49.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:36:49.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:37:19.842 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:37:19.845 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:37:49.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:37:49.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:38:19.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:38:19.993 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:38:50.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:38:50.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:39:20.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:39:20.135 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:39:50.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:39:50.245 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:40:20.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:40:20.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:40:50.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:40:50.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:41:20.649 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:41:20.652 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:41:50.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:41:50.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:42:20.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:42:20.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:42:51.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:42:51.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:43:21.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:43:21.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:43:51.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:43:51.267 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:44:21.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:44:21.398 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:44:51.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:44:51.521 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:45:21.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:45:21.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:45:51.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:45:51.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:46:21.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:46:21.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:46:51.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:46:51.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:47:22.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:47:22.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:47:52.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:47:52.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:48:22.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:48:22.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:48:52.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:48:52.367 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:49:22.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:49:22.438 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:49:52.501 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:49:52.504 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:50:22.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:50:22.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:50:52.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:50:52.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:51:22.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:51:22.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:51:52.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:51:52.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:52:22.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:52:22.876 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:52:52.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:52:52.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:53:23.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:53:23.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:53:53.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:53:53.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:54:23.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:54:23.194 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:54:53.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:54:53.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:55:23.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:55:23.389 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:55:53.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:55:53.528 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:56:23.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:56:23.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:56:53.814 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:56:53.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:57:23.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:57:23.972 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:57:54.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:57:54.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:58:24.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:58:24.129 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:58:54.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:58:54.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:59:24.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:59:24.439 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:59:54.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T02:59:54.579 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:00:24.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:00:24.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:00:54.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:00:54.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:01:24.936 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:01:24.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:01:54.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:01:55.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:02:25.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:02:25.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:02:55.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:02:55.132 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:03:25.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:03:25.197 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:03:55.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:03:55.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:04:25.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:04:25.352 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:04:55.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:04:55.416 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:05:25.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:05:25.481 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:05:55.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:05:55.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:06:25.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:06:25.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:06:55.672 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:06:55.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:07:25.736 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:07:25.739 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:07:55.801 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:07:55.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:08:25.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:08:25.878 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:08:55.959 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:08:55.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:09:26.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:09:26.107 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:09:56.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:09:56.186 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:10:26.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:10:26.323 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:10:56.456 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:10:56.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:11:26.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:11:26.580 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:11:56.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:11:56.691 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:12:26.817 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:12:26.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:12:56.961 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:12:56.965 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:13:27.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:13:27.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:13:57.096 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:13:57.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:14:27.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:14:27.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:14:57.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:14:57.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:15:27.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:15:27.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:15:57.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:15:57.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:16:27.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:16:27.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:16:57.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:16:57.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:17:27.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:17:27.816 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:17:57.879 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:17:57.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:18:28.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:18:28.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:18:58.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:18:58.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:19:28.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:19:28.324 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:19:58.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:19:58.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:20:28.635 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:20:28.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:20:58.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:20:58.711 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:21:28.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:21:28.854 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:21:58.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:21:58.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:22:29.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:22:29.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:22:59.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:22:59.197 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:23:29.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:23:29.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:23:59.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:23:59.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:24:29.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:24:29.598 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:24:59.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:24:59.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:25:29.892 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:25:29.895 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:26:00.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:26:00.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:26:30.181 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:26:30.184 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:27:00.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:27:00.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:27:30.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:27:30.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:28:00.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:28:00.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:28:30.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:28:30.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:29:00.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:29:00.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:29:31.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:29:31.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:30:01.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:30:01.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:30:31.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:30:31.257 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:31:01.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:31:01.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:31:31.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:31:31.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:32:01.692 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:32:01.697 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:32:31.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:32:31.832 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:33:01.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:33:01.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:33:32.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:33:32.045 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:34:02.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:34:02.191 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:34:32.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:34:32.299 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:35:02.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:35:02.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:35:32.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:35:32.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:36:02.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:36:02.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:36:33.138 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:36:33.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:37:03.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:37:03.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:37:33.343 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:37:33.346 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:38:03.505 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:38:03.508 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:38:33.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:38:33.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:39:03.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:39:03.790 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:39:33.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:39:33.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:40:04.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:40:04.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:40:34.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:40:34.182 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:41:04.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:41:04.391 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:41:34.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:41:34.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:42:04.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:42:04.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:42:34.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:42:34.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:43:04.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:43:04.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:43:34.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:43:34.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:44:04.843 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:44:04.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:44:34.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:44:34.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:45:05.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:45:05.059 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:45:35.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:45:35.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:46:05.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:46:05.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:46:35.432 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:46:35.435 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:47:05.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:47:05.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:47:35.731 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:47:35.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:48:05.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:48:05.883 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:48:35.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:48:35.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:49:06.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:49:06.156 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:49:36.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:49:36.311 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:50:06.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:50:06.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:50:36.521 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:50:36.524 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:51:06.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:51:06.688 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:51:36.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:51:36.866 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:52:06.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:52:06.934 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:52:37.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:52:37.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:53:07.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:53:07.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:53:37.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:53:37.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:54:07.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:54:07.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:54:37.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:54:37.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:55:07.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:55:07.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:55:37.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:55:37.626 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:56:07.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:56:07.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:56:37.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:56:37.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:57:08.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:57:08.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:57:38.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:57:38.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:58:08.383 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:58:08.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:58:38.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:58:38.524 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:59:08.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:59:08.597 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:59:38.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T03:59:38.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:00:08.882 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:00:08.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:00:39.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:00:39.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:01:09.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:01:09.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:01:39.346 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:01:39.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:02:09.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:02:09.485 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:02:39.690 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:02:39.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:03:09.763 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:03:09.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:03:39.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:03:39.971 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:04:10.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:04:10.086 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:04:40.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:04:40.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:05:10.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:05:10.317 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:05:40.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:05:40.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:06:10.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:06:10.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:06:40.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:06:40.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:07:10.881 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:07:10.883 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:07:41.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:07:41.023 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:08:11.168 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:08:11.172 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:08:41.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:08:41.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:09:11.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:09:11.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:09:41.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:09:41.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:10:11.677 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:10:11.680 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:10:41.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:10:41.762 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:11:11.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:11:11.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:11:41.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:11:41.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:12:12.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:12:12.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:12:42.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:12:42.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:13:12.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:13:12.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:13:42.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:13:42.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:14:12.743 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:14:12.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:14:42.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:14:42.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:15:13.031 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:15:13.034 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:15:43.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:15:43.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:16:13.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:16:13.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:16:43.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:16:43.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:17:13.630 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:17:13.634 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:17:43.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:17:43.764 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:18:13.868 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:18:13.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:18:44.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:18:44.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:19:14.156 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:19:14.158 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:19:44.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:19:44.323 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:20:14.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:20:14.384 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:20:44.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:20:44.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:21:14.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:21:14.541 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:21:44.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:21:44.606 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:22:14.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:22:14.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:22:44.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:22:44.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:23:14.792 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:23:14.795 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:23:44.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:23:44.863 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:24:14.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:24:14.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:24:44.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:24:44.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:25:15.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:25:15.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:25:45.110 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:25:45.113 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:26:15.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:26:15.186 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:26:45.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:26:45.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:27:15.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:27:15.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:27:45.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:27:45.439 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:28:15.501 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:28:15.504 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:28:45.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:28:45.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:29:15.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:29:15.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:29:45.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:29:45.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:30:15.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:30:15.839 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:30:45.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:30:45.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:31:15.980 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:31:15.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:31:46.053 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:31:46.056 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:32:16.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:32:16.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:32:46.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:32:46.198 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:33:16.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:33:16.268 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:33:46.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:33:46.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:34:16.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:34:16.422 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:34:46.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:34:46.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:35:16.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:35:16.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:35:46.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:35:46.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:36:16.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:36:16.711 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:36:46.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:36:46.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:37:16.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:37:16.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:37:46.903 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:37:46.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:38:16.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:38:16.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:38:47.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:38:47.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:39:17.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:39:17.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:39:47.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:39:47.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:40:17.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:40:17.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:40:47.274 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:40:47.276 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:41:17.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:41:17.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:41:47.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:41:47.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:42:17.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:42:17.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:42:47.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:42:47.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:43:17.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:43:17.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:43:47.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:43:47.689 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:44:17.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:44:17.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:44:47.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:44:47.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:45:17.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:45:17.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:45:47.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:45:47.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:46:18.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:46:18.028 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:46:48.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:46:48.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:47:18.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:47:18.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:47:48.335 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:47:48.338 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:48:18.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:48:18.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:48:48.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:48:48.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:49:18.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:49:18.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:49:48.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:49:48.806 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:50:18.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:50:18.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:50:49.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:50:49.061 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:51:19.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:51:19.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:51:49.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:51:49.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:52:19.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:52:19.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:52:49.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:52:49.595 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:53:19.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:53:19.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:53:49.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:53:49.807 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:54:19.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:54:19.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:54:49.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:54:49.946 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:55:20.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:55:20.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:55:50.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:55:50.233 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:56:20.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:56:20.355 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:56:50.484 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:56:50.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:57:20.635 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:57:20.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:57:50.838 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:57:50.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:58:21.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:58:21.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:58:51.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:58:51.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:59:21.140 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:59:21.143 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:59:51.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T04:59:51.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:00:21.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:00:21.268 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:00:51.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:00:51.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:01:21.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:01:21.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:01:51.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:01:51.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:02:21.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:02:21.541 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:02:51.677 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:02:51.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:03:21.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:03:21.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:03:51.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:03:51.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:04:22.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:04:22.039 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:04:52.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:04:52.129 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:05:22.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:05:22.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:05:52.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:05:52.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:06:22.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:06:22.355 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:06:52.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:06:52.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:07:22.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:07:22.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:07:52.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:07:52.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:08:22.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:08:22.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:08:52.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:08:52.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:09:23.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:09:23.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:09:53.246 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:09:53.249 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:10:23.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:10:23.406 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:10:53.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:10:53.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:11:23.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:11:23.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:11:53.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:11:53.807 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:12:23.958 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:12:23.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:12:54.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:12:54.022 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:13:24.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:13:24.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:13:54.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:13:54.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:14:24.387 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:14:24.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:14:54.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:14:54.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:15:24.660 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:15:24.664 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:15:54.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:15:54.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:16:24.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:16:24.929 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:16:55.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:16:55.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:17:25.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:17:25.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:17:55.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:17:55.336 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:18:25.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:18:25.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:18:55.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:18:55.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:19:25.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:19:25.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:19:55.830 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:19:55.833 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:20:25.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:20:25.946 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:20:56.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:20:56.070 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:21:26.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:21:26.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:21:56.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:21:56.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:22:26.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:22:26.514 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:22:56.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:22:56.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:23:26.830 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:23:26.834 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:23:56.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:23:56.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:24:27.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:24:27.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:24:57.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:24:57.210 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:25:27.351 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:25:27.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:25:57.487 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:25:57.490 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:26:27.585 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:26:27.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:26:57.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:26:57.727 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:27:27.864 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:27:27.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:27:57.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:27:57.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:28:28.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:28:28.089 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:28:58.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:28:58.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:29:28.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:29:28.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:29:58.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:29:58.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:30:28.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:30:28.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:30:58.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:30:58.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:31:28.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:31:28.985 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:31:59.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:31:59.047 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:32:29.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:32:29.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:32:59.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:32:59.345 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:33:29.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:33:29.465 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:33:59.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:33:59.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:34:29.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:34:29.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:34:59.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:34:59.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:35:29.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:35:29.935 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:36:00.052 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:36:00.056 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:36:30.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:36:30.175 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:37:00.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:37:00.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:37:30.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:37:30.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:38:00.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:38:00.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:38:30.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:38:30.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:39:00.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:39:00.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:39:30.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:39:30.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:40:00.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:40:00.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:40:31.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:40:31.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:41:01.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:41:01.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:41:31.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:41:31.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:42:01.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:42:01.434 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:42:31.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:42:31.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:43:01.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:43:01.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:43:31.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:43:31.876 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:44:01.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:44:01.935 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:44:31.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:44:31.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:45:02.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:45:02.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:45:32.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:45:32.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:46:02.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:46:02.193 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:46:32.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:46:32.256 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:47:02.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:47:02.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:47:32.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:47:32.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:48:02.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:48:02.473 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:48:32.531 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:48:32.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:49:02.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:49:02.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:49:32.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:49:32.666 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:50:02.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:50:02.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:50:32.785 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:50:32.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:51:02.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:51:02.858 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:51:32.916 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:51:32.919 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:52:02.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:52:02.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:52:33.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:52:33.053 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:53:03.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:53:03.112 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:53:33.170 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:53:33.173 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:54:03.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:54:03.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:54:33.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:54:33.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:55:03.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:55:03.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:55:33.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:55:33.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:56:03.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:56:03.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:56:33.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:56:33.559 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:57:03.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:57:03.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:57:33.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:57:33.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:58:03.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:58:03.869 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:58:34.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:58:34.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:59:04.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:59:04.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:59:34.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T05:59:34.336 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:00:04.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:00:04.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:00:34.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:00:34.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:01:04.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:01:04.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:01:34.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:01:34.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:02:05.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:02:05.094 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:02:35.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:02:35.165 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:03:05.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:03:05.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:03:35.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:03:35.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:04:05.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:04:05.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:04:35.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:04:35.439 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:05:05.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:05:05.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:05:35.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:05:35.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:06:05.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:06:05.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:06:35.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:06:35.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:07:05.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:07:05.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:07:35.830 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:07:35.833 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:08:05.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:08:05.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:08:36.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:08:36.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:09:06.181 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:09:06.184 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:09:36.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:09:36.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:10:06.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:10:06.472 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:10:36.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:10:36.609 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:11:06.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:11:06.737 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:11:36.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:11:36.865 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:12:07.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:12:07.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:12:37.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:12:37.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:13:07.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:13:07.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:13:37.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:13:37.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:14:07.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:14:07.398 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:14:37.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:14:37.594 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:15:07.677 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:15:07.680 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:15:37.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:15:37.816 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:16:08.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:16:08.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:16:38.237 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:16:38.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:17:08.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:17:08.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:17:38.453 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:17:38.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:18:08.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:18:08.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:18:38.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:18:38.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:19:08.927 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:19:08.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:19:39.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:19:39.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:20:09.201 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:20:09.204 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:20:39.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:20:39.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:21:09.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:21:09.489 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:21:39.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:21:39.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:22:09.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:22:09.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:22:39.868 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:22:39.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:23:10.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:23:10.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:23:40.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:23:40.144 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:24:10.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:24:10.289 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:24:40.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:24:40.433 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:25:10.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:25:10.529 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:25:40.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:25:40.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:26:10.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:26:10.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:26:40.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:26:40.852 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:27:10.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:27:10.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:27:41.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:27:41.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:28:11.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:28:11.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:28:41.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:28:41.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:29:11.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:29:11.520 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:29:41.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:29:41.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:30:11.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:30:11.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:30:41.785 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:30:41.788 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:31:11.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:31:11.854 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:31:41.983 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:31:41.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:32:12.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:32:12.048 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:32:42.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:32:42.175 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:33:12.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:33:12.322 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:33:42.387 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:33:42.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:34:12.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:34:12.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:34:42.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:34:42.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:35:12.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:35:12.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:35:42.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:35:42.666 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:36:12.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:36:12.730 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:36:42.792 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:36:42.795 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:37:12.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:37:12.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:37:42.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:37:42.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:38:13.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:38:13.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:38:43.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:38:43.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:39:13.140 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:39:13.143 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:39:43.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:39:43.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:40:13.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:40:13.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:40:43.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:40:43.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:41:13.410 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:41:13.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:41:43.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:41:43.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:42:13.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:42:13.539 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:42:43.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:42:43.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:43:13.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:43:13.668 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:43:43.743 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:43:43.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:44:13.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:44:13.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:44:43.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:44:43.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:45:14.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:45:14.038 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:45:44.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:45:44.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:46:14.214 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:46:14.218 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:46:44.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:46:44.352 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:47:14.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:47:14.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:47:44.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:47:44.598 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:48:14.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:48:14.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:48:44.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:48:44.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:49:14.936 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:49:14.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:49:45.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:49:45.016 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:50:15.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:50:15.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:50:45.142 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:50:45.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:51:15.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:51:15.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:51:45.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:51:45.266 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:52:15.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:52:15.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:52:45.383 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:52:45.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:53:15.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:53:15.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:53:45.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:53:45.515 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:54:15.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:54:15.595 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:54:45.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:54:45.661 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:55:15.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:55:15.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:55:45.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:55:45.839 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:56:15.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:56:16.001 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:56:46.192 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:56:46.195 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:57:16.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:57:16.283 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:57:46.339 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:57:46.342 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:58:16.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:58:16.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:58:46.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:58:46.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:59:16.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:59:16.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:59:46.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T06:59:46.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:00:16.995 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:00:16.998 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:00:47.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:00:47.111 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:01:17.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:01:17.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:01:47.327 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:01:47.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:02:17.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:02:17.404 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:02:47.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:02:47.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:03:17.549 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:03:17.552 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:03:47.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:03:47.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:04:17.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:04:17.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:04:47.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:04:47.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:05:17.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:05:17.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:05:48.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:05:48.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:06:18.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:06:18.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:06:48.300 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:06:48.303 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:07:18.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:07:18.445 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:07:48.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:07:48.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:08:18.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:08:18.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:08:48.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:08:48.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:09:19.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:09:19.027 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:09:49.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:09:49.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:10:19.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:10:19.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:10:49.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:10:49.355 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:11:19.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:11:19.505 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:11:49.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:11:49.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:12:19.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:12:19.787 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:12:49.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:12:49.897 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:13:20.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:13:20.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:13:50.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:13:50.151 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:14:20.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:14:20.284 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:14:50.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:14:51.955 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:15:22.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:15:22.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:15:52.101 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:15:52.111 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:16:22.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:16:22.177 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:16:52.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:16:52.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:17:22.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:17:22.424 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:17:52.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:17:53.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:18:23.660 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:18:23.663 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:18:53.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:18:53.801 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:19:23.951 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:19:23.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:19:54.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:19:54.107 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:20:24.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:20:24.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:20:54.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:20:54.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:21:24.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:21:24.496 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:21:54.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:21:54.668 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:22:24.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:22:24.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:22:54.877 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:22:54.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:23:25.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:23:25.011 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:23:55.156 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:23:55.159 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:24:25.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:24:25.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:24:55.444 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:24:55.447 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:25:25.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:25:25.593 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:25:55.731 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:25:55.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:26:25.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:26:25.849 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:26:55.983 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:26:55.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:27:26.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:27:26.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:27:56.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:27:56.215 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:28:26.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:28:26.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:28:56.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:28:56.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:29:26.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:29:26.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:29:56.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:29:56.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:30:26.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:30:26.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:30:56.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:30:56.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:31:27.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:31:27.050 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:31:57.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:31:57.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:32:27.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:32:27.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:32:57.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:32:57.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:33:27.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:33:27.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:33:57.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:33:57.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:34:27.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:34:27.829 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:34:57.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:34:57.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:35:28.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:35:28.039 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:35:58.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:35:58.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:36:28.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:36:28.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:36:58.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:36:58.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:37:28.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:37:28.536 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:37:58.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:37:58.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:38:28.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:38:28.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:38:58.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:38:58.929 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:39:29.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:39:29.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:39:59.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:39:59.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:40:29.343 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:40:29.346 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:40:59.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:40:59.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:41:29.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:41:29.471 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:41:59.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:41:59.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:42:29.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:42:29.743 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:42:59.868 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:42:59.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:43:30.026 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:43:30.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:44:00.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:44:00.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:44:30.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:44:30.264 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:45:00.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:45:00.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:45:30.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:45:30.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:46:00.606 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:46:00.609 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:46:30.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:46:30.760 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:47:00.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:47:00.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:47:30.949 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:47:30.952 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:48:01.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:48:01.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:48:31.168 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:48:31.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:49:01.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:49:01.317 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:49:31.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:49:31.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:50:01.649 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:50:01.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:50:31.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:50:31.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:51:01.850 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:51:01.853 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:51:31.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:51:31.986 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:52:02.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:52:02.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:52:32.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:52:32.300 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:53:02.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:53:02.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:53:32.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:53:32.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:54:02.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:54:02.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:54:32.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:54:32.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:55:02.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:55:02.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:55:32.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:55:32.917 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:56:03.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:56:03.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:56:33.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:56:33.158 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:57:03.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:57:03.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:57:33.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:57:33.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:58:03.549 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:58:03.552 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:58:33.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:58:33.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:59:03.762 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:59:03.765 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:59:33.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T07:59:33.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:00:04.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:00:04.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:00:34.214 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:00:34.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:01:04.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:01:04.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:01:34.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:01:34.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:02:04.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:02:04.505 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:02:34.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:02:34.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:03:04.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:03:04.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:03:34.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:03:34.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:04:04.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:04:04.980 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:04:35.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:04:35.136 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:05:05.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:05:05.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:05:35.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:05:35.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:06:05.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:06:05.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:06:35.644 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:06:35.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:07:05.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:07:05.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:07:35.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:07:35.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:08:05.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:08:05.993 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:08:36.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:08:36.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:09:06.278 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:09:06.280 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:09:36.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:09:36.412 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:10:06.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:10:06.562 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:10:36.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:10:36.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:11:06.868 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:11:06.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:11:36.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:11:36.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:12:07.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:12:07.067 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:12:37.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:12:37.206 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:13:07.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:13:07.412 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:13:37.491 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:13:37.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:14:07.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:14:07.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:14:37.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:14:37.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:15:07.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:15:07.837 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:15:37.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:15:37.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:16:07.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:16:07.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:16:38.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:16:38.038 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:17:08.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:17:08.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:17:38.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:17:38.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:18:08.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:18:08.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:18:38.424 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:18:38.427 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:19:08.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:19:08.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:19:38.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:19:38.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:20:08.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:20:08.713 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:20:38.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:20:38.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:21:08.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:21:08.843 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:21:38.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:21:38.995 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:22:09.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:22:09.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:22:39.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:22:39.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:23:09.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:23:09.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:23:39.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:23:39.231 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:24:09.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:24:09.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:24:39.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:24:39.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:25:09.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:25:09.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:25:39.485 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:25:39.488 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:26:09.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:26:09.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:26:39.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:26:39.626 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:27:09.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:27:09.714 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:27:39.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:27:39.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:28:09.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:28:09.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:28:39.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:28:39.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-19T08:29:03.263 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-08-19T08:29:03.314 DEBUG:teuthology.task.console_log:Killing console logger for smithi121 2023-08-19T08:29:03.315 DEBUG:teuthology.task.console_log:Killing console logger for smithi122 2023-08-19T08:29:03.315 DEBUG:teuthology.exit:Finished running handlers